[2025-10-30T17:00:01.140995] [INFO ] [MAIN ] Using last completed trading day: 2025-10-30 [2025-10-30T17:00:01.318084] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-30T17:00:01.318257] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-30T17:00:01.390718] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-30T17:00:01.391058] [WARN ] [STATE ] State set to: RUNNING [2025-10-30T17:00:01.391137] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-30T17:00:01.391180] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-30T17:00:01.391257] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-30T17:00:01.391292] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-30T17:00:02.420497] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-30T17:00:02.420705] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-30T17:00:02.420928] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-30T17:00:02.421421] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-30T17:00:02.421479] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-30T17:00:02.421512] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-30T17:00:02.421568] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-30T17:00:02.421601] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-30T17:00:02.421629] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-30T17:00:02.422153] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-30T17:00:02.422215] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-30T17:00:02.422424] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-30T17:00:02.422486] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-30T17:00:02.422525] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-30T17:00:02.422565] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-30T17:00:02.451297] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-30T17:00:02.479639] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-30T17:00:02.479862] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-30T17:00:02.479907] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-30T17:00:02.479941] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-30T17:00:02.480002] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-30T17:00:02.480433] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-30T17:00:02.480487] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-30T17:00:02.480527] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-30T17:00:02.480561] [INFO ] [MAIN ] Running in parallel mode [2025-10-30T17:00:02.480803] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-10-30T17:00:03.216209] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:03.269926] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-10-30T17:00:03.303267] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:03.342497] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-10-30T17:00:03.350119] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:03.355739] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-30T17:00:03.366677] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-30T17:00:03.386873] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-30T17:00:03.390200] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:03.383019] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-30T17:00:03.390599] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-30T17:00:03.391919] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-30T17:00:03.392545] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-30T17:00:03.392622] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-30T17:00:03.400239] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-30T17:00:03.429491] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-30T17:00:03.745219] [DEBUG] [LOCAL ] AAMI: Loaded 23622 existing records from primary storage. [2025-10-30T17:00:03.833788] [INFO ] [MAIN ] AAMI: Loaded 23622 existing records. [2025-10-30T17:00:04.124974] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-30T17:00:04.234139] [INFO ] [MAIN ] AA: Loaded 53622 existing records. [2025-10-30T17:00:04.420064] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:04.497370] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-30T17:00:04.578854] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:04.543448] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:04.611142] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-30T17:00:04.612350] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-30T17:00:04.636136] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-30T17:00:04.642219] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-30T17:00:04.658116] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-30T17:00:04.806308] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:04.829442] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-30T17:00:04.847587] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-30T17:00:04.860212] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-30T17:00:04.860381] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-30T17:00:05.575715] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:05.584725] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:05.585374] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-30T17:00:05.586049] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-30T17:00:06.106364] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-30T17:00:06.107872] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-30T17:00:07.693665] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-30T17:00:07.694594] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-30T17:00:07.933055] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-30T17:00:07.937206] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-30T17:00:08.296553] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-30T17:00:08.307063] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-30T17:00:08.690728] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (4.08 seconds). [2025-10-30T17:00:08.700628] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-30T17:00:08.967540] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T17:00:08.968459] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-30T17:00:09.452442] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-30T17:00:09.456411] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-30T17:00:11.076478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-30T17:00:11.077440] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-30T17:00:11.266802] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.19 seconds). [2025-10-30T17:00:11.269402] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.96 seconds). [2025-10-30T17:00:11.268332] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-30T17:00:11.281547] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-30T17:00:11.757105] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (3.06 seconds). [2025-10-30T17:00:11.770118] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-30T17:00:11.826309] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T17:00:11.827612] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-30T17:00:11.846414] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-30T17:00:11.852375] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-30T17:00:12.037062] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-30T17:00:12.038162] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-30T17:00:12.297364] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-30T17:00:12.298672] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-30T17:00:12.755119] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-30T17:00:12.761438] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-30T17:00:12.850664] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T17:00:12.851520] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-30T17:00:13.024989] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T17:00:13.035359] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-30T17:00:13.231557] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-30T17:00:13.233147] [INFO ] [REMOTE ] AAM: Full fetch complete (915 records). [2025-10-30T17:00:13.234138] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-30T17:00:13.234301] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-30T17:00:13.298497] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-30T17:00:13.469670] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-30T17:00:13.469884] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:00:13.469980] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:00:13.470080] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-30T17:00:13.470190] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-30T17:00:13.470260] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-30T17:00:13.470335] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-30T17:00:13.470403] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 10.9s. Estimated remaining: 7h 13m 11s. Rate: 5.5 symbols/min [2025-10-30T17:00:13.670207] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:13.725266] [DEBUG] [LOCAL ] AAP: Loaded 51534 existing records from primary storage. [2025-10-30T17:00:13.725611] [INFO ] [MAIN ] AAP: Loaded 51534 existing records. [2025-10-30T17:00:13.972469] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:13.972772] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-30T17:00:13.972834] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-30T17:00:13.973257] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-30T17:00:13.973298] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-30T17:00:14.514235] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:14.515012] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-30T17:00:14.566776] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T17:00:14.581066] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-30T17:00:15.043924] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-30T17:00:15.049744] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-30T17:00:15.633370] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T17:00:15.643380] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-30T17:00:15.991152] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T17:00:15.997213] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-30T17:00:16.109947] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-30T17:00:16.121446] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-30T17:00:16.409663] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-30T17:00:16.420711] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-30T17:00:16.969152] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T17:00:16.979394] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-30T17:00:16.996669] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T17:00:17.003075] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-30T17:00:17.347365] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T17:00:17.357586] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-30T17:00:18.076919] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-30T17:00:18.088672] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-30T17:00:18.265099] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T17:00:18.276319] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-30T17:00:18.651524] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T17:00:18.664055] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-30T17:00:18.713820] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-30T17:00:18.719340] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-30T17:00:19.460989] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T17:00:19.473191] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-30T17:00:19.587995] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T17:00:19.594083] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-30T17:00:19.792540] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-30T17:00:19.806226] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-30T17:00:19.862509] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T17:00:19.873025] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-30T17:00:20.402979] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T17:00:20.407626] [INFO ] [REMOTE ] AAMI: Full fetch complete (32992 records). [2025-10-30T17:00:20.407733] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-30T17:00:20.408730] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:00:20.408814] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:00:20.408858] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:00:20.408924] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-30T17:00:20.408986] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-30T17:00:20.409023] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-30T17:00:20.409186] [DEBUG] [LOCAL ] AAMI: Deleted derivative data file. [2025-10-30T17:00:20.409276] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 17.8s. Estimated remaining: 5h 53m 12s. Rate: 6.7 symbols/min [2025-10-30T17:00:20.579376] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:20.607976] [DEBUG] [LOCAL ] AAT: Loaded 29845 existing records from primary storage. [2025-10-30T17:00:20.608225] [INFO ] [MAIN ] AAT: Loaded 29845 existing records. [2025-10-30T17:00:20.787609] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:20.787844] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-30T17:00:20.787898] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-30T17:00:20.788216] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-30T17:00:20.788277] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-30T17:00:21.154244] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:21.154685] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-30T17:00:21.191255] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-30T17:00:21.208434] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-30T17:00:21.253520] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-30T17:00:21.267397] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-30T17:00:21.378582] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T17:00:21.391207] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-30T17:00:21.994914] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T17:00:22.000297] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-30T17:00:22.534122] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T17:00:22.544514] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-30T17:00:22.854911] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-30T17:00:22.860780] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-30T17:00:22.890926] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-30T17:00:22.902876] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-30T17:00:23.028753] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T17:00:23.039401] [INFO ] [REMOTE ] A: Full fetch complete (73166 records). [2025-10-30T17:00:23.039524] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-30T17:00:23.041553] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:00:23.041937] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:00:23.042009] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:00:23.042082] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-30T17:00:23.042144] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-30T17:00:23.042180] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-10-30T17:00:23.042219] [DEBUG] [LOCAL ] A: No derivative data file found to delete. [2025-10-30T17:00:23.042275] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 20.6s. Estimated remaining: 4h 29m 56s. Rate: 8.8 symbols/min [2025-10-30T17:00:23.213235] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:23.213389] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-30T17:00:23.213427] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-30T17:00:23.213535] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-30T17:00:23.213577] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-30T17:00:23.213617] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-30T17:00:23.213674] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-30T17:00:23.603502] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:23.603878] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-30T17:00:23.776827] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:00:23.777153] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-30T17:00:23.777256] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:00:23.777350] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-30T17:00:23.777435] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:00:23.777527] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-30T17:00:23.777614] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-30T17:00:23.777683] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-30T17:00:23.777746] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-30T17:00:23.777796] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 0.7s. Estimated remaining: 3h 29m 36s. Rate: 11.3 symbols/min [2025-10-30T17:00:23.960337] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:24.026804] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-30T17:00:24.027997] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T17:00:24.055025] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-30T17:00:24.055981] [DEBUG] [LOCAL ] AB: Loaded 23912 existing records from primary storage. [2025-10-30T17:00:24.056295] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-30T17:00:24.058385] [INFO ] [MAIN ] AB: Loaded 23912 existing records. [2025-10-30T17:00:24.247168] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:24.247552] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-30T17:00:24.247824] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-30T17:00:24.248207] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-30T17:00:24.248305] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-30T17:00:24.579811] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T17:00:24.643324] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-30T17:00:24.646895] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:24.647290] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-30T17:00:25.075948] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T17:00:25.083792] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-30T17:00:25.375520] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:00:25.386397] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-30T17:00:25.784257] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T17:00:25.791879] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-30T17:00:26.054186] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:00:26.060846] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-30T17:00:26.279165] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T17:00:26.291987] [INFO ] [REMOTE ] AA: Full fetch complete (77352 records). [2025-10-30T17:00:26.292882] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-30T17:00:26.294230] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:00:26.294436] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:00:26.294488] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:00:26.294575] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-30T17:00:26.294681] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-30T17:00:26.294749] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-10-30T17:00:26.294970] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-10-30T17:00:26.295729] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 23.8s. Estimated remaining: 3h 7m 25s. Rate: 12.6 symbols/min [2025-10-30T17:00:26.462595] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:26.515043] [DEBUG] [LOCAL ] ABBV: Loaded 53674 existing records from primary storage. [2025-10-30T17:00:26.515386] [INFO ] [MAIN ] ABBV: Loaded 53674 existing records. [2025-10-30T17:00:26.701577] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:26.701979] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-30T17:00:26.702085] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-30T17:00:26.702903] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-30T17:00:26.702961] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-30T17:00:27.022182] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-30T17:00:27.117792] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-30T17:00:27.195897] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:27.200136] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-30T17:00:27.199267] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T17:00:27.208338] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-30T17:00:27.234976] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T17:00:27.244534] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-30T17:00:28.361610] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T17:00:28.369854] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-30T17:00:28.397918] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T17:00:28.408257] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-30T17:00:28.674563] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T17:00:28.688087] [INFO ] [REMOTE ] AAP: Full fetch complete (74975 records). [2025-10-30T17:00:28.688219] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-30T17:00:29.029133] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-30T17:00:29.050445] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-30T17:00:29.152443] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-30T17:00:29.152636] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-30T17:00:29.153423] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-30T17:00:29.153585] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-30T17:00:29.156665] [DEBUG] [LOCAL ] AAP: Trimmed 74975 records to 51923 (keeping 200 days of data) [2025-10-30T17:00:29.474961] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T17:00:29.503315] [DEBUG] [LOCAL ] AAP: Primary data saved (51923 records). [2025-10-30T17:00:29.503674] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-30T17:00:29.504239] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAP took 16.0s. Estimated remaining: 2h 57m 9s. Rate: 13.3 symbols/min [2025-10-30T17:00:29.504718] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-30T17:00:29.638760] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T17:00:29.663827] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-30T17:00:29.722782] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:29.749538] [DEBUG] [LOCAL ] ABCB: Loaded 30076 existing records from primary storage. [2025-10-30T17:00:29.749881] [INFO ] [MAIN ] ABCB: Loaded 30076 existing records. [2025-10-30T17:00:29.931113] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:29.931320] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-30T17:00:29.931370] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-30T17:00:29.931579] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-30T17:00:29.931618] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-30T17:00:30.287139] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:30.287462] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-30T17:00:30.542968] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T17:00:30.553028] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-30T17:00:30.641324] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T17:00:30.647842] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-30T17:00:30.671788] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T17:00:30.678054] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-30T17:00:31.428346] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T17:00:31.433297] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-30T17:00:31.543766] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T17:00:31.550464] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-30T17:00:31.633080] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T17:00:31.639954] [INFO ] [REMOTE ] AAT: Full fetch complete (43163 records). [2025-10-30T17:00:31.640047] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-30T17:00:32.015730] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-30T17:00:32.015935] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-30T17:00:32.016573] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-30T17:00:32.016843] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-30T17:00:32.018390] [DEBUG] [LOCAL ] AAT: Trimmed 43163 records to 30102 (keeping 200 days of data) [2025-10-30T17:00:32.159777] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-30T17:00:32.181748] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-30T17:00:32.245842] [DEBUG] [LOCAL ] AAT: Primary data saved (30102 records). [2025-10-30T17:00:32.245956] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-30T17:00:32.246033] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAT took 11.8s. Estimated remaining: 2h 47m 11s. Rate: 14.1 symbols/min [2025-10-30T17:00:32.396187] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T17:00:32.450405] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-30T17:00:32.450119] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:32.470322] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T17:00:32.478795] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-30T17:00:32.521919] [DEBUG] [LOCAL ] ABEV: Loaded 53277 existing records from primary storage. [2025-10-30T17:00:32.522229] [INFO ] [MAIN ] ABEV: Loaded 53277 existing records. [2025-10-30T17:00:32.698100] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:32.698336] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-30T17:00:32.698401] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-30T17:00:32.698909] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-30T17:00:32.698968] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-30T17:00:33.051787] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:33.052085] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-30T17:00:33.214262] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-30T17:00:33.219332] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-30T17:00:33.416014] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T17:00:33.423211] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-30T17:00:33.703057] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-30T17:00:33.714169] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-30T17:00:34.182006] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T17:00:34.187376] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-30T17:00:34.395923] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:00:34.406480] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-30T17:00:34.556201] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T17:00:34.564095] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-30T17:00:35.300258] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-30T17:00:35.305832] [INFO ] [REMOTE ] AB: Full fetch complete (43654 records). [2025-10-30T17:00:35.305955] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-30T17:00:35.722148] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T17:00:35.728815] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-30T17:00:35.729892] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-30T17:00:35.729489] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-30T17:00:35.731628] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-30T17:00:35.731991] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-30T17:00:35.787491] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-30T17:00:35.782944] [DEBUG] [LOCAL ] AB: Trimmed 43654 records to 24123 (keeping 200 days of data) [2025-10-30T17:00:35.799606] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-30T17:00:35.860993] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-30T17:00:35.901059] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-30T17:00:35.954430] [DEBUG] [LOCAL ] AB: Primary data saved (24123 records). [2025-10-30T17:00:35.954539] [INFO ] [MAIN ] AB: Full history saved. [2025-10-30T17:00:35.954613] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 12.2s. Estimated remaining: 2h 44m 26s. Rate: 14.3 symbols/min [2025-10-30T17:00:36.123337] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:36.139296] [DEBUG] [LOCAL ] ABG: Loaded 17324 existing records from primary storage. [2025-10-30T17:00:36.139520] [INFO ] [MAIN ] ABG: Loaded 17324 existing records. [2025-10-30T17:00:36.315637] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:36.315872] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-30T17:00:36.315923] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-30T17:00:36.316113] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-30T17:00:36.316152] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-30T17:00:36.671708] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:36.672243] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-30T17:00:36.718415] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-30T17:00:36.724616] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-30T17:00:37.346249] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T17:00:37.358063] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-30T17:00:37.371280] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T17:00:37.375796] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-30T17:00:37.432396] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T17:00:37.443405] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-30T17:00:37.758966] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T17:00:37.765992] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-30T17:00:38.067483] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-30T17:00:38.071102] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-30T17:00:38.604713] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-30T17:00:38.611490] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-30T17:00:38.661062] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T17:00:38.672907] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-30T17:00:38.700808] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T17:00:38.705636] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-30T17:00:38.904611] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T17:00:38.916345] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-30T17:00:39.654524] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T17:00:39.660920] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-30T17:00:39.813934] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T17:00:39.820763] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-30T17:00:40.172771] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T17:00:40.184260] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-30T17:00:40.429949] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-30T17:00:40.441092] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-30T17:00:40.467026] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-30T17:00:40.470400] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-30T17:00:40.884101] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T17:00:40.890905] [INFO ] [REMOTE ] ABCB: Full fetch complete (44712 records). [2025-10-30T17:00:40.890993] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-30T17:00:40.891609] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:00:40.891746] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:00:40.891842] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:00:40.891936] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-30T17:00:40.892017] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-30T17:00:40.892054] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-30T17:00:40.892295] [DEBUG] [LOCAL ] ABCB: Deleted derivative data file. [2025-10-30T17:00:40.892383] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 11.4s. Estimated remaining: 2h 47m 40s. Rate: 14.1 symbols/min [2025-10-30T17:00:41.065542] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:41.094439] [DEBUG] [LOCAL ] ABM: Loaded 31578 existing records from primary storage. [2025-10-30T17:00:41.094752] [INFO ] [MAIN ] ABM: Loaded 31578 existing records. [2025-10-30T17:00:41.304556] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:41.311981] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-30T17:00:41.312281] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T17:00:41.316405] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-30T17:00:41.312506] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-30T17:00:41.317893] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-30T17:00:41.318031] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-30T17:00:41.677053] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-30T17:00:41.733399] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-30T17:00:41.733129] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:41.733736] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-30T17:00:42.033489] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-30T17:00:42.045230] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-30T17:00:42.143616] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-30T17:00:42.148418] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-30T17:00:42.682192] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T17:00:42.688459] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-30T17:00:42.742298] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-30T17:00:42.747203] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-30T17:00:43.062251] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T17:00:43.079752] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-30T17:00:43.232525] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T17:00:43.236442] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-30T17:00:43.507764] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T17:00:43.512902] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-30T17:00:43.874952] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-30T17:00:43.887594] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-10-30T17:00:43.887788] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-30T17:00:44.174129] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T17:00:44.204703] [INFO ] [REMOTE ] ABG: Full fetch complete (26891 records). [2025-10-30T17:00:44.210426] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-30T17:00:44.369203] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-30T17:00:44.385708] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-30T17:00:44.427737] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-30T17:00:44.428631] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-30T17:00:44.499183] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 54064 (keeping 200 days of data) [2025-10-30T17:00:44.930631] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-30T17:00:45.019845] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-30T17:00:45.026631] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-30T17:00:45.039591] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-30T17:00:45.057714] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-30T17:00:45.040003] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-30T17:00:45.067713] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-30T17:00:45.068057] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-30T17:00:45.093908] [DEBUG] [LOCAL ] ABG: Trimmed 26891 records to 17447 (keeping 200 days of data) [2025-10-30T17:00:45.286401] [DEBUG] [LOCAL ] ABG: Primary data saved (17447 records). [2025-10-30T17:00:45.292505] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-30T17:00:45.292628] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABG took 9.3s. Estimated remaining: 2h 48m 7s. Rate: 14.0 symbols/min [2025-10-30T17:00:45.292373] [DEBUG] [LOCAL ] ABBV: Primary data saved (54064 records). [2025-10-30T17:00:45.304539] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-30T17:00:45.335970] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABBV took 19.0s. Estimated remaining: 2h 32m 55s. Rate: 15.4 symbols/min [2025-10-30T17:00:45.628893] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:45.647900] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-10-30T17:00:45.657143] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-10-30T17:00:45.658331] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-30T17:00:45.676236] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-30T17:00:45.681161] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-30T17:00:45.681072] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:45.681280] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-30T17:00:46.071735] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:46.072170] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-30T17:00:46.074315] [DEBUG] [LOCAL ] ABT: Loaded 53625 existing records from primary storage. [2025-10-30T17:00:46.074691] [INFO ] [MAIN ] ABT: Loaded 53625 existing records. [2025-10-30T17:00:46.268277] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:46.268675] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-30T17:00:46.268783] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-30T17:00:46.269565] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-30T17:00:46.269627] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-30T17:00:46.416483] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T17:00:46.490319] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-30T17:00:46.675811] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:46.676152] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-30T17:00:46.733109] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-30T17:00:46.744543] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-30T17:00:47.335628] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T17:00:47.342156] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-30T17:00:47.634708] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T17:00:47.644769] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-30T17:00:48.310103] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-30T17:00:48.321672] [INFO ] [REMOTE ] ABEV: Full fetch complete (76938 records). [2025-10-30T17:00:48.321849] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-30T17:00:48.322739] [FATAL] [VALIDATOR ] ABEV: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:00:48.322827] [FATAL] [MAIN ] ABEV: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:00:48.322873] [WARN ] [MAIN ] ABEV: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:00:48.322945] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-30T17:00:48.323036] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-30T17:00:48.323095] [INFO ] [LOCAL ] ABEV: Starting deletion of derivative data. [2025-10-30T17:00:48.323295] [DEBUG] [LOCAL ] ABEV: Deleted derivative data file. [2025-10-30T17:00:48.323392] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABEV took 16.1s. Estimated remaining: 2h 29m 53s. Rate: 15.7 symbols/min [2025-10-30T17:00:48.503236] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:48.524202] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:00:48.531800] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-30T17:00:48.558379] [DEBUG] [LOCAL ] ACA: Loaded 21893 existing records from primary storage. [2025-10-30T17:00:48.558739] [INFO ] [MAIN ] ACA: Loaded 21893 existing records. [2025-10-30T17:00:48.746902] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-30T17:00:48.761136] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-30T17:00:48.782168] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:48.782367] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-30T17:00:48.782416] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-30T17:00:48.782732] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-30T17:00:48.782788] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-30T17:00:49.153776] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:49.154194] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-30T17:00:49.181171] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-30T17:00:49.190944] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-30T17:00:49.490406] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T17:00:49.497784] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-30T17:00:50.182713] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T17:00:50.187823] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-30T17:00:50.325594] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-30T17:00:50.336381] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-30T17:00:50.357946] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-30T17:00:50.366632] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-30T17:00:50.674935] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T17:00:50.685836] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-30T17:00:50.914063] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T17:00:50.919122] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-30T17:00:51.262796] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-30T17:00:51.270729] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-30T17:00:51.711270] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T17:00:51.726186] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-30T17:00:51.909087] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T17:00:51.915365] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-30T17:00:51.989155] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T17:00:52.000142] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-30T17:00:52.429375] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T17:00:52.436508] [INFO ] [REMOTE ] ABM: Full fetch complete (45088 records). [2025-10-30T17:00:52.436670] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-30T17:00:52.823378] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-30T17:00:52.823484] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-30T17:00:52.823987] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-30T17:00:52.824070] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-30T17:00:52.825319] [DEBUG] [LOCAL ] ABM: Trimmed 45088 records to 31797 (keeping 200 days of data) [2025-10-30T17:00:52.841860] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T17:00:52.848344] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-30T17:00:53.031952] [DEBUG] [LOCAL ] ABM: Primary data saved (31797 records). [2025-10-30T17:00:53.032081] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-30T17:00:53.032161] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 12.1s. Estimated remaining: 2h 32m 30s. Rate: 15.4 symbols/min [2025-10-30T17:00:53.205481] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:00:53.239192] [DEBUG] [LOCAL ] ACCO: Loaded 36145 existing records from primary storage. [2025-10-30T17:00:53.239631] [INFO ] [MAIN ] ACCO: Loaded 36145 existing records. [2025-10-30T17:00:53.427564] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:00:53.428399] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-30T17:00:53.428918] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-30T17:00:53.429600] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-30T17:00:53.429722] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-30T17:00:53.640948] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-30T17:00:53.735338] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-30T17:00:53.864123] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-30T17:00:53.948577] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:00:53.964135] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T17:00:54.097518] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-30T17:00:54.897566] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-30T17:00:55.184187] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T17:00:55.248717] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-30T17:00:55.697516] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-30T17:00:56.246102] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T17:00:56.497494] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-30T17:00:56.881814] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T17:00:57.297508] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-30T17:00:57.961897] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-30T17:00:58.035550] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-30T17:00:58.097520] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-30T17:00:58.897552] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-30T17:00:59.697515] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-30T17:00:59.791305] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T17:00:59.854285] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-30T17:01:00.497496] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-30T17:01:01.297565] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-30T17:01:01.785104] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-30T17:01:02.097622] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-30T17:01:02.301912] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:01:02.347605] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-30T17:01:02.897506] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-30T17:01:03.644437] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-30T17:01:03.697455] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-30T17:01:04.268172] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T17:01:04.497591] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-30T17:01:05.037074] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T17:01:05.166852] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T17:01:05.297536] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-30T17:01:06.075433] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-30T17:01:06.079973] [INFO ] [REMOTE ] ACA: Full fetch complete (33864 records). [2025-10-30T17:01:06.080065] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-30T17:01:06.080577] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:01:06.080687] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:01:06.080758] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:01:06.080845] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-30T17:01:06.080924] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-30T17:01:06.080975] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-30T17:01:06.081151] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-30T17:01:06.081244] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 17.8s. Estimated remaining: 2h 58m 5s. Rate: 13.2 symbols/min [2025-10-30T17:01:06.103361] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-30T17:01:06.260149] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:06.283278] [DEBUG] [LOCAL ] ACEL: Loaded 25448 existing records from primary storage. [2025-10-30T17:01:06.283516] [INFO ] [MAIN ] ACEL: Loaded 25448 existing records. [2025-10-30T17:01:06.461622] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:01:06.461875] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-30T17:01:06.461938] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-30T17:01:06.462178] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-30T17:01:06.462236] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-30T17:01:06.822468] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:06.897511] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-30T17:01:07.370551] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T17:01:07.660101] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T17:01:07.697525] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-30T17:01:08.497547] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-30T17:01:09.198560] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T17:01:09.297519] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-30T17:01:10.097515] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-30T17:01:10.288464] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-30T17:01:10.301939] [INFO ] [REMOTE ] ABR: Full fetch complete (75332 records). [2025-10-30T17:01:10.302160] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-30T17:01:10.713379] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-30T17:01:10.713490] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-30T17:01:10.714277] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-30T17:01:10.714389] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-30T17:01:10.715845] [DEBUG] [LOCAL ] ABR: Trimmed 75332 records to 52159 (keeping 200 days of data) [2025-10-30T17:01:10.900229] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-30T17:01:11.045390] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T17:01:11.059249] [DEBUG] [LOCAL ] ABR: Primary data saved (52159 records). [2025-10-30T17:01:11.060365] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-30T17:01:11.060479] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABR took 25.8s. Estimated remaining: 2h 59m 9s. Rate: 13.1 symbols/min [2025-10-30T17:01:11.201311] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-30T17:01:11.278269] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:11.331542] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-30T17:01:11.331883] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-30T17:01:11.512135] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:01:11.512345] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-30T17:01:11.512395] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-30T17:01:11.512836] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-30T17:01:11.512895] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-30T17:01:11.704189] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-30T17:01:11.863828] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:12.111169] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T17:01:12.497512] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-30T17:01:13.028384] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:01:13.297501] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-30T17:01:14.097511] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-30T17:01:14.687317] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-30T17:01:14.824851] [DEBUG] [REMOTE ] ABT: Error fetching primary data for 2025-10: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-30T17:01:14.825062] [WARN ] [REMOTE ] ABT: No data returned for month 2025-10 [2025-10-30T17:01:14.825239] [FATAL] [REMOTE ] ABT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:01:14.825324] [FATAL] [MAIN ] ABT: Failed to fetch primary data. [2025-10-30T17:01:14.825439] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:01:14.825530] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-30T17:01:14.825594] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-30T17:01:14.825629] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-30T17:01:14.825896] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-10-30T17:01:14.825984] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ABT took 29.5s. Estimated remaining: 2h 57m 6s. Rate: 13.3 symbols/min [2025-10-30T17:01:14.902728] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-30T17:01:14.997469] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:15.046437] [DEBUG] [LOCAL ] ACI: Loaded 53280 existing records from primary storage. [2025-10-30T17:01:15.046932] [INFO ] [MAIN ] ACI: Loaded 53280 existing records. [2025-10-30T17:01:15.264067] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:01:15.257279] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T17:01:15.271123] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-30T17:01:15.271330] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-30T17:01:15.272308] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-30T17:01:15.272376] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-30T17:01:15.627901] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:15.697458] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-30T17:01:16.497512] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-30T17:01:17.126368] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T17:01:17.180303] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-30T17:01:17.220092] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-30T17:01:17.297520] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-30T17:01:18.097469] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-30T17:01:18.313927] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T17:01:18.897497] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-30T17:01:19.697516] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-30T17:01:20.044369] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T17:01:20.122767] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-30T17:01:20.497516] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-30T17:01:20.834366] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T17:01:21.270354] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T17:01:21.297453] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-30T17:01:22.097493] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-30T17:01:22.475945] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T17:01:22.897542] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-30T17:01:23.697471] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-30T17:01:23.843103] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T17:01:24.097170] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-30T17:01:24.497500] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-30T17:01:25.030501] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T17:01:25.297483] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-30T17:01:25.445416] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T17:01:26.097519] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-30T17:01:26.654946] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T17:01:26.897522] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-30T17:01:27.697486] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-30T17:01:27.856965] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T17:01:28.418974] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-30T17:01:28.497489] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-30T17:01:29.096941] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:01:29.297498] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-30T17:01:30.097526] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-30T17:01:30.618679] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-30T17:01:30.625601] [INFO ] [REMOTE ] ACCO: Full fetch complete (53409 records). [2025-10-30T17:01:30.625759] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-30T17:01:30.627433] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:01:30.627518] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:01:30.627560] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:01:30.627623] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-30T17:01:30.627724] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-30T17:01:30.627767] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-30T17:01:30.627924] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-30T17:01:30.628012] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ACCO took 37.6s. Estimated remaining: 3h 22m 60s. Rate: 11.6 symbols/min [2025-10-30T17:01:30.830346] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:30.870905] [DEBUG] [LOCAL ] ACM: Loaded 42213 existing records from primary storage. [2025-10-30T17:01:30.871242] [INFO ] [MAIN ] ACM: Loaded 42213 existing records. [2025-10-30T17:01:30.907791] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-30T17:01:31.034047] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-30T17:01:31.116996] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:01:31.117336] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-30T17:01:31.117445] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-30T17:01:31.118263] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-30T17:01:31.118324] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-30T17:01:31.301627] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T17:01:31.373938] [INFO ] [REMOTE ] ACEL: Full fetch complete (38565 records). [2025-10-30T17:01:31.398427] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-30T17:01:31.670079] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:31.723336] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-30T17:01:31.949397] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-30T17:01:31.949488] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-30T17:01:31.949970] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-30T17:01:31.950226] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-30T17:01:31.951423] [DEBUG] [LOCAL ] ACEL: Trimmed 38565 records to 25593 (keeping 200 days of data) [2025-10-30T17:01:32.098821] [DEBUG] [LOCAL ] ACEL: Primary data saved (25593 records). [2025-10-30T17:01:32.098950] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-30T17:01:32.099032] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 26.0s. Estimated remaining: 3h 14m 50s. Rate: 12.1 symbols/min [2025-10-30T17:01:32.270627] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:32.319082] [DEBUG] [LOCAL ] ACN: Loaded 53429 existing records from primary storage. [2025-10-30T17:01:32.319534] [INFO ] [MAIN ] ACN: Loaded 53429 existing records. [2025-10-30T17:01:32.498999] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-30T17:01:32.519504] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:01:32.520992] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-30T17:01:32.521190] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-30T17:01:32.536803] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-30T17:01:32.563341] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-30T17:01:32.641423] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-30T17:01:32.949092] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:33.297576] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-30T17:01:33.762609] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T17:01:33.928025] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-30T17:01:34.097514] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-30T17:01:34.568610] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T17:01:34.897544] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-30T17:01:35.697520] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-30T17:01:36.023473] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T17:01:36.284163] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-30T17:01:36.497574] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-30T17:01:37.185752] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T17:01:37.297545] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-30T17:01:37.765392] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T17:01:38.097522] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-30T17:01:38.754045] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T17:01:38.897570] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-30T17:01:39.176598] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T17:01:39.697517] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-30T17:01:40.497502] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-30T17:01:40.982544] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-30T17:01:41.297477] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-30T17:01:41.323698] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-30T17:01:41.823543] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T17:01:42.097497] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-30T17:01:42.897706] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-30T17:01:43.521109] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-30T17:01:43.659978] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-30T17:01:43.671327] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-30T17:01:43.671537] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-30T17:01:43.672510] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:01:43.672610] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:01:43.672720] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:01:43.672819] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-30T17:01:43.672902] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-30T17:01:43.672941] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-30T17:01:43.673116] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-10-30T17:01:43.673211] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACHR took 32.6s. Estimated remaining: 3h 28m 20s. Rate: 11.3 symbols/min [2025-10-30T17:01:43.705346] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-30T17:01:43.848820] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:43.849003] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-30T17:01:43.849041] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-30T17:01:43.849151] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-30T17:01:43.849193] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-30T17:01:43.849238] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-30T17:01:43.849272] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-30T17:01:44.200189] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:44.497583] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-30T17:01:44.674375] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-30T17:01:44.899823] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T17:01:45.297539] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-30T17:01:45.752131] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T17:01:46.097520] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-30T17:01:46.833241] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T17:01:46.897527] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-30T17:01:47.590136] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T17:01:47.697536] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-30T17:01:48.038137] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T17:01:48.497533] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-30T17:01:49.157021] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T17:01:49.297507] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-30T17:01:49.375573] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T17:01:50.097567] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-30T17:01:50.897554] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-30T17:01:51.195530] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-30T17:01:51.209478] [INFO ] [REMOTE ] ACI: Full fetch complete (77226 records). [2025-10-30T17:01:51.209696] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-30T17:01:51.663984] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-30T17:01:51.664166] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-30T17:01:51.664965] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-30T17:01:51.665182] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-30T17:01:51.691334] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-30T17:01:51.701899] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-30T17:01:51.701808] [DEBUG] [LOCAL ] ACI: Trimmed 77226 records to 53669 (keeping 200 days of data) [2025-10-30T17:01:52.040310] [DEBUG] [LOCAL ] ACI: Primary data saved (53669 records). [2025-10-30T17:01:52.040454] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-30T17:01:52.040532] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACI took 37.2s. Estimated remaining: 3h 34m 11s. Rate: 11.0 symbols/min [2025-10-30T17:01:52.228191] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:52.234663] [DEBUG] [LOCAL ] ACR: Loaded 5178 existing records from primary storage. [2025-10-30T17:01:52.234867] [INFO ] [MAIN ] ACR: Loaded 5178 existing records. [2025-10-30T17:01:52.475444] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:01:52.475817] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-30T17:01:52.475869] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-30T17:01:52.476012] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-30T17:01:52.476061] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-30T17:01:52.499071] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-30T17:01:52.879764] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:52.893252] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T17:01:52.958317] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-30T17:01:53.297543] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-30T17:01:53.758047] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T17:01:53.767465] [INFO ] [REMOTE ] ACM: Full fetch complete (62941 records). [2025-10-30T17:01:53.767627] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-30T17:01:54.102621] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-30T17:01:54.171996] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-30T17:01:54.172083] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-30T17:01:54.172701] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-30T17:01:54.172959] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-30T17:01:54.174239] [DEBUG] [LOCAL ] ACM: Trimmed 62941 records to 42483 (keeping 200 days of data) [2025-10-30T17:01:54.458857] [DEBUG] [LOCAL ] ACM: Primary data saved (42483 records). [2025-10-30T17:01:54.458999] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-30T17:01:54.459861] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACM took 23.8s. Estimated remaining: 3h 28m 24s. Rate: 11.3 symbols/min [2025-10-30T17:01:54.650051] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:01:54.684905] [DEBUG] [LOCAL ] ACRE: Loaded 32447 existing records from primary storage. [2025-10-30T17:01:54.685189] [INFO ] [MAIN ] ACRE: Loaded 32447 existing records. [2025-10-30T17:01:54.901445] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:01:54.901623] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-30T17:01:54.902120] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-30T17:01:54.902338] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-30T17:01:54.904202] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-30T17:01:54.904772] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-30T17:01:55.300850] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-30T17:01:55.434465] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:01:55.558938] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:01:55.651525] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-30T17:01:55.697568] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-30T17:01:56.497515] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-30T17:01:56.753107] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T17:01:57.297564] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-30T17:01:57.606419] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T17:01:57.892017] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-30T17:01:58.097508] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-30T17:01:58.897515] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-30T17:01:59.154603] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T17:01:59.702622] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-30T17:01:59.716576] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T17:02:00.497500] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-30T17:02:01.295191] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-30T17:02:01.299257] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-30T17:02:01.582014] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-30T17:02:01.970542] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T17:02:02.097504] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-30T17:02:02.635886] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T17:02:02.897492] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-30T17:02:03.697514] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-30T17:02:04.463826] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T17:02:04.497513] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-30T17:02:04.847602] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T17:02:05.297583] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-30T17:02:05.858115] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T17:02:06.097550] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-30T17:02:06.429440] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-30T17:02:06.441209] [INFO ] [REMOTE ] ACN: Full fetch complete (77421 records). [2025-10-30T17:02:06.441343] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-30T17:02:06.844061] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-30T17:02:06.844156] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-30T17:02:06.844957] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-30T17:02:06.845033] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-30T17:02:06.846911] [DEBUG] [LOCAL ] ACN: Trimmed 77421 records to 53815 (keeping 200 days of data) [2025-10-30T17:02:06.903458] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-30T17:02:07.099733] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:02:07.226596] [DEBUG] [LOCAL ] ACN: Primary data saved (53815 records). [2025-10-30T17:02:07.226773] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-30T17:02:07.226860] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACN took 35.1s. Estimated remaining: 3h 41m 31s. Rate: 10.6 symbols/min [2025-10-30T17:02:07.402420] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:07.402585] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-30T17:02:07.402623] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-30T17:02:07.402774] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-30T17:02:07.402816] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-30T17:02:07.402856] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-30T17:02:07.402888] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-30T17:02:07.590523] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T17:02:07.702778] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-30T17:02:07.793919] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:02:08.497555] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-30T17:02:09.182850] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T17:02:09.297594] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-30T17:02:09.693186] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T17:02:09.981448] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T17:02:10.097496] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-30T17:02:10.487409] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T17:02:10.897497] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-30T17:02:11.526058] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T17:02:11.697531] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-30T17:02:12.058824] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-30T17:02:12.497512] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-30T17:02:13.297537] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-30T17:02:13.631552] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T17:02:13.681838] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T17:02:14.097500] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-30T17:02:14.897472] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-30T17:02:15.003571] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-30T17:02:15.697505] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-30T17:02:15.884089] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T17:02:15.891414] [INFO ] [REMOTE ] ACP: Full fetch complete (45965 records). [2025-10-30T17:02:15.891532] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-30T17:02:15.892143] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:02:15.892222] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:02:15.892291] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:02:15.892381] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-30T17:02:15.892477] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-30T17:02:15.892529] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-30T17:02:15.892574] [DEBUG] [LOCAL ] ACP: No derivative data file found to delete. [2025-10-30T17:02:15.892631] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACP took 32.2s. Estimated remaining: 3h 46m 31s. Rate: 10.3 symbols/min [2025-10-30T17:02:16.100058] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:16.148955] [DEBUG] [LOCAL ] ACVA: Loaded 49044 existing records from primary storage. [2025-10-30T17:02:16.149296] [INFO ] [MAIN ] ACVA: Loaded 49044 existing records. [2025-10-30T17:02:16.317144] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T17:02:16.382917] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:02:16.383134] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-30T17:02:16.383185] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-30T17:02:16.383598] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-30T17:02:16.383695] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-30T17:02:16.502753] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-30T17:02:16.790450] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:02:17.297519] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-30T17:02:17.665296] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T17:02:18.097503] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-30T17:02:18.623473] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T17:02:18.847841] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:02:18.897500] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-30T17:02:19.697511] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-30T17:02:19.893953] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:02:20.190469] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-30T17:02:20.191975] [INFO ] [REMOTE ] ACR: Full fetch complete (8574 records). [2025-10-30T17:02:20.192046] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-30T17:02:20.502832] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-30T17:02:20.584468] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-30T17:02:20.584542] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-30T17:02:20.584747] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-30T17:02:20.584807] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-30T17:02:20.585204] [DEBUG] [LOCAL ] ACR: Trimmed 8574 records to 5256 (keeping 200 days of data) [2025-10-30T17:02:20.617712] [DEBUG] [LOCAL ] ACR: Primary data saved (5256 records). [2025-10-30T17:02:20.617797] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-30T17:02:20.617867] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACR took 28.6s. Estimated remaining: 3h 44m 40s. Rate: 10.4 symbols/min [2025-10-30T17:02:20.797044] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:20.797222] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-30T17:02:20.797270] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-30T17:02:20.797377] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-30T17:02:20.797420] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-30T17:02:20.797461] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-30T17:02:20.797494] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-30T17:02:21.091899] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-30T17:02:21.164860] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:02:21.297493] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-30T17:02:22.097467] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-30T17:02:22.121848] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-30T17:02:22.417952] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-30T17:02:22.897493] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-30T17:02:23.697554] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-30T17:02:23.994786] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T17:02:24.037308] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:02:24.037626] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-30T17:02:24.037744] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:02:24.037824] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-30T17:02:24.037907] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:02:24.038002] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-30T17:02:24.038083] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-30T17:02:24.038134] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-30T17:02:24.038178] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-30T17:02:24.038223] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. AD took 3.4s. Estimated remaining: 3h 40m 55s. Rate: 10.6 symbols/min [2025-10-30T17:02:24.211181] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:24.250020] [DEBUG] [LOCAL ] ADC: Loaded 46236 existing records from primary storage. [2025-10-30T17:02:24.250319] [INFO ] [MAIN ] ADC: Loaded 46236 existing records. [2025-10-30T17:02:24.426905] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:02:24.427132] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-30T17:02:24.427191] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-30T17:02:24.427618] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-30T17:02:24.427701] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-30T17:02:24.502607] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-30T17:02:24.796508] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:02:24.883542] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-30T17:02:25.297493] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-30T17:02:26.097494] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-30T17:02:26.627823] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T17:02:26.634736] [INFO ] [REMOTE ] ACRE: Full fetch complete (48817 records). [2025-10-30T17:02:26.634891] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-30T17:02:26.907504] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-30T17:02:27.060248] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-30T17:02:27.060380] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-30T17:02:27.060901] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-30T17:02:27.060965] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-30T17:02:27.062548] [DEBUG] [LOCAL ] ACRE: Trimmed 48817 records to 32623 (keeping 200 days of data) [2025-10-30T17:02:27.242944] [DEBUG] [LOCAL ] ACRE: Primary data saved (32623 records). [2025-10-30T17:02:27.243072] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-30T17:02:27.243149] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. ACRE took 32.8s. Estimated remaining: 3h 37m 9s. Rate: 10.8 symbols/min [2025-10-30T17:02:27.410359] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:27.442879] [DEBUG] [LOCAL ] ADCT: Loaded 35864 existing records from primary storage. [2025-10-30T17:02:27.443142] [INFO ] [MAIN ] ADCT: Loaded 35864 existing records. [2025-10-30T17:02:27.636830] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:02:27.654861] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-30T17:02:27.655125] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-30T17:02:27.657115] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-30T17:02:27.657064] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-30T17:02:27.657219] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-30T17:02:27.698714] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-30T17:02:28.023721] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:02:28.182266] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-30T17:02:28.213555] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-30T17:02:28.497570] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-30T17:02:29.014125] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T17:02:29.297541] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-30T17:02:30.097484] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-30T17:02:30.235792] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T17:02:30.897548] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-30T17:02:31.403982] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T17:02:31.697521] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-30T17:02:32.068732] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T17:02:32.497742] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-30T17:02:32.863774] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T17:02:33.297487] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-30T17:02:33.406989] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T17:02:34.097523] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-30T17:02:34.332231] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-30T17:02:34.335508] [INFO ] [REMOTE ] ACV: Full fetch complete (10708 records). [2025-10-30T17:02:34.335582] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-30T17:02:34.804449] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-30T17:02:34.804569] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-30T17:02:34.804892] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-30T17:02:34.804976] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-30T17:02:34.805606] [DEBUG] [LOCAL ] ACV: Trimmed 10708 records to 7373 (keeping 200 days of data) [2025-10-30T17:02:34.862231] [DEBUG] [LOCAL ] ACV: Primary data saved (7373 records). [2025-10-30T17:02:34.862368] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-30T17:02:34.862467] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ACV took 27.6s. Estimated remaining: 3h 40m 1s. Rate: 10.6 symbols/min [2025-10-30T17:02:34.902740] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-30T17:02:35.084927] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:35.137947] [DEBUG] [LOCAL ] ADM: Loaded 53375 existing records from primary storage. [2025-10-30T17:02:35.138256] [INFO ] [MAIN ] ADM: Loaded 53375 existing records. [2025-10-30T17:02:35.328269] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:02:35.328469] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-30T17:02:35.328517] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-30T17:02:35.329145] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-30T17:02:35.329201] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-30T17:02:35.681125] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:02:35.697451] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-30T17:02:35.911209] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-30T17:02:36.038229] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T17:02:36.497543] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-30T17:02:37.297511] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-30T17:02:37.477992] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-30T17:02:37.628951] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T17:02:38.097531] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-30T17:02:38.796693] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T17:02:38.897545] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-30T17:02:39.232207] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T17:02:39.697540] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-30T17:02:40.412500] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-30T17:02:40.497530] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-30T17:02:40.831380] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T17:02:41.297499] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-30T17:02:42.065679] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-30T17:02:42.097516] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-30T17:02:42.377193] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-30T17:02:42.897539] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-30T17:02:43.697512] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-30T17:02:43.744542] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-30T17:02:44.316808] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T17:02:44.497515] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-30T17:02:44.755224] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T17:02:45.297540] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-30T17:02:45.588265] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T17:02:46.097513] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-30T17:02:46.876666] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T17:02:46.897477] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-30T17:02:47.524222] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T17:02:47.697531] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-30T17:02:48.459769] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-30T17:02:48.497465] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-30T17:02:48.710050] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-30T17:02:49.297543] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-30T17:02:50.105259] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-30T17:02:50.128090] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-30T17:02:50.440665] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T17:02:50.897508] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-30T17:02:51.399431] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T17:02:51.411090] [INFO ] [REMOTE ] ADCT: Full fetch complete (51237 records). [2025-10-30T17:02:51.411259] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-30T17:02:51.412950] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:02:51.413061] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:02:51.413141] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:02:51.413221] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-30T17:02:51.413294] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-30T17:02:51.413339] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-30T17:02:51.413534] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-10-30T17:02:51.413638] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ADCT took 24.2s. Estimated remaining: 3h 55m 6s. Rate: 9.9 symbols/min [2025-10-30T17:02:51.591556] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:51.635628] [DEBUG] [LOCAL ] ADNT: Loaded 45853 existing records from primary storage. [2025-10-30T17:02:51.635973] [INFO ] [MAIN ] ADNT: Loaded 45853 existing records. [2025-10-30T17:02:51.702779] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-30T17:02:51.822001] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:02:51.822237] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-30T17:02:51.822286] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-30T17:02:51.822583] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-30T17:02:51.822674] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-30T17:02:52.182233] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:02:52.208509] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T17:02:52.497501] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-30T17:02:53.008898] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T17:02:53.297570] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-30T17:02:53.553666] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T17:02:54.097511] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-30T17:02:54.224982] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T17:02:54.897562] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-30T17:02:55.538567] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T17:02:55.697526] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-30T17:02:56.494151] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-30T17:02:56.504197] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-30T17:02:56.836623] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T17:02:57.297545] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-30T17:02:57.529375] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T17:02:58.097559] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-30T17:02:58.636694] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T17:02:58.647126] [INFO ] [REMOTE ] ADC: Full fetch complete (66797 records). [2025-10-30T17:02:58.647265] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-30T17:02:58.902579] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-30T17:02:59.045020] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-30T17:02:59.045113] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-30T17:02:59.045742] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-30T17:02:59.045804] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-30T17:02:59.047136] [DEBUG] [LOCAL ] ADC: Trimmed 66797 records to 46596 (keeping 200 days of data) [2025-10-30T17:02:59.350557] [DEBUG] [LOCAL ] ADC: Primary data saved (46596 records). [2025-10-30T17:02:59.350733] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-30T17:02:59.350822] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ADC took 35.3s. Estimated remaining: 3h 57m 33s. Rate: 9.8 symbols/min [2025-10-30T17:02:59.527975] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:02:59.574877] [DEBUG] [LOCAL ] ADT: Loaded 53424 existing records from primary storage. [2025-10-30T17:02:59.575195] [INFO ] [MAIN ] ADT: Loaded 53424 existing records. [2025-10-30T17:02:59.702618] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-30T17:02:59.785245] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:02:59.785578] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-30T17:02:59.785630] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-30T17:02:59.786140] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-30T17:02:59.786185] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-30T17:03:00.175356] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:00.271244] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T17:03:00.474391] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-30T17:03:00.497465] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-30T17:03:01.297497] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-30T17:03:01.664534] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-30T17:03:01.675772] [INFO ] [REMOTE ] ACVA: Full fetch complete (71119 records). [2025-10-30T17:03:01.675940] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-30T17:03:02.103874] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-30T17:03:02.173171] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-30T17:03:02.173290] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-30T17:03:02.174198] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-30T17:03:02.174282] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-30T17:03:02.175790] [DEBUG] [LOCAL ] ACVA: Trimmed 71119 records to 49412 (keeping 200 days of data) [2025-10-30T17:03:02.473230] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-30T17:03:02.520105] [DEBUG] [LOCAL ] ACVA: Primary data saved (49412 records). [2025-10-30T17:03:02.520593] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-30T17:03:02.520872] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ACVA took 46.6s. Estimated remaining: 3h 53m 39s. Rate: 10.0 symbols/min [2025-10-30T17:03:02.555983] [INFO ] [REMOTE ] ADM: Full fetch complete (77079 records). [2025-10-30T17:03:02.570395] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-30T17:03:02.613827] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:03:02.638452] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:03:02.638875] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:03:02.649893] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-30T17:03:02.655147] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-30T17:03:02.660343] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-10-30T17:03:02.714385] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:03:02.684979] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-10-30T17:03:02.715175] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADM took 27.9s. Estimated remaining: 3h 46m 16s. Rate: 10.3 symbols/min [2025-10-30T17:03:02.918957] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:03:02.920278] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-10-30T17:03:02.921133] [DEBUG] [LOCAL ] ADX: Loaded 27530 existing records from primary storage. [2025-10-30T17:03:02.921451] [INFO ] [MAIN ] ADX: Loaded 27530 existing records. [2025-10-30T17:03:02.921565] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-10-30T17:03:02.977198] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-30T17:03:03.005836] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-30T17:03:03.021441] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-30T17:03:03.031892] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-30T17:03:03.274845] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-30T17:03:03.269471] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:03:03.278981] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-30T17:03:03.305836] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-30T17:03:03.335143] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-30T17:03:03.335427] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-30T17:03:03.335770] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-30T17:03:03.748850] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:03.815177] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-30T17:03:03.959749] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:03.993035] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-30T17:03:04.497584] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-30T17:03:04.641577] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T17:03:05.303704] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-30T17:03:05.317638] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T17:03:05.592303] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T17:03:06.097519] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-30T17:03:06.583268] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T17:03:06.897505] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-30T17:03:07.350982] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T17:03:07.697520] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-30T17:03:08.170860] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T17:03:08.497500] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-30T17:03:08.804957] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T17:03:09.297518] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-30T17:03:09.746279] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T17:03:10.097470] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-30T17:03:10.211484] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T17:03:10.897514] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-30T17:03:11.355288] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T17:03:11.697590] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-30T17:03:12.004817] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T17:03:12.497528] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-30T17:03:12.848900] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T17:03:13.297737] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-30T17:03:13.841462] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T17:03:14.097725] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-30T17:03:14.902583] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-30T17:03:14.921660] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-30T17:03:14.998724] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-30T17:03:15.697509] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-30T17:03:16.151156] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T17:03:16.497494] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-30T17:03:16.729510] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T17:03:17.297490] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-30T17:03:17.978012] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-30T17:03:18.097483] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-30T17:03:18.165218] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:03:18.897482] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-30T17:03:19.397989] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T17:03:19.697499] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-30T17:03:20.081806] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T17:03:20.497473] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-30T17:03:20.767949] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-30T17:03:21.297530] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-30T17:03:21.773460] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T17:03:22.097530] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-30T17:03:22.570583] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T17:03:22.897464] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-30T17:03:23.451664] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T17:03:23.697473] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-30T17:03:23.777598] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T17:03:24.497547] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-30T17:03:24.872962] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T17:03:24.882131] [INFO ] [REMOTE ] ADNT: Full fetch complete (67510 records). [2025-10-30T17:03:24.882240] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-30T17:03:25.275760] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-30T17:03:25.275855] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-30T17:03:25.276517] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-30T17:03:25.276600] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-30T17:03:25.277950] [DEBUG] [LOCAL ] ADNT: Trimmed 67510 records to 46161 (keeping 200 days of data) [2025-10-30T17:03:25.326524] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-30T17:03:25.538764] [DEBUG] [LOCAL ] ADNT: Primary data saved (46161 records). [2025-10-30T17:03:25.538884] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-30T17:03:25.540003] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADNT took 34.1s. Estimated remaining: 4h 6m 51s. Rate: 9.5 symbols/min [2025-10-30T17:03:25.721662] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:03:25.731984] [DEBUG] [LOCAL ] AEFC: Loaded 7378 existing records from primary storage. [2025-10-30T17:03:25.732192] [INFO ] [MAIN ] AEFC: Loaded 7378 existing records. [2025-10-30T17:03:25.923532] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:03:25.923851] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-30T17:03:25.923900] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-30T17:03:25.924052] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-30T17:03:25.924090] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-30T17:03:26.108232] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-30T17:03:26.332076] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-30T17:03:26.347567] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T17:03:26.393538] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:26.395286] [INFO ] [REMOTE ] ADT: Full fetch complete (77380 records). [2025-10-30T17:03:26.395393] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-30T17:03:26.819974] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-30T17:03:26.820054] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-30T17:03:26.820953] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-30T17:03:26.821015] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-30T17:03:26.822624] [DEBUG] [LOCAL ] ADT: Trimmed 77380 records to 53812 (keeping 200 days of data) [2025-10-30T17:03:26.911977] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-30T17:03:27.147499] [DEBUG] [LOCAL ] ADT: Primary data saved (53812 records). [2025-10-30T17:03:27.147662] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-30T17:03:27.147779] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADT took 27.8s. Estimated remaining: 4h 1m 9s. Rate: 9.7 symbols/min [2025-10-30T17:03:27.330638] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:03:27.372043] [DEBUG] [LOCAL ] AEG: Loaded 49369 existing records from primary storage. [2025-10-30T17:03:27.372375] [INFO ] [MAIN ] AEG: Loaded 49369 existing records. [2025-10-30T17:03:27.570445] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:03:27.547260] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-30T17:03:27.570794] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-30T17:03:27.570942] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-30T17:03:27.574124] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-30T17:03:27.574185] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-30T17:03:27.702721] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-30T17:03:27.952614] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:28.014807] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-30T17:03:28.497576] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-30T17:03:28.998721] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T17:03:29.005493] [INFO ] [REMOTE ] ADX: Full fetch complete (41589 records). [2025-10-30T17:03:29.005606] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-30T17:03:29.305396] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-30T17:03:29.402665] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-30T17:03:29.405255] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-30T17:03:29.407991] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-30T17:03:29.408580] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-30T17:03:29.408862] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T17:03:29.411918] [DEBUG] [LOCAL ] ADX: Trimmed 41589 records to 27752 (keeping 200 days of data) [2025-10-30T17:03:29.572177] [DEBUG] [LOCAL ] ADX: Primary data saved (27752 records). [2025-10-30T17:03:29.572301] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-30T17:03:29.572382] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. ADX took 27.1s. Estimated remaining: 3h 56m 44s. Rate: 9.9 symbols/min [2025-10-30T17:03:29.743463] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:03:29.793556] [DEBUG] [LOCAL ] AEM: Loaded 53471 existing records from primary storage. [2025-10-30T17:03:29.794068] [INFO ] [MAIN ] AEM: Loaded 53471 existing records. [2025-10-30T17:03:29.985943] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:03:29.986314] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-30T17:03:29.986368] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-30T17:03:29.987119] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-30T17:03:29.987178] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-30T17:03:30.102787] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-30T17:03:30.360001] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:30.611232] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-30T17:03:30.722224] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-30T17:03:30.897485] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-30T17:03:31.697532] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-30T17:03:32.150152] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T17:03:32.246343] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T17:03:32.497535] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-30T17:03:33.297507] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-30T17:03:33.618338] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T17:03:34.097487] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-30T17:03:34.468293] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T17:03:34.897493] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-30T17:03:35.218992] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T17:03:35.697491] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-30T17:03:36.144414] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T17:03:36.497520] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-30T17:03:37.038841] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T17:03:37.210264] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-30T17:03:37.297470] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-30T17:03:37.886968] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-30T17:03:38.097545] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-30T17:03:38.897546] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-30T17:03:39.321599] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T17:03:39.697495] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-30T17:03:40.218764] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:03:40.278761] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-30T17:03:40.497497] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-30T17:03:41.297486] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-30T17:03:41.708431] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T17:03:42.097561] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-30T17:03:42.573083] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-30T17:03:42.624872] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T17:03:42.897525] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-30T17:03:43.697501] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-30T17:03:44.466945] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-30T17:03:44.497457] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-30T17:03:44.998824] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T17:03:45.297569] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-30T17:03:45.952507] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T17:03:46.097522] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-30T17:03:46.868121] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-30T17:03:46.879060] [INFO ] [REMOTE ] AEE: Full fetch complete (72972 records). [2025-10-30T17:03:46.879212] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-30T17:03:46.902717] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-30T17:03:47.269319] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-30T17:03:47.269450] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-30T17:03:47.270165] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-30T17:03:47.270228] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-30T17:03:47.271575] [DEBUG] [LOCAL ] AEE: Trimmed 72972 records to 50215 (keeping 200 days of data) [2025-10-30T17:03:47.547175] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T17:03:47.623224] [DEBUG] [LOCAL ] AEE: Primary data saved (50215 records). [2025-10-30T17:03:47.623360] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-30T17:03:47.623450] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEE took 44.9s. Estimated remaining: 4h 9m 55s. Rate: 9.3 symbols/min [2025-10-30T17:03:47.702588] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-30T17:03:47.797691] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:03:47.845691] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-30T17:03:47.846026] [INFO ] [MAIN ] AEO: Loaded 53563 existing records. [2025-10-30T17:03:48.030108] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:03:48.030397] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-30T17:03:48.030449] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-30T17:03:48.031205] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-30T17:03:48.031285] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-30T17:03:48.400907] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:48.480082] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-30T17:03:48.497480] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-30T17:03:49.268743] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T17:03:49.297505] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-30T17:03:49.835319] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:03:50.097512] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-30T17:03:50.551361] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T17:03:50.897511] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-30T17:03:51.388984] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T17:03:51.562893] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T17:03:51.697570] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-30T17:03:52.497558] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-30T17:03:53.106230] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-30T17:03:53.297533] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-30T17:03:53.814714] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-30T17:03:53.817041] [INFO ] [REMOTE ] AEFC: Full fetch complete (11459 records). [2025-10-30T17:03:53.817133] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-30T17:03:53.817696] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:03:53.817779] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:03:53.817823] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:03:53.817904] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-30T17:03:53.818003] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-30T17:03:53.818072] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-30T17:03:53.818306] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-10-30T17:03:53.818416] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. AEFC took 28.3s. Estimated remaining: 4h 9m 33s. Rate: 9.3 symbols/min [2025-10-30T17:03:54.019902] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:03:54.065174] [DEBUG] [LOCAL ] AER: Loaded 47644 existing records from primary storage. [2025-10-30T17:03:54.065751] [INFO ] [MAIN ] AER: Loaded 47644 existing records. [2025-10-30T17:03:54.103612] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-30T17:03:54.267922] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:03:54.268133] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-30T17:03:54.268182] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-30T17:03:54.268683] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-30T17:03:54.268741] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-30T17:03:54.464103] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-30T17:03:54.681992] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:03:54.897515] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-30T17:03:55.697483] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-30T17:03:55.872830] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-30T17:03:55.883496] [INFO ] [REMOTE ] AEG: Full fetch complete (70655 records). [2025-10-30T17:03:55.883723] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-30T17:03:56.289689] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-30T17:03:56.289915] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-30T17:03:56.290625] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-30T17:03:56.290753] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-30T17:03:56.292399] [DEBUG] [LOCAL ] AEG: Trimmed 70655 records to 49719 (keeping 200 days of data) [2025-10-30T17:03:56.342895] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T17:03:56.531089] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-30T17:03:56.654662] [DEBUG] [LOCAL ] AEG: Primary data saved (49719 records). [2025-10-30T17:03:56.654800] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-30T17:03:56.654877] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEG took 29.5s. Estimated remaining: 4h 5m 40s. Rate: 9.5 symbols/min [2025-10-30T17:03:57.196478] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T17:03:57.297544] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-30T17:03:58.097479] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-30T17:03:58.162617] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-30T17:03:58.677439] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:03:58.897497] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-30T17:03:59.206338] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T17:03:59.697495] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-30T17:04:00.497520] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-30T17:04:00.796201] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-30T17:04:00.808218] [INFO ] [REMOTE ] AEM: Full fetch complete (77507 records). [2025-10-30T17:04:00.808374] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-30T17:04:01.207831] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-30T17:04:01.207984] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-30T17:04:01.208777] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-30T17:04:01.208870] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-30T17:04:01.210350] [DEBUG] [LOCAL ] AEM: Trimmed 77507 records to 53860 (keeping 200 days of data) [2025-10-30T17:04:01.495945] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-30T17:04:01.585444] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-30T17:04:01.603044] [DEBUG] [LOCAL ] AEM: Primary data saved (53860 records). [2025-10-30T17:04:01.603194] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-30T17:04:01.603283] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEM took 32.0s. Estimated remaining: 4h 4m 9s. Rate: 9.5 symbols/min [2025-10-30T17:04:02.369955] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-30T17:04:02.381118] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-30T17:04:03.264593] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-30T17:04:03.275478] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-30T17:04:03.963146] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-30T17:04:03.973994] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-30T17:04:04.438596] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T17:04:04.497501] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-30T17:04:05.532944] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T17:04:05.545010] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-30T17:04:05.718997] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T17:04:06.097513] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-30T17:04:07.111904] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T17:04:07.123381] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-30T17:04:07.408270] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T17:04:07.697506] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-30T17:04:08.958636] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-30T17:04:08.971223] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-30T17:04:09.127297] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T17:04:09.297493] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-30T17:04:10.521494] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T17:04:10.532105] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-30T17:04:11.267234] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-30T17:04:11.279891] [INFO ] [REMOTE ] AEO: Full fetch complete (77653 records). [2025-10-30T17:04:11.280099] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-30T17:04:11.669462] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-30T17:04:11.669550] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-30T17:04:11.670298] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-30T17:04:11.670361] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-30T17:04:11.671917] [DEBUG] [LOCAL ] AEO: Trimmed 77653 records to 53953 (keeping 200 days of data) [2025-10-30T17:04:12.002315] [DEBUG] [LOCAL ] AEO: Primary data saved (53953 records). [2025-10-30T17:04:12.002566] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-30T17:04:12.002679] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEO took 24.4s. Estimated remaining: 4h 8m 8s. Rate: 9.4 symbols/min [2025-10-30T17:04:12.030424] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T17:04:12.040749] [INFO ] [REMOTE ] AER: Full fetch complete (69930 records). [2025-10-30T17:04:12.040911] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-30T17:04:12.446235] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-30T17:04:12.446329] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-30T17:04:12.447016] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-30T17:04:12.447084] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-30T17:04:12.448491] [DEBUG] [LOCAL ] AER: Trimmed 69930 records to 48002 (keeping 200 days of data) [2025-10-30T17:04:12.758115] [DEBUG] [LOCAL ] AER: Primary data saved (48002 records). [2025-10-30T17:04:12.758257] [INFO ] [MAIN ] AER: Full history saved. [2025-10-30T17:04:12.759369] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 18.9s. Estimated remaining: 4h 2m 34s. Rate: 9.6 symbols/min [2025-10-30T17:04:13.416931] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:13.419148] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:13.460268] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:13.472900] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-30T17:04:13.480161] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-30T17:04:13.502785] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:13.503216] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-30T17:04:13.503473] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-10-30T17:04:13.503567] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-30T17:04:13.503827] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-30T17:04:13.503886] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-30T17:04:13.503635] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-10-30T17:04:13.504258] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-30T17:04:13.509467] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-30T17:04:13.534405] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-30T17:04:13.540298] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-30T17:04:13.935022] [DEBUG] [LOCAL ] AESI: Loaded 49754 existing records from primary storage. [2025-10-30T17:04:13.995126] [INFO ] [MAIN ] AESI: Loaded 49754 existing records. [2025-10-30T17:04:14.189157] [DEBUG] [LOCAL ] AES: Loaded 53663 existing records from primary storage. [2025-10-30T17:04:14.251022] [INFO ] [MAIN ] AES: Loaded 53663 existing records. [2025-10-30T17:04:14.406546] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:14.472866] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-30T17:04:14.599481] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:04:14.560880] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:14.603329] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-30T17:04:14.603434] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-30T17:04:14.604165] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-30T17:04:14.610097] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-30T17:04:14.625760] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-30T17:04:14.749560] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:04:14.718959] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:04:14.788705] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-30T17:04:14.788871] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-30T17:04:14.785352] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-30T17:04:14.789295] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:04:14.789797] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-30T17:04:14.789858] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-30T17:04:14.810820] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:04:14.816267] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-30T17:04:14.810932] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-30T17:04:14.838583] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-30T17:04:14.868309] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-30T17:04:14.883807] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-30T17:04:14.922073] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.2s. Estimated remaining: 3h 58m 35s. Rate: 9.7 symbols/min [2025-10-30T17:04:15.456724] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:15.454759] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:15.451203] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T17:04:15.473733] [DEBUG] [LOCAL ] AFG: No existing data file found in primary storage. [2025-10-30T17:04:15.473601] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-30T17:04:15.487311] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-30T17:04:15.497356] [WARN ] [MAIN ] AFG: No existing data found, performing full refresh instead. [2025-10-30T17:04:15.548875] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-30T17:04:15.548996] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-30T17:04:15.576541] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-30T17:04:15.576700] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-30T17:04:15.771268] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:15.792693] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-30T17:04:16.019032] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:16.019323] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-30T17:04:16.282870] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T17:04:16.286066] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-30T17:04:16.819919] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T17:04:16.829347] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-30T17:04:16.938505] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:04:16.953554] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T17:04:17.297496] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-30T17:04:17.460579] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-30T17:04:18.097515] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-30T17:04:18.219577] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T17:04:18.237675] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T17:04:18.897496] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-30T17:04:19.587754] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T17:04:19.697484] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-30T17:04:20.219235] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:04:20.497469] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-30T17:04:21.113673] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-30T17:04:21.297512] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-30T17:04:21.848452] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T17:04:22.097503] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-30T17:04:22.877365] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-30T17:04:22.897470] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-30T17:04:23.312230] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T17:04:23.697508] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-30T17:04:24.359152] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T17:04:24.497532] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-30T17:04:24.619162] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T17:04:25.297497] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-30T17:04:25.759944] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T17:04:26.097506] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-30T17:04:26.338180] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T17:04:26.614111] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T17:04:26.897513] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-30T17:04:27.697514] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-30T17:04:28.184639] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T17:04:28.497553] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-30T17:04:29.297467] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-30T17:04:29.403855] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T17:04:29.527153] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-30T17:04:30.097499] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-30T17:04:30.569823] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T17:04:30.897483] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-30T17:04:31.118329] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T17:04:31.518159] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-30T17:04:31.697504] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-30T17:04:32.497500] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-30T17:04:33.074229] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-30T17:04:33.224676] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T17:04:33.297473] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-30T17:04:34.097544] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-30T17:04:34.166337] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:04:34.897499] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-30T17:04:35.683092] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-30T17:04:35.697464] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-30T17:04:36.178217] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T17:04:36.497507] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-30T17:04:36.961390] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:04:37.297574] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-30T17:04:37.809215] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T17:04:37.820437] [INFO ] [REMOTE ] AESI: Full fetch complete (72066 records). [2025-10-30T17:04:37.820571] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-30T17:04:38.107525] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-30T17:04:38.212396] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-30T17:04:38.212471] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-30T17:04:38.213146] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-30T17:04:38.213241] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-30T17:04:38.214530] [DEBUG] [LOCAL ] AESI: Trimmed 72066 records to 50144 (keeping 200 days of data) [2025-10-30T17:04:38.532315] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T17:04:38.557190] [DEBUG] [LOCAL ] AESI: Primary data saved (50144 records). [2025-10-30T17:04:38.557365] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-30T17:04:38.557469] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AESI took 25.8s. Estimated remaining: 4h 14m 36s. Rate: 9.1 symbols/min [2025-10-30T17:04:38.762368] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:38.765914] [DEBUG] [LOCAL ] AFGB: Loaded 2099 existing records from primary storage. [2025-10-30T17:04:38.766067] [INFO ] [MAIN ] AFGB: Loaded 2099 existing records. [2025-10-30T17:04:38.902605] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-30T17:04:38.943117] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:04:38.943334] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-30T17:04:38.943392] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-30T17:04:38.943563] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-30T17:04:38.943619] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-30T17:04:39.307200] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:39.697489] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-30T17:04:39.981569] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T17:04:40.147926] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-30T17:04:40.497476] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-30T17:04:40.766701] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-30T17:04:40.778269] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-30T17:04:40.778417] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-30T17:04:41.165062] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-30T17:04:41.165147] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-30T17:04:41.165950] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-30T17:04:41.166016] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-30T17:04:41.167563] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 54053 (keeping 200 days of data) [2025-10-30T17:04:41.338270] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-30T17:04:41.412349] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-30T17:04:41.518564] [DEBUG] [LOCAL ] AES: Primary data saved (54053 records). [2025-10-30T17:04:41.518725] [INFO ] [MAIN ] AES: Full history saved. [2025-10-30T17:04:41.518813] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AES took 28.8s. Estimated remaining: 4h 11m 15s. Rate: 9.2 symbols/min [2025-10-30T17:04:41.624384] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T17:04:41.695557] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:41.701051] [DEBUG] [LOCAL ] AFGC: Loaded 2570 existing records from primary storage. [2025-10-30T17:04:41.701250] [INFO ] [MAIN ] AFGC: Loaded 2570 existing records. [2025-10-30T17:04:41.885043] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:04:41.885250] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-30T17:04:41.885298] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-30T17:04:41.885483] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-30T17:04:41.885540] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-30T17:04:42.102691] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-30T17:04:42.238227] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:42.428892] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T17:04:42.897510] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-30T17:04:43.503598] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T17:04:43.697724] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-30T17:04:44.497581] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-30T17:04:44.764595] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T17:04:44.771751] [INFO ] [REMOTE ] AFG: Full fetch complete (46797 records). [2025-10-30T17:04:44.771927] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-30T17:04:45.145297] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-30T17:04:45.202003] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-30T17:04:45.202122] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-30T17:04:45.202694] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-30T17:04:45.202759] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-30T17:04:45.203855] [DEBUG] [LOCAL ] AFG: Trimmed 46797 records to 31572 (keeping 200 days of data) [2025-10-30T17:04:45.297696] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-30T17:04:45.405339] [DEBUG] [LOCAL ] AFG: Primary data saved (31572 records). [2025-10-30T17:04:45.405900] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-30T17:04:45.405984] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AFG took 30.4s. Estimated remaining: 4h 8m 51s. Rate: 9.3 symbols/min [2025-10-30T17:04:45.595401] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:45.598562] [DEBUG] [LOCAL ] AFGD: Loaded 1683 existing records from primary storage. [2025-10-30T17:04:45.598723] [INFO ] [MAIN ] AFGD: Loaded 1683 existing records. [2025-10-30T17:04:45.775452] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:04:45.775730] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-30T17:04:45.775800] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-30T17:04:45.776010] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-30T17:04:45.776075] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-30T17:04:45.882951] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-30T17:04:46.102581] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-30T17:04:46.170845] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:46.481064] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T17:04:46.897539] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-30T17:04:47.451208] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T17:04:47.697508] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-30T17:04:47.948136] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-30T17:04:48.497536] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-30T17:04:48.781741] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-30T17:04:49.297577] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-30T17:04:49.792989] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T17:04:50.097505] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-30T17:04:50.769496] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-30T17:04:50.772359] [INFO ] [REMOTE ] AFB: Full fetch complete (16207 records). [2025-10-30T17:04:50.772440] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-30T17:04:50.772935] [FATAL] [VALIDATOR ] AFB: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:04:50.773018] [FATAL] [MAIN ] AFB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:04:50.773087] [WARN ] [MAIN ] AFB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:04:50.773160] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-30T17:04:50.773226] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-30T17:04:50.773264] [INFO ] [LOCAL ] AFB: Starting deletion of derivative data. [2025-10-30T17:04:50.773327] [DEBUG] [LOCAL ] AFB: No derivative data file found to delete. [2025-10-30T17:04:50.773405] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AFB took 38.0s. Estimated remaining: 4h 7m 50s. Rate: 9.4 symbols/min [2025-10-30T17:04:50.902633] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-30T17:04:50.956303] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:04:50.960273] [DEBUG] [LOCAL ] AFGE: Loaded 2187 existing records from primary storage. [2025-10-30T17:04:50.960425] [INFO ] [MAIN ] AFGE: Loaded 2187 existing records. [2025-10-30T17:04:51.137579] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:04:51.137797] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-30T17:04:51.137861] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-30T17:04:51.137992] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-30T17:04:51.138029] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-30T17:04:51.416267] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T17:04:51.495511] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:04:51.697477] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-30T17:04:52.159406] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-30T17:04:52.497496] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-30T17:04:52.781063] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-30T17:04:53.297535] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-30T17:04:53.575459] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-30T17:04:54.097549] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-30T17:04:54.408603] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-30T17:04:54.897534] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-30T17:04:55.340632] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-30T17:04:55.697533] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-30T17:04:56.122936] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T17:04:56.497498] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-30T17:04:56.847704] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-30T17:04:57.297544] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-30T17:04:57.811763] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T17:04:58.097541] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-30T17:04:58.483909] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-30T17:04:58.897504] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-30T17:04:59.693753] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T17:04:59.697445] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-30T17:04:59.992299] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-30T17:05:00.497489] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-30T17:05:01.091855] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-30T17:05:01.297517] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-30T17:05:01.860555] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-30T17:05:01.861917] [INFO ] [REMOTE ] AFGC: Full fetch complete (3554 records). [2025-10-30T17:05:01.862006] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-30T17:05:01.862482] [FATAL] [VALIDATOR ] AFGC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:05:01.862573] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:05:01.862801] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:05:01.862881] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-30T17:05:01.863184] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-30T17:05:01.863248] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-10-30T17:05:01.863541] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-10-30T17:05:01.863695] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AFGC took 20.3s. Estimated remaining: 4h 11m 39s. Rate: 9.2 symbols/min [2025-10-30T17:05:02.077225] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:05:02.104076] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-30T17:05:02.130178] [DEBUG] [LOCAL ] AFL: Loaded 53145 existing records from primary storage. [2025-10-30T17:05:02.130564] [INFO ] [MAIN ] AFL: Loaded 53145 existing records. [2025-10-30T17:05:02.312717] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:05:02.313077] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-30T17:05:02.313136] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-30T17:05:02.313955] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-30T17:05:02.314012] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-30T17:05:02.480346] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-30T17:05:02.680026] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:05:02.897559] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-30T17:05:03.441588] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T17:05:03.697494] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-30T17:05:04.019984] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T17:05:04.497494] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-30T17:05:05.297505] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-30T17:05:05.892548] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T17:05:06.013352] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-30T17:05:06.097560] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-30T17:05:06.444607] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-30T17:05:06.897493] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-30T17:05:07.309358] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T17:05:07.697508] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-30T17:05:08.497502] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-30T17:05:08.990717] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-30T17:05:09.029615] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T17:05:09.297493] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-30T17:05:09.579370] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-30T17:05:10.097511] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-30T17:05:10.897486] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-30T17:05:11.311165] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-30T17:05:11.418240] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:05:11.697495] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-30T17:05:12.003605] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-30T17:05:12.497504] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-30T17:05:12.851728] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-30T17:05:13.297500] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-30T17:05:14.097535] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-30T17:05:14.427874] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-30T17:05:14.694198] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-30T17:05:14.897487] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-30T17:05:15.697491] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-30T17:05:16.028520] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-30T17:05:16.502582] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-30T17:05:16.518427] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-30T17:05:17.028174] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-30T17:05:17.028956] [INFO ] [REMOTE ] AFGD: Full fetch complete (2603 records). [2025-10-30T17:05:17.029024] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-30T17:05:17.029350] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:05:17.029444] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:05:17.029519] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:05:17.029611] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-30T17:05:17.029727] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-30T17:05:17.029782] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-30T17:05:17.029967] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-10-30T17:05:17.030049] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGD took 31.6s. Estimated remaining: 4h 18m 40s. Rate: 9.0 symbols/min [2025-10-30T17:05:17.196433] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:05:17.241970] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-30T17:05:17.242272] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-30T17:05:17.305461] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-30T17:05:17.425299] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:05:17.425510] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-30T17:05:17.425558] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-30T17:05:17.426003] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-30T17:05:17.426058] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-30T17:05:17.793982] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:05:18.097496] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-30T17:05:18.524308] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-30T17:05:18.525191] [INFO ] [REMOTE ] AFGE: Full fetch complete (3252 records). [2025-10-30T17:05:18.525277] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-30T17:05:18.889048] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-30T17:05:18.889129] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-30T17:05:18.889241] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-30T17:05:18.889281] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-30T17:05:18.889705] [DEBUG] [LOCAL ] AFGE: Trimmed 3252 records to 2193 (keeping 200 days of data) [2025-10-30T17:05:18.899951] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-30T17:05:18.904684] [DEBUG] [LOCAL ] AFGE: Primary data saved (2193 records). [2025-10-30T17:05:18.904759] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-30T17:05:18.904831] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGE took 28.1s. Estimated remaining: 4h 14m 41s. Rate: 9.1 symbols/min [2025-10-30T17:05:19.078240] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:05:19.118700] [DEBUG] [LOCAL ] AGCO: Loaded 41777 existing records from primary storage. [2025-10-30T17:05:19.118966] [INFO ] [MAIN ] AGCO: Loaded 41777 existing records. [2025-10-30T17:05:19.297394] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:05:19.297726] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-30T17:05:19.297784] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-30T17:05:19.298200] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-30T17:05:19.298273] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-30T17:05:19.658169] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:05:19.702584] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-30T17:05:19.720617] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-30T17:05:20.497497] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-30T17:05:20.987279] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T17:05:21.226482] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-30T17:05:21.297475] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-30T17:05:21.855418] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T17:05:22.097563] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-30T17:05:22.704017] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T17:05:22.801029] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-30T17:05:22.897511] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-30T17:05:23.320405] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-30T17:05:23.321322] [INFO ] [REMOTE ] AFGB: Full fetch complete (3372 records). [2025-10-30T17:05:23.321389] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-30T17:05:23.680195] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-30T17:05:23.680284] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-30T17:05:23.680422] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-30T17:05:23.680462] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-30T17:05:23.680830] [DEBUG] [LOCAL ] AFGB: Trimmed 3372 records to 2106 (keeping 200 days of data) [2025-10-30T17:05:23.693597] [DEBUG] [LOCAL ] AFGB: Primary data saved (2106 records). [2025-10-30T17:05:23.693697] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-30T17:05:23.693779] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGB took 45.1s. Estimated remaining: 4h 13m 9s. Rate: 9.2 symbols/min [2025-10-30T17:05:23.704674] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-30T17:05:23.862986] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:05:23.863165] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-10-30T17:05:23.863202] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-10-30T17:05:23.863311] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-30T17:05:23.863369] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-30T17:05:23.863411] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-30T17:05:23.863442] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-30T17:05:24.218622] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:05:24.497504] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-30T17:05:25.297505] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-30T17:05:25.494092] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-30T17:05:25.707306] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T17:05:26.097527] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-30T17:05:26.897489] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-30T17:05:27.432498] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-30T17:05:27.478350] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T17:05:27.697506] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-30T17:05:28.400667] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T17:05:28.497518] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-30T17:05:29.135421] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T17:05:29.297509] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-30T17:05:29.975723] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T17:05:29.989551] [INFO ] [REMOTE ] AFL: Full fetch complete (77057 records). [2025-10-30T17:05:29.989802] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-30T17:05:30.102697] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-30T17:05:30.407115] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-30T17:05:30.407211] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-30T17:05:30.407951] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-30T17:05:30.408018] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-30T17:05:30.409676] [DEBUG] [LOCAL ] AFL: Trimmed 77057 records to 53530 (keeping 200 days of data) [2025-10-30T17:05:30.741240] [DEBUG] [LOCAL ] AFL: Primary data saved (53530 records). [2025-10-30T17:05:30.741460] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-30T17:05:30.742335] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AFL took 28.9s. Estimated remaining: 4h 13m 25s. Rate: 9.1 symbols/min [2025-10-30T17:05:30.912185] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-30T17:05:30.915022] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:05:30.949213] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-30T17:05:31.011941] [DEBUG] [LOCAL ] AGI: Loaded 53421 existing records from primary storage. [2025-10-30T17:05:31.012260] [INFO ] [MAIN ] AGI: Loaded 53421 existing records. [2025-10-30T17:05:31.195315] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:05:31.195528] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-30T17:05:31.195578] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-30T17:05:31.196694] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-30T17:05:31.196753] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-30T17:05:31.590514] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:05:31.671746] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-30T17:05:31.697528] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-30T17:05:31.776595] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-30T17:05:32.497564] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-30T17:05:33.297488] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-30T17:05:33.404290] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-30T17:05:33.910039] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T17:05:33.951071] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T17:05:34.097492] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-30T17:05:34.812305] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-30T17:05:34.897496] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-30T17:05:35.697502] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-30T17:05:36.414250] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T17:05:36.460794] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-30T17:05:36.497470] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-30T17:05:37.155553] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T17:05:37.297507] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-30T17:05:38.097476] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-30T17:05:38.252712] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-30T17:05:38.897494] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-30T17:05:39.356187] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T17:05:39.697584] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-30T17:05:40.497493] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-30T17:05:40.600635] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-30T17:05:41.162891] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T17:05:41.271573] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T17:05:41.297487] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-30T17:05:42.097527] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-30T17:05:42.897495] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-30T17:05:42.944828] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-30T17:05:43.248828] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T17:05:43.697544] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-30T17:05:44.497528] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-30T17:05:44.559521] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-30T17:05:44.695622] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T17:05:45.216479] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T17:05:45.297531] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-30T17:05:46.097504] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-30T17:05:46.638592] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:05:46.897469] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-30T17:05:47.056580] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-30T17:05:47.061411] [INFO ] [REMOTE ] AGD: Full fetch complete (26153 records). [2025-10-30T17:05:47.061485] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-30T17:05:47.426532] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-30T17:05:47.426615] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-30T17:05:47.426997] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-30T17:05:47.427054] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-30T17:05:47.427718] [DEBUG] [LOCAL ] AGD: Trimmed 26153 records to 19029 (keeping 200 days of data) [2025-10-30T17:05:47.542706] [DEBUG] [LOCAL ] AGD: Primary data saved (19029 records). [2025-10-30T17:05:47.542920] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-30T17:05:47.542996] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AGD took 23.8s. Estimated remaining: 4h 21m 3s. Rate: 8.9 symbols/min [2025-10-30T17:05:47.709900] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-30T17:05:47.712445] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:05:47.758855] [DEBUG] [LOCAL ] AGL: Loaded 52567 existing records from primary storage. [2025-10-30T17:05:47.759148] [INFO ] [MAIN ] AGL: Loaded 52567 existing records. [2025-10-30T17:05:47.935305] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:05:47.935556] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-30T17:05:47.935609] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-30T17:05:47.936225] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-30T17:05:47.936282] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-30T17:05:48.295138] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T17:05:48.315541] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:05:48.497492] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-30T17:05:49.261105] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-30T17:05:49.297529] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-30T17:05:49.749563] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T17:05:49.758538] [INFO ] [REMOTE ] AGCO: Full fetch complete (61356 records). [2025-10-30T17:05:49.758664] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-30T17:05:50.105871] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-30T17:05:50.157422] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-30T17:05:50.157506] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-30T17:05:50.158141] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-30T17:05:50.158229] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-30T17:05:50.159524] [DEBUG] [LOCAL ] AGCO: Trimmed 61356 records to 42102 (keeping 200 days of data) [2025-10-30T17:05:50.411808] [DEBUG] [LOCAL ] AGCO: Primary data saved (42102 records). [2025-10-30T17:05:50.411988] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-30T17:05:50.412076] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AGCO took 31.5s. Estimated remaining: 4h 18m 3s. Rate: 9.0 symbols/min [2025-10-30T17:05:50.591280] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T17:05:50.608286] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:05:50.628886] [DEBUG] [LOCAL ] AGM: Loaded 10447 existing records from primary storage. [2025-10-30T17:05:50.629089] [INFO ] [MAIN ] AGM: Loaded 10447 existing records. [2025-10-30T17:05:50.806161] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:05:50.806365] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-30T17:05:50.806413] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-30T17:05:50.806770] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-30T17:05:50.806827] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-30T17:05:50.902628] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-30T17:05:51.154508] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:05:51.595009] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-30T17:05:51.697496] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-30T17:05:51.920493] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T17:05:52.497509] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-30T17:05:52.935155] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T17:05:53.065402] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-30T17:05:53.297577] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-30T17:05:54.097550] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-30T17:05:54.608746] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T17:05:54.897474] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-30T17:05:55.344271] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-30T17:05:55.391143] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-30T17:05:55.697494] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-30T17:05:56.497518] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-30T17:05:56.992184] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T17:05:57.038910] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:05:57.297505] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-30T17:05:58.097501] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-30T17:05:58.465909] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T17:05:58.661735] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T17:05:58.897506] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-30T17:05:59.697542] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-30T17:06:00.202613] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T17:06:00.497523] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-30T17:06:01.297501] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-30T17:06:01.400047] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-30T17:06:02.007595] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-30T17:06:02.064001] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-30T17:06:02.097465] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-30T17:06:02.897557] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-30T17:06:03.463858] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T17:06:03.697478] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-30T17:06:04.497511] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-30T17:06:05.133443] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-30T17:06:05.146124] [INFO ] [REMOTE ] AG: Full fetch complete (77799 records). [2025-10-30T17:06:05.146295] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-30T17:06:05.301388] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-30T17:06:05.382385] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-30T17:06:05.597154] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-30T17:06:05.597261] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-30T17:06:05.598143] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-30T17:06:05.598209] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-30T17:06:05.599771] [DEBUG] [LOCAL ] AG: Trimmed 77799 records to 54033 (keeping 200 days of data) [2025-10-30T17:06:05.912414] [DEBUG] [LOCAL ] AG: Primary data saved (54033 records). [2025-10-30T17:06:05.912542] [INFO ] [MAIN ] AG: Full history saved. [2025-10-30T17:06:05.912629] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AG took 48.9s. Estimated remaining: 4h 24m 21s. Rate: 8.7 symbols/min [2025-10-30T17:06:06.086146] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:06.100088] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-30T17:06:06.113191] [DEBUG] [LOCAL ] AGO: Loaded 27118 existing records from primary storage. [2025-10-30T17:06:06.113453] [INFO ] [MAIN ] AGO: Loaded 27118 existing records. [2025-10-30T17:06:06.159221] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-30T17:06:06.341110] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:06.344603] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-30T17:06:06.345387] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-30T17:06:06.346539] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-30T17:06:06.357979] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-30T17:06:06.358067] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-30T17:06:06.739152] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:06.897532] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-30T17:06:07.437146] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:06:07.697490] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-30T17:06:08.065148] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T17:06:08.497492] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-30T17:06:08.975027] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T17:06:09.297499] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-30T17:06:10.097508] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-30T17:06:10.358737] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-30T17:06:10.370985] [INFO ] [REMOTE ] AGI: Full fetch complete (77401 records). [2025-10-30T17:06:10.371147] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-30T17:06:10.677184] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-30T17:06:10.705950] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T17:06:10.795940] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-30T17:06:10.796016] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-30T17:06:10.796780] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-30T17:06:10.796846] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-30T17:06:10.798305] [DEBUG] [LOCAL ] AGI: Trimmed 77401 records to 53811 (keeping 200 days of data) [2025-10-30T17:06:10.904699] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-30T17:06:11.117995] [DEBUG] [LOCAL ] AGI: Primary data saved (53811 records). [2025-10-30T17:06:11.118133] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-30T17:06:11.118210] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 40.4s. Estimated remaining: 4h 23m 3s. Rate: 8.8 symbols/min [2025-10-30T17:06:11.284348] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:11.315632] [DEBUG] [LOCAL ] AGRO: Loaded 31944 existing records from primary storage. [2025-10-30T17:06:11.315910] [INFO ] [MAIN ] AGRO: Loaded 31944 existing records. [2025-10-30T17:06:11.491165] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:11.491400] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-30T17:06:11.491463] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-30T17:06:11.491695] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-30T17:06:11.491766] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-30T17:06:11.707230] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-30T17:06:11.843140] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:12.497509] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-30T17:06:12.754099] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-30T17:06:12.838452] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-30T17:06:12.850363] [INFO ] [REMOTE ] AGL: Full fetch complete (76000 records). [2025-10-30T17:06:12.850524] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-30T17:06:13.229760] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T17:06:13.254700] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-30T17:06:13.255035] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-30T17:06:13.255790] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-30T17:06:13.255852] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-30T17:06:13.257288] [DEBUG] [LOCAL ] AGL: Trimmed 76000 records to 52953 (keeping 200 days of data) [2025-10-30T17:06:13.301523] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-30T17:06:13.542405] [DEBUG] [LOCAL ] AGL: Primary data saved (52953 records). [2025-10-30T17:06:13.542536] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-30T17:06:13.543597] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGL took 26.0s. Estimated remaining: 4h 19m 51s. Rate: 8.9 symbols/min [2025-10-30T17:06:13.714477] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:13.746193] [DEBUG] [LOCAL ] AGX: Loaded 32103 existing records from primary storage. [2025-10-30T17:06:13.746469] [INFO ] [MAIN ] AGX: Loaded 32103 existing records. [2025-10-30T17:06:13.920920] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:13.921075] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-30T17:06:13.921121] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-30T17:06:13.921358] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-30T17:06:13.921435] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-30T17:06:14.103693] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-30T17:06:14.211134] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T17:06:14.219851] [INFO ] [REMOTE ] AGM: Full fetch complete (13176 records). [2025-10-30T17:06:14.230242] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-30T17:06:14.253423] [FATAL] [VALIDATOR ] AGM: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:06:14.264238] [FATAL] [MAIN ] AGM: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:06:14.290461] [WARN ] [MAIN ] AGM: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:06:14.296524] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:14.297074] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-30T17:06:14.297163] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-10-30T17:06:14.297208] [INFO ] [LOCAL ] AGM: Starting deletion of derivative data. [2025-10-30T17:06:14.297396] [DEBUG] [LOCAL ] AGM: Deleted derivative data file. [2025-10-30T17:06:14.297485] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGM took 23.9s. Estimated remaining: 4h 15m 37s. Rate: 9.0 symbols/min [2025-10-30T17:06:14.467901] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:14.503156] [DEBUG] [LOCAL ] AHH: Loaded 39635 existing records from primary storage. [2025-10-30T17:06:14.503496] [INFO ] [MAIN ] AHH: Loaded 39635 existing records. [2025-10-30T17:06:14.679250] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:14.679442] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-30T17:06:14.679488] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-30T17:06:14.680181] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-30T17:06:14.680237] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-30T17:06:14.902686] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-30T17:06:15.038006] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:15.289489] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T17:06:15.697492] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-30T17:06:16.312553] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T17:06:16.497518] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-30T17:06:16.897368] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:06:17.297512] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-30T17:06:17.339449] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T17:06:18.097522] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-30T17:06:18.390793] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T17:06:18.897498] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-30T17:06:19.401966] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T17:06:19.697498] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-30T17:06:19.760189] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-30T17:06:20.497511] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-30T17:06:20.780916] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-30T17:06:21.297525] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-30T17:06:21.673210] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T17:06:22.049761] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T17:06:22.097478] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-30T17:06:22.897475] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-30T17:06:22.935109] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-30T17:06:23.697566] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-30T17:06:24.005594] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T17:06:24.497478] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-30T17:06:24.836554] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T17:06:25.297505] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-30T17:06:25.894941] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T17:06:26.066200] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-30T17:06:26.097512] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-30T17:06:26.897497] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-30T17:06:27.697523] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-30T17:06:28.004902] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-30T17:06:28.201196] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T17:06:28.497495] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-30T17:06:28.893280] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T17:06:29.297512] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-30T17:06:29.771442] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T17:06:29.777718] [INFO ] [REMOTE ] AGO: Full fetch complete (39574 records). [2025-10-30T17:06:29.777837] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-30T17:06:30.102713] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-30T17:06:30.163846] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-30T17:06:30.163926] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-30T17:06:30.164360] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-30T17:06:30.164400] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-30T17:06:30.165195] [DEBUG] [LOCAL ] AGO: Trimmed 39574 records to 27333 (keeping 200 days of data) [2025-10-30T17:06:30.328755] [DEBUG] [LOCAL ] AGO: Primary data saved (27333 records). [2025-10-30T17:06:30.329043] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-30T17:06:30.329162] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGO took 24.4s. Estimated remaining: 4h 21m 51s. Rate: 8.8 symbols/min [2025-10-30T17:06:30.535796] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T17:06:30.546527] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:30.547622] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-30T17:06:30.547713] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-30T17:06:30.547849] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-30T17:06:30.547894] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-30T17:06:30.547938] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-30T17:06:30.547998] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-30T17:06:30.905576] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-30T17:06:30.938426] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:31.471007] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T17:06:31.697551] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-30T17:06:31.816244] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T17:06:32.497517] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-30T17:06:32.850498] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T17:06:33.297524] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-30T17:06:33.328290] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T17:06:33.454420] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:06:33.454832] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-30T17:06:33.454948] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:06:33.455037] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-30T17:06:33.455127] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:06:33.455217] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-30T17:06:33.455323] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-30T17:06:33.455401] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-30T17:06:33.455491] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-30T17:06:33.455584] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 3.1s. Estimated remaining: 4h 19m 18s. Rate: 8.9 symbols/min [2025-10-30T17:06:33.634520] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:33.675813] [DEBUG] [LOCAL ] AHR: Loaded 48823 existing records from primary storage. [2025-10-30T17:06:33.676110] [INFO ] [MAIN ] AHR: Loaded 48823 existing records. [2025-10-30T17:06:33.853259] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:33.853453] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-30T17:06:33.853501] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-30T17:06:33.854530] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-30T17:06:33.854590] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-30T17:06:34.102740] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-30T17:06:34.212259] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:34.897510] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-30T17:06:34.996425] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T17:06:35.697492] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-30T17:06:36.193111] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T17:06:36.497492] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-30T17:06:36.697347] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T17:06:37.297498] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-30T17:06:37.335109] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-30T17:06:38.097473] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-30T17:06:38.659355] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T17:06:38.897530] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-30T17:06:39.037506] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T17:06:39.697530] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-30T17:06:39.842148] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T17:06:40.497504] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-30T17:06:41.043755] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T17:06:41.297611] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-30T17:06:41.551819] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T17:06:41.562326] [INFO ] [REMOTE ] AGRO: Full fetch complete (48516 records). [2025-10-30T17:06:41.562524] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-30T17:06:42.012136] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-30T17:06:42.012214] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-30T17:06:42.012706] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-30T17:06:42.012767] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-30T17:06:42.013711] [DEBUG] [LOCAL ] AGRO: Trimmed 48516 records to 32145 (keeping 200 days of data) [2025-10-30T17:06:42.107746] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-30T17:06:42.198694] [DEBUG] [LOCAL ] AGRO: Primary data saved (32145 records). [2025-10-30T17:06:42.198865] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-30T17:06:42.198955] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AGRO took 31.1s. Estimated remaining: 4h 20m 30s. Rate: 8.9 symbols/min [2025-10-30T17:06:42.375080] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:42.398583] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-30T17:06:42.410214] [DEBUG] [LOCAL ] AHT: Loaded 6421 existing records from primary storage. [2025-10-30T17:06:42.410854] [INFO ] [MAIN ] AHT: Loaded 6421 existing records. [2025-10-30T17:06:42.591037] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:42.591252] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-30T17:06:42.591302] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-30T17:06:42.591550] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-30T17:06:42.591588] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-30T17:06:42.912366] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-30T17:06:42.954142] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:43.253119] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T17:06:43.697529] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-30T17:06:44.436914] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T17:06:44.445322] [INFO ] [REMOTE ] AHH: Full fetch complete (59229 records). [2025-10-30T17:06:44.445466] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-30T17:06:44.508345] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-30T17:06:44.915165] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-30T17:06:44.925032] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-30T17:06:44.926510] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-30T17:06:44.927134] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T17:06:44.927289] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-30T17:06:44.935167] [DEBUG] [LOCAL ] AHH: Trimmed 59229 records to 39931 (keeping 200 days of data) [2025-10-30T17:06:45.188876] [DEBUG] [LOCAL ] AHH: Primary data saved (39931 records). [2025-10-30T17:06:45.189123] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T17:06:45.189318] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-30T17:06:45.189535] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AHH took 30.9s. Estimated remaining: 4h 17m 57s. Rate: 8.9 symbols/min [2025-10-30T17:06:45.302600] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-30T17:06:45.361322] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:45.410182] [DEBUG] [LOCAL ] AI: Loaded 53766 existing records from primary storage. [2025-10-30T17:06:45.410518] [INFO ] [MAIN ] AI: Loaded 53766 existing records. [2025-10-30T17:06:45.586374] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:45.586598] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-30T17:06:45.586669] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-30T17:06:45.587176] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-30T17:06:45.587242] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-30T17:06:45.932341] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:46.097503] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-30T17:06:46.600357] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T17:06:46.739907] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T17:06:46.897500] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-30T17:06:47.388707] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T17:06:47.697517] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-30T17:06:48.497578] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-30T17:06:48.751853] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T17:06:49.297532] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-30T17:06:49.761626] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:06:50.097550] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-30T17:06:50.275385] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-30T17:06:50.282012] [INFO ] [REMOTE ] AGX: Full fetch complete (48406 records). [2025-10-30T17:06:50.282154] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-30T17:06:50.660817] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-30T17:06:50.678426] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-30T17:06:50.678523] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-30T17:06:50.679086] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-30T17:06:50.679150] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-30T17:06:50.680173] [DEBUG] [LOCAL ] AGX: Trimmed 48406 records to 32319 (keeping 200 days of data) [2025-10-30T17:06:50.881467] [DEBUG] [LOCAL ] AGX: Primary data saved (32319 records). [2025-10-30T17:06:50.881593] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-30T17:06:50.881699] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AGX took 37.3s. Estimated remaining: 4h 17m 12s. Rate: 9.0 symbols/min [2025-10-30T17:06:50.902749] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-30T17:06:51.050864] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:06:51.113359] [DEBUG] [LOCAL ] AIG: Loaded 53447 existing records from primary storage. [2025-10-30T17:06:51.113921] [INFO ] [MAIN ] AIG: Loaded 53447 existing records. [2025-10-30T17:06:51.288620] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:06:51.288892] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-30T17:06:51.288942] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-30T17:06:51.289267] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-30T17:06:51.289329] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-30T17:06:51.656100] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:06:51.697507] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-30T17:06:52.166121] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T17:06:52.291798] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-30T17:06:52.497550] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-30T17:06:53.297494] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-30T17:06:53.919325] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T17:06:54.097500] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-30T17:06:54.897511] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-30T17:06:55.272122] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T17:06:55.360371] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-30T17:06:55.537576] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T17:06:55.697496] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-30T17:06:56.497543] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-30T17:06:57.162207] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T17:06:57.297498] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-30T17:06:57.633587] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-30T17:06:58.097513] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-30T17:06:58.740201] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-30T17:06:58.897494] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-30T17:06:59.356302] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T17:06:59.426007] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:06:59.697499] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-30T17:07:00.497519] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-30T17:07:01.291042] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-30T17:07:01.301516] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-30T17:07:02.036905] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-30T17:07:02.097458] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-30T17:07:02.897513] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-30T17:07:03.305608] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-30T17:07:03.343214] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T17:07:03.356702] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T17:07:03.697485] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-30T17:07:04.497524] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-30T17:07:05.297470] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-30T17:07:05.452849] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-30T17:07:05.781257] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T17:07:06.097501] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-30T17:07:06.456180] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T17:07:06.812888] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-30T17:07:06.815010] [INFO ] [REMOTE ] AHT: Full fetch complete (9024 records). [2025-10-30T17:07:06.815078] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-30T17:07:06.897511] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-30T17:07:07.175382] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-30T17:07:07.175478] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-30T17:07:07.175690] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-30T17:07:07.175757] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-30T17:07:07.176367] [DEBUG] [LOCAL ] AHT: Trimmed 9024 records to 6463 (keeping 200 days of data) [2025-10-30T17:07:07.212073] [DEBUG] [LOCAL ] AHT: Primary data saved (6463 records). [2025-10-30T17:07:07.212186] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-30T17:07:07.212263] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHT took 25.0s. Estimated remaining: 4h 23m 4s. Rate: 8.8 symbols/min [2025-10-30T17:07:07.381993] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:07.382154] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-30T17:07:07.382192] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-30T17:07:07.382302] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-30T17:07:07.382342] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-30T17:07:07.382384] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-30T17:07:07.382417] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-30T17:07:07.706210] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-30T17:07:07.737898] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:08.473489] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-30T17:07:08.497502] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-30T17:07:08.760093] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:07:08.760371] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-30T17:07:08.760456] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:07:08.760503] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-30T17:07:08.760560] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:07:08.760638] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-30T17:07:08.760745] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-30T17:07:08.760802] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-30T17:07:08.760843] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-30T17:07:08.760887] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AII took 1.5s. Estimated remaining: 4h 19m 43s. Rate: 8.9 symbols/min [2025-10-30T17:07:08.933381] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:08.933747] [DEBUG] [LOCAL ] AIN: No existing data file found in primary storage. [2025-10-30T17:07:08.933799] [WARN ] [MAIN ] AIN: No existing data found, performing full refresh instead. [2025-10-30T17:07:08.934013] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-30T17:07:08.934123] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-30T17:07:08.934193] [DEBUG] [LOCAL ] AIN: No primary data file found to delete. [2025-10-30T17:07:08.934229] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-30T17:07:09.127415] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T17:07:09.302809] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-30T17:07:09.352321] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:10.097500] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-30T17:07:10.897491] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-30T17:07:11.298263] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-30T17:07:11.386139] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T17:07:11.697496] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-30T17:07:12.497467] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-30T17:07:12.512077] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-30T17:07:12.545568] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-30T17:07:12.556076] [INFO ] [REMOTE ] AHR: Full fetch complete (70885 records). [2025-10-30T17:07:12.556206] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-30T17:07:12.968448] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-30T17:07:12.968535] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-30T17:07:12.969211] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-30T17:07:12.969274] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-30T17:07:12.970625] [DEBUG] [LOCAL ] AHR: Trimmed 70885 records to 49186 (keeping 200 days of data) [2025-10-30T17:07:13.258752] [DEBUG] [LOCAL ] AHR: Primary data saved (49186 records). [2025-10-30T17:07:13.258875] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-30T17:07:13.258950] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AHR took 39.8s. Estimated remaining: 4h 18m 15s. Rate: 8.9 symbols/min [2025-10-30T17:07:13.304155] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-30T17:07:13.438152] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:13.450860] [DEBUG] [LOCAL ] AIO: Loaded 12727 existing records from primary storage. [2025-10-30T17:07:13.451109] [INFO ] [MAIN ] AIO: Loaded 12727 existing records. [2025-10-30T17:07:13.632046] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:07:13.632243] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-30T17:07:13.632290] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-30T17:07:13.632513] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-30T17:07:13.632584] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-30T17:07:14.011201] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:14.022193] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-30T17:07:14.055206] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-30T17:07:14.097464] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-30T17:07:14.885329] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-30T17:07:14.897461] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-30T17:07:15.697543] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-30T17:07:15.867933] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T17:07:16.497562] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-30T17:07:17.297507] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-30T17:07:17.496741] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-30T17:07:17.999922] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T17:07:18.011527] [INFO ] [REMOTE ] AIG: Full fetch complete (77560 records). [2025-10-30T17:07:18.011719] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-30T17:07:18.102599] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-30T17:07:18.373564] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T17:07:18.425703] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-30T17:07:18.425783] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-30T17:07:18.426496] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-30T17:07:18.426559] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-30T17:07:18.427935] [DEBUG] [LOCAL ] AIG: Trimmed 77560 records to 53837 (keeping 200 days of data) [2025-10-30T17:07:18.746791] [DEBUG] [LOCAL ] AIG: Primary data saved (53837 records). [2025-10-30T17:07:18.746926] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-30T17:07:18.748204] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AIG took 27.9s. Estimated remaining: 4h 17m 24s. Rate: 8.9 symbols/min [2025-10-30T17:07:18.899735] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-30T17:07:18.916337] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:18.944191] [DEBUG] [LOCAL ] AIR: Loaded 28373 existing records from primary storage. [2025-10-30T17:07:18.944434] [INFO ] [MAIN ] AIR: Loaded 28373 existing records. [2025-10-30T17:07:19.127827] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T17:07:19.131430] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:07:19.135361] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-30T17:07:19.135410] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-30T17:07:19.135981] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-30T17:07:19.136040] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-30T17:07:19.490675] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:19.698529] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-30T17:07:19.699866] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-30T17:07:20.497546] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-30T17:07:21.302613] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-30T17:07:21.312053] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T17:07:21.619397] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-30T17:07:22.097488] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-30T17:07:22.198208] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T17:07:22.897484] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-30T17:07:23.177299] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T17:07:23.702691] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-30T17:07:23.709109] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T17:07:24.497469] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-30T17:07:24.634410] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T17:07:25.059798] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T17:07:25.297463] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-30T17:07:26.097564] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-30T17:07:26.304069] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T17:07:26.309705] [INFO ] [REMOTE ] AIN: Full fetch complete (33884 records). [2025-10-30T17:07:26.309822] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-30T17:07:26.709243] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-30T17:07:26.709346] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-30T17:07:26.709774] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-30T17:07:26.709835] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-30T17:07:26.710636] [DEBUG] [LOCAL ] AIN: Trimmed 33884 records to 24354 (keeping 200 days of data) [2025-10-30T17:07:26.856901] [DEBUG] [LOCAL ] AIN: Primary data saved (24354 records). [2025-10-30T17:07:26.857039] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-30T17:07:26.857115] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AIN took 18.1s. Estimated remaining: 4h 18m 6s. Rate: 8.9 symbols/min [2025-10-30T17:07:26.902622] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-30T17:07:27.031711] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:27.056090] [DEBUG] [LOCAL ] AIT: Loaded 26097 existing records from primary storage. [2025-10-30T17:07:27.056339] [INFO ] [MAIN ] AIT: Loaded 26097 existing records. [2025-10-30T17:07:27.230802] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:07:27.231000] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-30T17:07:27.231048] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-30T17:07:27.231590] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-30T17:07:27.231679] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-30T17:07:27.590320] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:27.600167] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T17:07:27.697486] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-30T17:07:28.090035] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-30T17:07:28.251520] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-30T17:07:28.497581] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-30T17:07:29.297484] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-30T17:07:29.374689] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T17:07:30.097500] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-30T17:07:30.695057] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-30T17:07:30.897534] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-30T17:07:31.195071] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-30T17:07:31.550869] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-30T17:07:31.697530] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-30T17:07:32.497497] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-30T17:07:32.880523] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T17:07:33.079337] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-30T17:07:33.297532] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-30T17:07:34.097530] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-30T17:07:34.196777] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-30T17:07:34.897528] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-30T17:07:35.697516] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-30T17:07:35.924627] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T17:07:36.095189] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-30T17:07:36.232309] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-30T17:07:36.244303] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-30T17:07:36.244470] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-30T17:07:36.502731] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-30T17:07:36.643722] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-30T17:07:36.643802] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-30T17:07:36.644502] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-30T17:07:36.644542] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-30T17:07:36.645924] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 54156 (keeping 200 days of data) [2025-10-30T17:07:36.954522] [DEBUG] [LOCAL ] AI: Primary data saved (54156 records). [2025-10-30T17:07:36.954675] [INFO ] [MAIN ] AI: Full history saved. [2025-10-30T17:07:36.955802] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AI took 51.8s. Estimated remaining: 4h 19m 55s. Rate: 8.8 symbols/min [2025-10-30T17:07:37.130624] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:37.141024] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-30T17:07:37.179670] [DEBUG] [LOCAL ] AIV: Loaded 41758 existing records from primary storage. [2025-10-30T17:07:37.179969] [INFO ] [MAIN ] AIV: Loaded 41758 existing records. [2025-10-30T17:07:37.302736] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-30T17:07:37.378503] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:07:37.378715] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-30T17:07:37.378768] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-30T17:07:37.379503] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-30T17:07:37.379561] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-30T17:07:37.736038] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:38.095295] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-30T17:07:38.098673] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-30T17:07:38.897479] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-30T17:07:39.592311] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T17:07:39.697476] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-30T17:07:39.973976] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T17:07:40.497547] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-30T17:07:40.780620] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T17:07:41.297506] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-30T17:07:41.474855] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T17:07:42.097474] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-30T17:07:42.123610] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T17:07:42.127176] [INFO ] [REMOTE ] AIO: Full fetch complete (20083 records). [2025-10-30T17:07:42.127248] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-30T17:07:42.486970] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-30T17:07:42.487051] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-30T17:07:42.487314] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-30T17:07:42.487354] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-30T17:07:42.488014] [DEBUG] [LOCAL ] AIO: Trimmed 20083 records to 12827 (keeping 200 days of data) [2025-10-30T17:07:42.562794] [DEBUG] [LOCAL ] AIO: Primary data saved (12827 records). [2025-10-30T17:07:42.562929] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-30T17:07:42.563009] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIO took 29.3s. Estimated remaining: 4h 19m 8s. Rate: 8.9 symbols/min [2025-10-30T17:07:42.732701] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:42.759394] [DEBUG] [LOCAL ] AIZ: Loaded 28714 existing records from primary storage. [2025-10-30T17:07:42.759631] [INFO ] [MAIN ] AIZ: Loaded 28714 existing records. [2025-10-30T17:07:42.898291] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-30T17:07:42.939466] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:07:42.939891] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-30T17:07:42.939997] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-30T17:07:42.945918] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-30T17:07:42.952710] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-30T17:07:42.985973] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T17:07:43.308741] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:43.697539] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-30T17:07:43.970675] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T17:07:44.497535] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-30T17:07:44.514916] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T17:07:45.297520] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-30T17:07:45.366975] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:07:46.097511] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-30T17:07:46.359345] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-30T17:07:46.897495] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-30T17:07:47.124753] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:07:47.697549] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-30T17:07:47.900681] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T17:07:48.497513] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-30T17:07:48.557806] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T17:07:49.297514] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-30T17:07:49.529752] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T17:07:50.097472] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-30T17:07:50.225579] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T17:07:50.897499] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-30T17:07:51.163064] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T17:07:51.697509] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-30T17:07:51.920721] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T17:07:52.497486] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-30T17:07:52.533029] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-30T17:07:53.297496] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-30T17:07:53.622458] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T17:07:54.097515] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-30T17:07:54.379018] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T17:07:54.897484] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-30T17:07:55.029270] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T17:07:55.697476] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-30T17:07:55.796796] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-30T17:07:56.497494] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-30T17:07:56.625133] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T17:07:57.297470] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-30T17:07:57.343087] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-30T17:07:57.348359] [INFO ] [REMOTE ] AIT: Full fetch complete (38947 records). [2025-10-30T17:07:57.348453] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-30T17:07:57.734915] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-30T17:07:57.735004] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-30T17:07:57.735414] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-30T17:07:57.735457] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-30T17:07:57.736409] [DEBUG] [LOCAL ] AIT: Trimmed 38947 records to 26298 (keeping 200 days of data) [2025-10-30T17:07:57.898903] [DEBUG] [LOCAL ] AIT: Primary data saved (26298 records). [2025-10-30T17:07:57.899045] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-30T17:07:57.899124] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIT took 31.0s. Estimated remaining: 4h 23m 47s. Rate: 8.7 symbols/min [2025-10-30T17:07:58.077146] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:07:58.082797] [DEBUG] [LOCAL ] AIZN: Loaded 3613 existing records from primary storage. [2025-10-30T17:07:58.083060] [INFO ] [MAIN ] AIZN: Loaded 3613 existing records. [2025-10-30T17:07:58.103579] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-30T17:07:58.292271] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:07:58.292705] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-30T17:07:58.292812] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-30T17:07:58.293045] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-30T17:07:58.293104] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-30T17:07:58.413719] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T17:07:58.679938] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:07:58.897522] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-30T17:07:59.189681] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T17:07:59.544615] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-30T17:07:59.697489] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-30T17:08:00.121224] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T17:08:00.497509] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-30T17:08:01.297521] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-30T17:08:01.615160] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T17:08:02.097494] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-30T17:08:02.517904] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-30T17:08:02.851202] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-30T17:08:02.897462] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-30T17:08:03.697531] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-30T17:08:04.188001] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T17:08:04.409443] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T17:08:04.497481] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-30T17:08:04.863351] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T17:08:05.297514] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-30T17:08:05.665145] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-30T17:08:06.097506] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-30T17:08:06.534258] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-30T17:08:06.897493] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-30T17:08:07.265728] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-30T17:08:07.697489] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-30T17:08:08.497496] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-30T17:08:08.900429] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T17:08:08.921008] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T17:08:09.297521] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-30T17:08:09.848927] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T17:08:09.850276] [INFO ] [REMOTE ] AIZN: Full fetch complete (5490 records). [2025-10-30T17:08:09.850345] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-30T17:08:10.102638] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-30T17:08:10.209936] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-30T17:08:10.210006] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-30T17:08:10.210160] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-30T17:08:10.210198] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-30T17:08:10.210542] [DEBUG] [LOCAL ] AIZN: Trimmed 5490 records to 3626 (keeping 200 days of data) [2025-10-30T17:08:10.232528] [DEBUG] [LOCAL ] AIZN: Primary data saved (3626 records). [2025-10-30T17:08:10.232621] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-30T17:08:10.232723] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIZN took 12.3s. Estimated remaining: 4h 26m 38s. Rate: 8.6 symbols/min [2025-10-30T17:08:10.402905] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:08:10.442664] [DEBUG] [LOCAL ] AJG: Loaded 46216 existing records from primary storage. [2025-10-30T17:08:10.442965] [INFO ] [MAIN ] AJG: Loaded 46216 existing records. [2025-10-30T17:08:10.620054] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:08:10.620248] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-30T17:08:10.620293] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-30T17:08:10.621144] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-30T17:08:10.621201] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-30T17:08:10.902695] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-30T17:08:10.968598] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:08:11.228114] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-30T17:08:11.697496] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-30T17:08:12.497501] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-30T17:08:12.801423] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-30T17:08:12.810622] [INFO ] [REMOTE ] AIR: Full fetch complete (39900 records). [2025-10-30T17:08:12.810810] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-30T17:08:12.811433] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:08:12.811523] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:08:12.811566] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:08:12.811630] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-30T17:08:12.811733] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-30T17:08:12.811775] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-30T17:08:12.811956] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-10-30T17:08:12.812049] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIR took 54.1s. Estimated remaining: 4h 24m 9s. Rate: 8.7 symbols/min [2025-10-30T17:08:12.977429] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:08:12.977612] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-30T17:08:12.977675] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-30T17:08:12.977789] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-30T17:08:12.977829] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-30T17:08:12.977889] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-30T17:08:12.977924] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-30T17:08:13.325628] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-30T17:08:13.330484] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:08:13.383466] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T17:08:13.389030] [INFO ] [REMOTE ] AIZ: Full fetch complete (42619 records). [2025-10-30T17:08:13.389110] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-30T17:08:13.798175] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-30T17:08:13.808031] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-30T17:08:13.808105] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-30T17:08:13.808973] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-30T17:08:13.809053] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-30T17:08:13.809556] [INFO ] [REMOTE ] AIV: Full fetch complete (60340 records). [2025-10-30T17:08:13.809923] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-30T17:08:13.810541] [DEBUG] [LOCAL ] AIZ: Trimmed 42619 records to 28894 (keeping 200 days of data) [2025-10-30T17:08:14.099736] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-30T17:08:14.376006] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-30T17:08:14.376330] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-30T17:08:14.377498] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-30T17:08:14.377575] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-30T17:08:14.381248] [DEBUG] [LOCAL ] AIV: Trimmed 60340 records to 42131 (keeping 200 days of data) [2025-10-30T17:08:14.383691] [DEBUG] [LOCAL ] AIZ: Primary data saved (28894 records). [2025-10-30T17:08:14.383762] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-30T17:08:14.383841] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIZ took 31.8s. Estimated remaining: 4h 21m 13s. Rate: 8.8 symbols/min [2025-10-30T17:08:14.781812] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T17:08:14.751265] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:08:14.832961] [DEBUG] [LOCAL ] AIV: Primary data saved (42131 records). [2025-10-30T17:08:14.833205] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-30T17:08:14.833319] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AIV took 37.9s. Estimated remaining: 4h 17m 45s. Rate: 8.9 symbols/min [2025-10-30T17:08:14.904397] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-30T17:08:15.050731] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:08:15.066199] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-30T17:08:15.066962] [DEBUG] [LOCAL ] AKR: Loaded 45938 existing records from primary storage. [2025-10-30T17:08:15.077966] [INFO ] [MAIN ] AKR: Loaded 45938 existing records. [2025-10-30T17:08:15.283937] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:08:15.284185] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-30T17:08:15.284288] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-30T17:08:15.285078] [DEBUG] [LOCAL ] AL: Loaded 44711 existing records from primary storage. [2025-10-30T17:08:15.285442] [INFO ] [MAIN ] AL: Loaded 44711 existing records. [2025-10-30T17:08:15.290821] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-30T17:08:15.309202] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-30T17:08:15.429236] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T17:08:15.629600] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:08:15.699432] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-30T17:08:15.711991] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-30T17:08:15.745534] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-30T17:08:15.778155] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-30T17:08:15.788538] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-30T17:08:15.939818] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:08:16.047549] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-30T17:08:16.243306] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:08:16.497514] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-30T17:08:17.297529] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-30T17:08:17.741520] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T17:08:18.097505] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-30T17:08:18.565287] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T17:08:18.897504] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-30T17:08:19.246086] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T17:08:19.697535] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-30T17:08:20.012358] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-30T17:08:20.052331] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T17:08:20.497543] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-30T17:08:21.297573] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-30T17:08:22.097483] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-30T17:08:22.132979] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-30T17:08:22.325104] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:08:22.625075] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-30T17:08:22.897486] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-30T17:08:23.697526] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-30T17:08:23.951618] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-30T17:08:24.241128] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:08:24.497494] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-30T17:08:25.297492] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-30T17:08:25.587935] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-30T17:08:25.764732] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T17:08:26.097527] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-30T17:08:26.897488] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-30T17:08:27.280456] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-30T17:08:27.697527] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-30T17:08:28.000152] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T17:08:28.497508] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-30T17:08:28.723231] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-30T17:08:28.926347] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T17:08:29.297504] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-30T17:08:30.097517] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-30T17:08:30.481848] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T17:08:30.897508] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-30T17:08:31.440692] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T17:08:31.697534] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-30T17:08:31.981239] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-30T17:08:32.465283] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-30T17:08:32.476525] [INFO ] [REMOTE ] AJG: Full fetch complete (68729 records). [2025-10-30T17:08:32.476711] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-30T17:08:32.502588] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-30T17:08:32.935554] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-30T17:08:32.935670] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-30T17:08:32.936338] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-30T17:08:32.936383] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-30T17:08:32.937769] [DEBUG] [LOCAL ] AJG: Trimmed 68729 records to 46589 (keeping 200 days of data) [2025-10-30T17:08:33.190160] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-30T17:08:33.195988] [INFO ] [REMOTE ] AKA: Full fetch complete (2808 records). [2025-10-30T17:08:33.200200] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-30T17:08:33.302901] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-30T17:08:33.330983] [DEBUG] [LOCAL ] AJG: Primary data saved (46589 records). [2025-10-30T17:08:33.338897] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-30T17:08:33.339049] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AJG took 23.1s. Estimated remaining: 4h 23m 43s. Rate: 8.7 symbols/min [2025-10-30T17:08:33.529436] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-30T17:08:33.535458] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:08:33.551006] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:08:33.568296] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-30T17:08:33.574672] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-30T17:08:33.574762] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-30T17:08:33.581934] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-30T17:08:33.582756] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AKA took 20.8s. Estimated remaining: 4h 20m 12s. Rate: 8.8 symbols/min [2025-10-30T17:08:33.630910] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:08:33.776557] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:08:33.814202] [DEBUG] [LOCAL ] ALB: Loaded 53354 existing records from primary storage. [2025-10-30T17:08:33.814613] [INFO ] [MAIN ] ALB: Loaded 53354 existing records. [2025-10-30T17:08:34.048523] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:08:34.048817] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-30T17:08:34.050341] [DEBUG] [LOCAL ] ALC: Loaded 51123 existing records from primary storage. [2025-10-30T17:08:34.048907] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-30T17:08:34.050895] [INFO ] [MAIN ] ALC: Loaded 51123 existing records. [2025-10-30T17:08:34.082974] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-30T17:08:34.106605] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-30T17:08:34.106720] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-30T17:08:34.354507] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:08:34.387890] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-30T17:08:34.434754] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-30T17:08:34.461902] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-30T17:08:34.499326] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-30T17:08:34.729573] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:08:34.896397] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-30T17:08:34.902259] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-30T17:08:35.014573] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:08:35.317606] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T17:08:35.697507] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-30T17:08:36.447711] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:08:36.497470] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-30T17:08:37.133578] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T17:08:37.297494] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-30T17:08:37.781232] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T17:08:38.097484] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-30T17:08:38.685566] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T17:08:38.897458] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-30T17:08:39.444114] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T17:08:39.697492] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-30T17:08:40.402874] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-30T17:08:40.497527] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-30T17:08:41.142243] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T17:08:41.297574] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-30T17:08:41.859977] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-30T17:08:42.097527] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-30T17:08:42.573054] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T17:08:42.897493] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-30T17:08:43.129190] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T17:08:43.697525] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-30T17:08:44.085147] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T17:08:44.497507] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-30T17:08:44.966151] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T17:08:45.297512] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-30T17:08:45.810816] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T17:08:46.097516] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-30T17:08:46.897468] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-30T17:08:47.083173] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-30T17:08:47.592126] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-30T17:08:47.697547] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-30T17:08:47.985911] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T17:08:48.497515] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-30T17:08:48.690392] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T17:08:49.297509] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-30T17:08:49.777204] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T17:08:50.097498] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-30T17:08:50.361700] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T17:08:50.897481] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-30T17:08:51.307138] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T17:08:51.697526] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-30T17:08:52.049468] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T17:08:52.497474] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-30T17:08:52.950159] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T17:08:53.297520] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-30T17:08:53.915163] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T17:08:53.925772] [INFO ] [REMOTE ] AL: Full fetch complete (63928 records). [2025-10-30T17:08:53.925918] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-30T17:08:54.104917] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-30T17:08:54.332791] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-30T17:08:54.332878] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-30T17:08:54.333506] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-30T17:08:54.333550] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-30T17:08:54.334859] [DEBUG] [LOCAL ] AL: Trimmed 63928 records to 45059 (keeping 200 days of data) [2025-10-30T17:08:54.603859] [DEBUG] [LOCAL ] AL: Primary data saved (45059 records). [2025-10-30T17:08:54.604047] [INFO ] [MAIN ] AL: Full history saved. [2025-10-30T17:08:54.604136] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AL took 39.8s. Estimated remaining: 4h 27m 14s. Rate: 8.6 symbols/min [2025-10-30T17:08:54.839117] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:08:54.841670] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-30T17:08:54.880694] [DEBUG] [LOCAL ] ALE: Loaded 31738 existing records from primary storage. [2025-10-30T17:08:54.880986] [INFO ] [MAIN ] ALE: Loaded 31738 existing records. [2025-10-30T17:08:54.902635] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-30T17:08:55.058074] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:08:55.058277] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-30T17:08:55.058345] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-30T17:08:55.058683] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-30T17:08:55.058739] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-30T17:08:55.419775] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:08:55.697499] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-30T17:08:55.800962] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T17:08:55.811600] [INFO ] [REMOTE ] AKR: Full fetch complete (65558 records). [2025-10-30T17:08:55.811781] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-30T17:08:56.230579] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-30T17:08:56.230683] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-30T17:08:56.231346] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-30T17:08:56.231388] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-30T17:08:56.232601] [DEBUG] [LOCAL ] AKR: Trimmed 65558 records to 46317 (keeping 200 days of data) [2025-10-30T17:08:56.498245] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-30T17:08:56.508451] [DEBUG] [LOCAL ] AKR: Primary data saved (46317 records). [2025-10-30T17:08:56.508541] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-30T17:08:56.508668] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AKR took 42.1s. Estimated remaining: 4h 24m 35s. Rate: 8.7 symbols/min [2025-10-30T17:08:56.876354] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-30T17:08:57.180294] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T17:08:57.297465] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-30T17:08:57.440095] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T17:08:58.097511] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-30T17:08:58.835260] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-30T17:08:58.846979] [INFO ] [REMOTE ] ALC: Full fetch complete (73988 records). [2025-10-30T17:08:58.847125] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-30T17:08:58.910577] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-30T17:08:59.228522] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-30T17:08:59.228603] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-30T17:08:59.229296] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-30T17:08:59.229361] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-30T17:08:59.230743] [DEBUG] [LOCAL ] ALC: Trimmed 73988 records to 51499 (keeping 200 days of data) [2025-10-30T17:08:59.526516] [DEBUG] [LOCAL ] ALC: Primary data saved (51499 records). [2025-10-30T17:08:59.526683] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-30T17:08:59.527671] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALC took 25.9s. Estimated remaining: 4h 22m 33s. Rate: 8.7 symbols/min [2025-10-30T17:08:59.646371] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-30T17:08:59.697842] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T17:08:59.697906] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-30T17:09:00.497491] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-30T17:09:01.848247] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T17:09:01.854589] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-30T17:09:02.120070] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-30T17:09:02.132068] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-30T17:09:03.118902] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:09:03.125842] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-30T17:09:03.785625] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-30T17:09:03.798848] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-30T17:09:04.248897] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T17:09:04.497494] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-30T17:09:05.476300] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T17:09:05.487636] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-30T17:09:05.602938] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T17:09:06.097492] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-30T17:09:07.252693] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T17:09:07.260325] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-30T17:09:07.457813] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-30T17:09:07.469870] [INFO ] [REMOTE ] ALB: Full fetch complete (76740 records). [2025-10-30T17:09:07.470019] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-30T17:09:07.470750] [FATAL] [VALIDATOR ] ALB: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:09:07.470860] [FATAL] [MAIN ] ALB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:09:07.470939] [WARN ] [MAIN ] ALB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:09:07.471035] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-30T17:09:07.471143] [DEBUG] [LOCAL ] ALB: No primary data file found to delete. [2025-10-30T17:09:07.471216] [INFO ] [LOCAL ] ALB: Starting deletion of derivative data. [2025-10-30T17:09:07.471442] [DEBUG] [LOCAL ] ALB: Deleted derivative data file. [2025-10-30T17:09:07.471533] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALB took 34.1s. Estimated remaining: 4h 22m 57s. Rate: 8.7 symbols/min [2025-10-30T17:09:08.377386] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:09:08.389159] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-30T17:09:09.681360] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T17:09:09.689429] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-30T17:09:10.883276] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T17:09:10.891744] [INFO ] [REMOTE ] ALE: Full fetch complete (44440 records). [2025-10-30T17:09:10.891859] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-30T17:09:11.274539] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-30T17:09:11.274614] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-30T17:09:11.275088] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-30T17:09:11.275147] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-30T17:09:11.276124] [DEBUG] [LOCAL ] ALE: Trimmed 44440 records to 31988 (keeping 200 days of data) [2025-10-30T17:09:11.462562] [DEBUG] [LOCAL ] ALE: Primary data saved (31988 records). [2025-10-30T17:09:11.462712] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-30T17:09:11.462799] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALE took 16.9s. Estimated remaining: 4h 21m 27s. Rate: 8.7 symbols/min [2025-10-30T17:09:12.106548] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:12.131596] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:12.108514] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:12.205887] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:12.206409] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-30T17:09:12.206620] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-30T17:09:12.206759] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-30T17:09:12.206803] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-30T17:09:12.206917] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-30T17:09:12.206955] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-30T17:09:12.242239] [DEBUG] [LOCAL ] ALG: Loaded 9448 existing records from primary storage. [2025-10-30T17:09:12.299547] [INFO ] [MAIN ] ALG: Loaded 9448 existing records. [2025-10-30T17:09:12.328381] [DEBUG] [LOCAL ] ALEX: Loaded 30183 existing records from primary storage. [2025-10-30T17:09:12.377493] [INFO ] [MAIN ] ALEX: Loaded 30183 existing records. [2025-10-30T17:09:12.664494] [DEBUG] [LOCAL ] ALIT: Loaded 52758 existing records from primary storage. [2025-10-30T17:09:12.800887] [INFO ] [MAIN ] ALIT: Loaded 52758 existing records. [2025-10-30T17:09:12.903372] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:12.963013] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-30T17:09:13.024157] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-30T17:09:13.072895] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-30T17:09:13.076689] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-30T17:09:13.196767] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:13.281045] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-30T17:09:13.294083] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-30T17:09:13.292240] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:13.348743] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:13.349110] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-30T17:09:13.364871] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-30T17:09:13.363817] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-30T17:09:13.365100] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-30T17:09:13.365684] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-30T17:09:13.401389] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-30T17:09:13.426114] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-30T17:09:13.728552] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:09:13.750279] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-30T17:09:13.837776] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:09:13.843572] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-30T17:09:13.996380] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:09:14.044141] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-30T17:09:14.060344] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-30T17:09:14.111162] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:14.072720] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-30T17:09:14.169328] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-30T17:09:14.169204] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-30T17:09:14.174741] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.7s. Estimated remaining: 4h 19m 23s. Rate: 8.8 symbols/min [2025-10-30T17:09:14.453519] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:14.480760] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-30T17:09:14.553396] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:14.577523] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-30T17:09:14.608535] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:14.654544] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-30T17:09:14.654893] [INFO ] [MAIN ] ALK: Loaded 53087 existing records. [2025-10-30T17:09:14.840762] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:14.841000] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-30T17:09:14.841050] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-30T17:09:14.841849] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-30T17:09:14.841911] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-30T17:09:15.102309] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-30T17:09:15.127498] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-30T17:09:15.212577] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:15.212875] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-30T17:09:15.487316] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-30T17:09:15.493109] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-30T17:09:16.102338] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T17:09:16.105506] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-30T17:09:16.145857] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-30T17:09:16.156610] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-30T17:09:16.416712] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T17:09:16.497481] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-30T17:09:16.751882] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-30T17:09:16.875302] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-30T17:09:17.297494] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-30T17:09:17.438956] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T17:09:17.502192] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T17:09:18.097521] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-30T17:09:18.457777] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T17:09:18.897548] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-30T17:09:19.265131] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T17:09:19.697563] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-30T17:09:20.260414] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:09:20.497477] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-30T17:09:21.288449] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T17:09:21.299103] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-30T17:09:22.097518] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-30T17:09:22.294186] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T17:09:22.328580] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-30T17:09:22.737169] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-30T17:09:22.897536] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-30T17:09:23.422167] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T17:09:23.697497] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-30T17:09:24.301379] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T17:09:24.497537] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-30T17:09:25.297562] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-30T17:09:25.697841] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T17:09:25.984573] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-30T17:09:26.097571] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-30T17:09:26.897521] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-30T17:09:26.977041] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T17:09:27.697541] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-30T17:09:28.313216] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T17:09:28.345357] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T17:09:28.497495] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-30T17:09:29.297499] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-30T17:09:29.804401] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T17:09:29.878530] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-30T17:09:30.097508] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-30T17:09:30.897497] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-30T17:09:31.248206] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T17:09:31.697468] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-30T17:09:32.506454] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-30T17:09:32.511797] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-30T17:09:32.774474] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T17:09:33.297471] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-30T17:09:33.375789] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-30T17:09:33.378371] [INFO ] [REMOTE ] ALG: Full fetch complete (14902 records). [2025-10-30T17:09:33.378450] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-30T17:09:33.750784] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-30T17:09:33.750898] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-30T17:09:33.751147] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-30T17:09:33.751191] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-30T17:09:33.751667] [DEBUG] [LOCAL ] ALG: Trimmed 14902 records to 9513 (keeping 200 days of data) [2025-10-30T17:09:33.809745] [DEBUG] [LOCAL ] ALG: Primary data saved (9513 records). [2025-10-30T17:09:33.809870] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-30T17:09:33.809945] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 22.3s. Estimated remaining: 4h 25m 14s. Rate: 8.6 symbols/min [2025-10-30T17:09:33.973553] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:33.973756] [DEBUG] [LOCAL ] ALL: No existing data file found in primary storage. [2025-10-30T17:09:33.973859] [WARN ] [MAIN ] ALL: No existing data found, performing full refresh instead. [2025-10-30T17:09:33.973939] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-30T17:09:33.973976] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-30T17:09:33.974016] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-10-30T17:09:33.974047] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-30T17:09:34.109673] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-30T17:09:34.324071] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:34.590050] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T17:09:34.901720] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-30T17:09:34.905607] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T17:09:35.697492] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-30T17:09:36.162747] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:09:36.497496] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-30T17:09:36.874744] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:09:37.297493] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-30T17:09:38.097499] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-30T17:09:38.460672] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-30T17:09:38.473058] [INFO ] [REMOTE ] ALK: Full fetch complete (77044 records). [2025-10-30T17:09:38.473236] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-30T17:09:38.844393] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:09:38.901923] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-30T17:09:38.903027] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-30T17:09:38.903113] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-30T17:09:38.903948] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-30T17:09:38.904099] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-30T17:09:38.905710] [DEBUG] [LOCAL ] ALK: Trimmed 77044 records to 53474 (keeping 200 days of data) [2025-10-30T17:09:39.221152] [DEBUG] [LOCAL ] ALK: Primary data saved (53474 records). [2025-10-30T17:09:39.221315] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-30T17:09:39.221400] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALK took 25.0s. Estimated remaining: 4h 24m 24s. Rate: 8.6 symbols/min [2025-10-30T17:09:39.393199] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:39.425385] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T17:09:39.473829] [DEBUG] [LOCAL ] ALLE: Loaded 43704 existing records from primary storage. [2025-10-30T17:09:39.474133] [INFO ] [MAIN ] ALLE: Loaded 43704 existing records. [2025-10-30T17:09:39.677519] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:39.677777] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-30T17:09:39.677830] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-30T17:09:39.678377] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-30T17:09:39.678433] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-30T17:09:39.702678] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-30T17:09:40.043275] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:40.348593] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T17:09:40.497494] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-30T17:09:41.206885] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T17:09:41.297485] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-30T17:09:42.074014] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T17:09:42.097460] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-30T17:09:42.250506] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T17:09:42.897480] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-30T17:09:43.424330] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:09:43.697503] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-30T17:09:43.991747] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T17:09:43.998895] [INFO ] [REMOTE ] ALEX: Full fetch complete (44627 records). [2025-10-30T17:09:43.998992] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-30T17:09:44.381333] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-30T17:09:44.381411] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-30T17:09:44.381906] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-30T17:09:44.381969] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-30T17:09:44.382930] [DEBUG] [LOCAL ] ALEX: Trimmed 44627 records to 30448 (keeping 200 days of data) [2025-10-30T17:09:44.498703] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-30T17:09:44.563932] [DEBUG] [LOCAL ] ALEX: Primary data saved (30448 records). [2025-10-30T17:09:44.564047] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-30T17:09:44.564122] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALEX took 33.1s. Estimated remaining: 4h 23m 33s. Rate: 8.7 symbols/min [2025-10-30T17:09:44.735178] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:44.780602] [DEBUG] [LOCAL ] ALLY: Loaded 53190 existing records from primary storage. [2025-10-30T17:09:44.780967] [INFO ] [MAIN ] ALLY: Loaded 53190 existing records. [2025-10-30T17:09:44.966292] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:44.966612] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-30T17:09:44.966760] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-30T17:09:44.967287] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-30T17:09:44.967405] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-30T17:09:45.254344] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-30T17:09:45.299635] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-30T17:09:45.379736] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:46.060265] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-30T17:09:46.097459] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-30T17:09:46.641093] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:09:46.897507] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-30T17:09:47.697503] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-30T17:09:47.740374] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T17:09:47.752017] [INFO ] [REMOTE ] ALIT: Full fetch complete (76629 records). [2025-10-30T17:09:47.752159] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-30T17:09:48.154175] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-30T17:09:48.154319] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-30T17:09:48.155124] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-30T17:09:48.155205] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-30T17:09:48.180948] [DEBUG] [LOCAL ] ALIT: Trimmed 76629 records to 53146 (keeping 200 days of data) [2025-10-30T17:09:48.180808] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T17:09:48.493947] [DEBUG] [LOCAL ] ALIT: Primary data saved (53146 records). [2025-10-30T17:09:48.494075] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-30T17:09:48.495139] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALIT took 37.0s. Estimated remaining: 4h 22m 6s. Rate: 8.7 symbols/min [2025-10-30T17:09:48.506396] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-30T17:09:48.664624] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:48.703613] [DEBUG] [LOCAL ] ALSN: Loaded 42990 existing records from primary storage. [2025-10-30T17:09:48.703903] [INFO ] [MAIN ] ALSN: Loaded 42990 existing records. [2025-10-30T17:09:48.879100] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:48.879278] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-30T17:09:48.879323] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-30T17:09:48.879698] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-30T17:09:48.879753] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-30T17:09:49.243991] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:49.307545] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-30T17:09:49.313386] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-30T17:09:49.832721] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T17:09:50.097521] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-30T17:09:50.463178] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T17:09:50.897522] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-30T17:09:51.174681] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T17:09:51.697513] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-30T17:09:52.472062] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-30T17:09:52.497471] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-30T17:09:53.203468] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T17:09:53.297456] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-30T17:09:53.824868] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T17:09:54.097562] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-30T17:09:54.387792] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T17:09:54.897503] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-30T17:09:55.470081] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T17:09:55.697509] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-30T17:09:55.951112] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T17:09:56.497490] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-30T17:09:56.598336] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T17:09:57.305990] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-30T17:09:57.311775] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T17:09:57.322501] [INFO ] [REMOTE ] ALL: Full fetch complete (72210 records). [2025-10-30T17:09:57.322619] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-30T17:09:57.758350] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-30T17:09:57.758432] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-30T17:09:57.759149] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-30T17:09:57.759212] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-30T17:09:57.760742] [DEBUG] [LOCAL ] ALL: Trimmed 72210 records to 49729 (keeping 200 days of data) [2025-10-30T17:09:58.078269] [DEBUG] [LOCAL ] ALL: Primary data saved (49729 records). [2025-10-30T17:09:58.078395] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-30T17:09:58.078465] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALL took 24.3s. Estimated remaining: 4h 23m 10s. Rate: 8.7 symbols/min [2025-10-30T17:09:58.108712] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-30T17:09:58.250125] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:09:58.269521] [DEBUG] [LOCAL ] ALTG: Loaded 22719 existing records from primary storage. [2025-10-30T17:09:58.269802] [INFO ] [MAIN ] ALTG: Loaded 22719 existing records. [2025-10-30T17:09:58.442411] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:09:58.442600] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-30T17:09:58.442670] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-30T17:09:58.442928] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-30T17:09:58.442967] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-30T17:09:58.825179] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:09:58.863515] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-30T17:09:58.897461] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-30T17:09:59.576307] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T17:09:59.697505] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-30T17:10:00.416105] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T17:10:00.497467] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-30T17:10:01.297473] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-30T17:10:01.391255] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-30T17:10:02.097521] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-30T17:10:02.269750] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-30T17:10:02.678075] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:10:02.897499] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-30T17:10:03.697533] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-30T17:10:04.290354] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T17:10:04.438861] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-30T17:10:04.497492] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-30T17:10:05.297508] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-30T17:10:05.445874] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-30T17:10:05.566044] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T17:10:06.097494] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-30T17:10:06.404277] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T17:10:06.897508] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-30T17:10:07.697508] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-30T17:10:07.825726] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-30T17:10:08.073796] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:10:08.486124] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T17:10:08.497471] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-30T17:10:09.300361] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-30T17:10:09.301452] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-30T17:10:10.097491] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-30T17:10:10.309473] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T17:10:10.897489] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-30T17:10:11.697543] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-30T17:10:12.235505] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:10:12.497606] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-30T17:10:12.702475] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T17:10:13.297508] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-30T17:10:13.948035] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T17:10:14.097487] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-30T17:10:14.389768] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (4.29 seconds). [2025-10-30T17:10:14.399077] [INFO ] [REMOTE ] ALLE: Full fetch complete (64835 records). [2025-10-30T17:10:14.399203] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-30T17:10:14.800498] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-30T17:10:14.800590] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-30T17:10:14.801284] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-30T17:10:14.801535] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-30T17:10:14.802898] [DEBUG] [LOCAL ] ALLE: Trimmed 64835 records to 43964 (keeping 200 days of data) [2025-10-30T17:10:14.899115] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-30T17:10:15.088093] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-30T17:10:15.104518] [DEBUG] [LOCAL ] ALLE: Primary data saved (43964 records). [2025-10-30T17:10:15.104669] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-30T17:10:15.104767] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 35.9s. Estimated remaining: 4h 27m 28s. Rate: 8.5 symbols/min [2025-10-30T17:10:15.268958] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:10:15.278235] [DEBUG] [LOCAL ] ALUR: Loaded 9094 existing records from primary storage. [2025-10-30T17:10:15.278434] [INFO ] [MAIN ] ALUR: Loaded 9094 existing records. [2025-10-30T17:10:15.449710] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:10:15.449909] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-30T17:10:15.449956] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-30T17:10:15.450125] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-30T17:10:15.450162] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-30T17:10:15.712382] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-30T17:10:15.800998] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:10:16.057128] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-30T17:10:16.198117] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T17:10:16.497472] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-30T17:10:16.607231] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T17:10:17.297530] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-30T17:10:17.790547] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T17:10:18.097515] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-30T17:10:18.899497] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-30T17:10:18.910043] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T17:10:18.926544] [INFO ] [REMOTE ] ALSN: Full fetch complete (62916 records). [2025-10-30T17:10:18.926774] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-30T17:10:19.464779] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-30T17:10:19.464894] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-30T17:10:19.465621] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-30T17:10:19.465709] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-30T17:10:19.467152] [DEBUG] [LOCAL ] ALSN: Trimmed 62916 records to 43366 (keeping 200 days of data) [2025-10-30T17:10:19.627069] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T17:10:19.700470] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-30T17:10:19.807004] [DEBUG] [LOCAL ] ALSN: Primary data saved (43366 records). [2025-10-30T17:10:19.807145] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-30T17:10:19.807259] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALSN took 31.3s. Estimated remaining: 4h 26m 20s. Rate: 8.6 symbols/min [2025-10-30T17:10:19.968888] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-30T17:10:20.043300] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:10:20.043399] [INFO ] [REMOTE ] ALLY: Full fetch complete (77236 records). [2025-10-30T17:10:20.043859] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-30T17:10:20.383822] [DEBUG] [LOCAL ] ALV: Loaded 42004 existing records from primary storage. [2025-10-30T17:10:20.386583] [INFO ] [MAIN ] ALV: Loaded 42004 existing records. [2025-10-30T17:10:20.513702] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-30T17:10:20.590256] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-30T17:10:20.590489] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-30T17:10:20.591324] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-30T17:10:20.591723] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-30T17:10:20.649526] [DEBUG] [LOCAL ] ALLY: Trimmed 77236 records to 53578 (keeping 200 days of data) [2025-10-30T17:10:20.670101] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:10:20.670500] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-30T17:10:20.670760] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-30T17:10:20.671282] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-30T17:10:20.671357] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-30T17:10:21.243739] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-30T17:10:21.298760] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-30T17:10:21.344406] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:10:21.418735] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T17:10:21.447861] [DEBUG] [LOCAL ] ALLY: Primary data saved (53578 records). [2025-10-30T17:10:21.447987] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-30T17:10:21.448063] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALLY took 36.9s. Estimated remaining: 4h 23m 56s. Rate: 8.6 symbols/min [2025-10-30T17:10:21.614556] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:10:21.623891] [DEBUG] [LOCAL ] ALX: Loaded 7638 existing records from primary storage. [2025-10-30T17:10:21.624091] [INFO ] [MAIN ] ALX: Loaded 7638 existing records. [2025-10-30T17:10:21.802100] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:10:21.802364] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-30T17:10:21.802421] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-30T17:10:21.802593] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-30T17:10:21.802632] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-30T17:10:22.098454] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-30T17:10:22.196267] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T17:10:22.219590] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:10:22.881272] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T17:10:22.897446] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-30T17:10:23.697504] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-30T17:10:23.967172] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T17:10:23.972185] [INFO ] [REMOTE ] ALTG: Full fetch complete (33296 records). [2025-10-30T17:10:23.972299] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-30T17:10:24.375621] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-30T17:10:24.375766] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-30T17:10:24.376182] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-30T17:10:24.376236] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-30T17:10:24.377409] [DEBUG] [LOCAL ] ALTG: Trimmed 33296 records to 22843 (keeping 200 days of data) [2025-10-30T17:10:24.501150] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-30T17:10:24.506380] [DEBUG] [LOCAL ] ALTG: Primary data saved (22843 records). [2025-10-30T17:10:24.506543] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-30T17:10:24.506633] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALTG took 26.4s. Estimated remaining: 4h 22m 10s. Rate: 8.7 symbols/min [2025-10-30T17:10:24.677945] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:10:24.724504] [DEBUG] [LOCAL ] AM: Loaded 51745 existing records from primary storage. [2025-10-30T17:10:24.724846] [INFO ] [MAIN ] AM: Loaded 51745 existing records. [2025-10-30T17:10:24.900276] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:10:24.900576] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-30T17:10:24.900808] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-30T17:10:24.901320] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-30T17:10:24.901420] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-30T17:10:25.139561] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T17:10:25.291820] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:10:25.297451] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-30T17:10:25.521272] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T17:10:26.097517] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-30T17:10:26.786085] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-30T17:10:26.897481] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-30T17:10:27.297381] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T17:10:27.697490] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-30T17:10:28.313734] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T17:10:28.467300] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-30T17:10:28.497450] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-30T17:10:29.297517] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-30T17:10:29.938889] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-30T17:10:30.077606] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T17:10:30.097466] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-30T17:10:30.897517] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-30T17:10:31.450829] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T17:10:31.697499] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-30T17:10:32.200258] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T17:10:32.497512] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-30T17:10:33.154749] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T17:10:33.297492] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-30T17:10:33.375268] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T17:10:34.097524] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-30T17:10:34.626463] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T17:10:34.897555] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-30T17:10:35.697546] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-30T17:10:36.097100] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-30T17:10:36.195622] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-30T17:10:36.452498] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-30T17:10:36.497458] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-30T17:10:37.297499] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-30T17:10:37.760117] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T17:10:38.097496] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-30T17:10:38.547201] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T17:10:38.863509] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T17:10:38.897461] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-30T17:10:39.454741] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-30T17:10:39.697500] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-30T17:10:40.497500] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-30T17:10:41.012378] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-30T17:10:41.159300] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T17:10:41.297531] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-30T17:10:41.969819] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T17:10:42.097505] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-30T17:10:42.785824] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-30T17:10:42.787977] [INFO ] [REMOTE ] ALUR: Full fetch complete (17966 records). [2025-10-30T17:10:42.788045] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-30T17:10:42.902593] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-30T17:10:43.152707] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-30T17:10:43.152786] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-30T17:10:43.153064] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-30T17:10:43.153104] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-30T17:10:43.153592] [DEBUG] [LOCAL ] ALUR: Trimmed 17966 records to 9125 (keeping 200 days of data) [2025-10-30T17:10:43.207207] [DEBUG] [LOCAL ] ALUR: Primary data saved (9125 records). [2025-10-30T17:10:43.207438] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-30T17:10:43.207540] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALUR took 28.1s. Estimated remaining: 4h 26m 58s. Rate: 8.5 symbols/min [2025-10-30T17:10:43.377094] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:10:43.409446] [DEBUG] [LOCAL ] AMBC: Loaded 35354 existing records from primary storage. [2025-10-30T17:10:43.409724] [INFO ] [MAIN ] AMBC: Loaded 35354 existing records. [2025-10-30T17:10:43.584133] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:10:43.584359] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-30T17:10:43.584407] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-30T17:10:43.584841] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-30T17:10:43.584898] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-30T17:10:43.702613] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-30T17:10:43.946940] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:10:44.241028] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T17:10:44.507046] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-30T17:10:44.526139] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-30T17:10:44.537590] [INFO ] [REMOTE ] AM: Full fetch complete (75619 records). [2025-10-30T17:10:44.537729] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-30T17:10:44.919678] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-30T17:10:44.919766] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-30T17:10:44.920470] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-30T17:10:44.920510] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-30T17:10:44.921840] [DEBUG] [LOCAL ] AM: Trimmed 75619 records to 52129 (keeping 200 days of data) [2025-10-30T17:10:45.012975] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-30T17:10:45.235136] [DEBUG] [LOCAL ] AM: Primary data saved (52129 records). [2025-10-30T17:10:45.235261] [INFO ] [MAIN ] AM: Full history saved. [2025-10-30T17:10:45.236534] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. AM took 20.7s. Estimated remaining: 4h 24m 47s. Rate: 8.6 symbols/min [2025-10-30T17:10:45.302608] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-30T17:10:45.443557] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:10:45.482301] [DEBUG] [LOCAL ] AMBP: Loaded 44353 existing records from primary storage. [2025-10-30T17:10:45.482577] [INFO ] [MAIN ] AMBP: Loaded 44353 existing records. [2025-10-30T17:10:45.655060] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:10:45.655274] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-30T17:10:45.655322] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-30T17:10:45.655591] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-30T17:10:45.655629] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-30T17:10:46.005345] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:10:46.097488] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-30T17:10:46.730714] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T17:10:46.897554] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-30T17:10:47.558377] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T17:10:47.697462] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-30T17:10:47.820703] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:10:48.497547] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-30T17:10:48.755040] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T17:10:49.297472] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-30T17:10:49.328930] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T17:10:50.097490] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-30T17:10:50.460262] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T17:10:50.897519] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-30T17:10:51.391694] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T17:10:51.393698] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T17:10:51.697516] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-30T17:10:52.497495] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-30T17:10:52.960514] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-30T17:10:53.297466] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-30T17:10:53.635849] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T17:10:54.097506] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-30T17:10:54.267740] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T17:10:54.897508] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-30T17:10:55.148615] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T17:10:55.353800] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-30T17:10:55.697533] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-30T17:10:56.176723] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-30T17:10:56.497504] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-30T17:10:56.959890] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T17:10:57.297516] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-30T17:10:58.097497] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-30T17:10:58.496279] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T17:10:58.897511] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-30T17:10:59.220074] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T17:10:59.697489] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-30T17:11:00.057093] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T17:11:00.497497] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-30T17:11:00.747042] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T17:11:01.297518] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-30T17:11:01.994050] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T17:11:02.097501] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-30T17:11:02.365445] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-30T17:11:02.897500] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-30T17:11:03.398456] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T17:11:03.697494] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-30T17:11:03.976571] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T17:11:04.497494] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-30T17:11:05.017853] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-30T17:11:05.027768] [INFO ] [REMOTE ] ALV: Full fetch complete (62381 records). [2025-10-30T17:11:05.027894] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-30T17:11:05.260490] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T17:11:05.306962] [INFO ] [REMOTE ] ALX: Full fetch complete (8537 records). [2025-10-30T17:11:05.306680] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-30T17:11:05.322574] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-30T17:11:05.624887] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-30T17:11:05.633361] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-30T17:11:05.634134] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-30T17:11:05.634821] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-30T17:11:05.749628] [DEBUG] [LOCAL ] ALV: Trimmed 62381 records to 42323 (keeping 200 days of data) [2025-10-30T17:11:05.954027] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-30T17:11:05.969924] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-30T17:11:05.970971] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-30T17:11:05.973802] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-30T17:11:05.992943] [DEBUG] [LOCAL ] ALX: Trimmed 8537 records to 7671 (keeping 200 days of data) [2025-10-30T17:11:06.112455] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-30T17:11:06.178813] [DEBUG] [LOCAL ] ALX: Primary data saved (7671 records). [2025-10-30T17:11:06.195802] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-30T17:11:06.200030] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. ALX took 44.8s. Estimated remaining: 4h 30m 22s. Rate: 8.4 symbols/min [2025-10-30T17:11:06.295694] [DEBUG] [LOCAL ] ALV: Primary data saved (42323 records). [2025-10-30T17:11:06.301462] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-30T17:11:06.331262] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. ALV took 46.5s. Estimated remaining: 4h 27m 25s. Rate: 8.5 symbols/min [2025-10-30T17:11:06.569878] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T17:11:06.725102] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:06.741752] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-30T17:11:06.752241] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-30T17:11:06.768061] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-30T17:11:06.793637] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-30T17:11:06.827930] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:06.828159] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-30T17:11:06.828407] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-30T17:11:06.904505] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-30T17:11:07.198019] [DEBUG] [LOCAL ] AMC: Loaded 53768 existing records from primary storage. [2025-10-30T17:11:07.209843] [INFO ] [MAIN ] AMC: Loaded 53768 existing records. [2025-10-30T17:11:07.392909] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:07.499314] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:11:07.501389] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T17:11:07.501569] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-30T17:11:07.510637] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-30T17:11:07.511563] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-30T17:11:07.511623] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-30T17:11:07.706835] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-30T17:11:07.865540] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:07.885402] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T17:11:08.497494] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-30T17:11:08.828678] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T17:11:09.297510] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-30T17:11:10.097495] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-30T17:11:10.517350] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-30T17:11:10.526890] [INFO ] [REMOTE ] AMBP: Full fetch complete (64920 records). [2025-10-30T17:11:10.527103] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-30T17:11:10.712076] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-30T17:11:10.906273] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-30T17:11:10.961339] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-30T17:11:10.961435] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-30T17:11:10.962157] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-30T17:11:10.962223] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-30T17:11:10.963480] [DEBUG] [LOCAL ] AMBP: Trimmed 64920 records to 44694 (keeping 200 days of data) [2025-10-30T17:11:11.185999] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:11:11.187456] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-30T17:11:11.188515] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:11:11.189163] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-30T17:11:11.189551] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:11:11.189932] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-30T17:11:11.190305] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-30T17:11:11.190670] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-30T17:11:11.191245] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-30T17:11:11.191607] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AMBQ took 5.0s. Estimated remaining: 4h 26m 26s. Rate: 8.5 symbols/min [2025-10-30T17:11:11.356265] [DEBUG] [LOCAL ] AMBP: Primary data saved (44694 records). [2025-10-30T17:11:11.399303] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-30T17:11:11.416676] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AMBP took 26.2s. Estimated remaining: 4h 23m 38s. Rate: 8.6 symbols/min [2025-10-30T17:11:11.404054] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:11.493088] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T17:11:11.552316] [INFO ] [REMOTE ] AMBC: Full fetch complete (51796 records). [2025-10-30T17:11:11.557870] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-30T17:11:11.666791] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:11.700854] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-30T17:11:11.855293] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-30T17:11:11.928307] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-30T17:11:12.106470] [DEBUG] [LOCAL ] AME: Loaded 48315 existing records from primary storage. [2025-10-30T17:11:12.125186] [INFO ] [MAIN ] AME: Loaded 48315 existing records. [2025-10-30T17:11:12.374482] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-30T17:11:12.401790] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-30T17:11:12.418728] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-30T17:11:12.414067] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:11:12.418993] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-30T17:11:12.419202] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-30T17:11:12.419998] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-30T17:11:12.440925] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-30T17:11:12.470697] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-30T17:11:12.509316] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:11:12.500745] [DEBUG] [LOCAL ] AMBC: Trimmed 51796 records to 35563 (keeping 200 days of data) [2025-10-30T17:11:12.537406] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-30T17:11:12.597130] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-30T17:11:12.678201] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-30T17:11:12.686000] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-30T17:11:13.358207] [DEBUG] [LOCAL ] AMBC: Primary data saved (35563 records). [2025-10-30T17:11:13.353249] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:13.359329] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-30T17:11:13.365488] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-30T17:11:13.388043] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AMBC took 30.2s. Estimated remaining: 4h 21m 34s. Rate: 8.7 symbols/min [2025-10-30T17:11:13.496728] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:13.520039] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-30T17:11:13.633887] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:13.653608] [DEBUG] [LOCAL ] AMG: Loaded 19594 existing records from primary storage. [2025-10-30T17:11:13.653876] [INFO ] [MAIN ] AMG: Loaded 19594 existing records. [2025-10-30T17:11:13.826269] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-30T17:11:13.869947] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:11:13.870098] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-30T17:11:13.870164] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-30T17:11:13.870518] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-30T17:11:13.870585] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-30T17:11:14.112840] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-30T17:11:14.228457] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:14.764953] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T17:11:14.897513] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-30T17:11:14.937136] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T17:11:15.697561] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-30T17:11:15.984393] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-30T17:11:16.140036] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T17:11:16.497559] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-30T17:11:16.566087] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-30T17:11:17.297569] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-30T17:11:17.929696] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T17:11:18.097557] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-30T17:11:18.548036] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-30T17:11:18.903988] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-30T17:11:18.905123] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T17:11:19.697589] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-30T17:11:20.266220] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:11:20.497551] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-30T17:11:21.297508] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-30T17:11:21.333888] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-30T17:11:21.537119] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-30T17:11:22.097505] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-30T17:11:22.576576] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T17:11:22.838876] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-30T17:11:22.897466] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-30T17:11:23.547858] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-30T17:11:23.697488] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-30T17:11:24.497501] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-30T17:11:25.297486] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-30T17:11:25.424129] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-30T17:11:26.005360] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-30T17:11:26.097449] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-30T17:11:26.751151] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-30T17:11:26.897512] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-30T17:11:27.475008] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T17:11:27.697603] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-30T17:11:28.155054] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T17:11:28.497564] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-30T17:11:28.937063] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T17:11:29.297540] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-30T17:11:29.867263] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T17:11:30.097485] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-30T17:11:30.897497] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-30T17:11:31.073536] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-30T17:11:31.373931] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:11:31.697503] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-30T17:11:31.901738] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T17:11:32.497544] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-30T17:11:33.290171] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T17:11:33.297468] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-30T17:11:33.589408] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-30T17:11:34.097501] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-30T17:11:34.539441] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-30T17:11:34.897535] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-30T17:11:35.509477] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T17:11:35.697490] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-30T17:11:36.497506] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-30T17:11:36.822334] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-30T17:11:37.295685] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T17:11:37.300231] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-30T17:11:37.680016] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-30T17:11:38.097527] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-30T17:11:38.690095] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T17:11:38.897506] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-30T17:11:39.697507] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-30T17:11:39.999201] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-30T17:11:40.010868] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-30T17:11:40.011011] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-30T17:11:40.404991] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-30T17:11:40.405289] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-30T17:11:40.406053] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-30T17:11:40.406117] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-30T17:11:40.407618] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 54060 (keeping 200 days of data) [2025-10-30T17:11:40.497486] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-30T17:11:40.675226] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-30T17:11:40.777893] [DEBUG] [LOCAL ] AMCR: Primary data saved (54060 records). [2025-10-30T17:11:40.778018] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-30T17:11:40.778105] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AMCR took 29.6s. Estimated remaining: 4h 29m 21s. Rate: 8.4 symbols/min [2025-10-30T17:11:40.946856] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:40.979185] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T17:11:41.026752] [DEBUG] [LOCAL ] AMH: Loaded 51790 existing records from primary storage. [2025-10-30T17:11:41.027054] [INFO ] [MAIN ] AMH: Loaded 51790 existing records. [2025-10-30T17:11:41.201610] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:11:41.201870] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-30T17:11:41.202002] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-30T17:11:41.202722] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-30T17:11:41.207908] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-30T17:11:41.282314] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-30T17:11:41.299037] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-30T17:11:41.325594] [INFO ] [REMOTE ] AMG: Full fetch complete (29356 records). [2025-10-30T17:11:41.336582] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-30T17:11:41.903964] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:41.988013] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-30T17:11:41.988089] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-30T17:11:41.988481] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-30T17:11:41.988545] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-30T17:11:41.989481] [DEBUG] [LOCAL ] AMG: Trimmed 29356 records to 19719 (keeping 200 days of data) [2025-10-30T17:11:42.108583] [DEBUG] [LOCAL ] AMG: Primary data saved (19719 records). [2025-10-30T17:11:42.106868] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-30T17:11:42.108757] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-30T17:11:42.108864] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMG took 28.7s. Estimated remaining: 4h 27m 1s. Rate: 8.5 symbols/min [2025-10-30T17:11:42.279541] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:42.315283] [DEBUG] [LOCAL ] AMN: Loaded 41436 existing records from primary storage. [2025-10-30T17:11:42.315546] [INFO ] [MAIN ] AMN: Loaded 41436 existing records. [2025-10-30T17:11:42.488580] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:11:42.488797] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-30T17:11:42.488852] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-30T17:11:42.489108] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-30T17:11:42.489163] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-30T17:11:42.859762] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:42.890461] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T17:11:42.900483] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-30T17:11:42.902385] [INFO ] [REMOTE ] AME: Full fetch complete (70397 records). [2025-10-30T17:11:42.902570] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-30T17:11:43.294371] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-30T17:11:43.294453] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-30T17:11:43.295145] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-30T17:11:43.295209] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-30T17:11:43.296631] [DEBUG] [LOCAL ] AME: Trimmed 70397 records to 48692 (keeping 200 days of data) [2025-10-30T17:11:43.597378] [DEBUG] [LOCAL ] AME: Primary data saved (48692 records). [2025-10-30T17:11:43.597518] [INFO ] [MAIN ] AME: Full history saved. [2025-10-30T17:11:43.597704] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AME took 32.2s. Estimated remaining: 4h 24m 47s. Rate: 8.6 symbols/min [2025-10-30T17:11:43.699026] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-30T17:11:43.772444] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:43.772669] [DEBUG] [LOCAL ] AMP: No existing data file found in primary storage. [2025-10-30T17:11:43.772785] [WARN ] [MAIN ] AMP: No existing data found, performing full refresh instead. [2025-10-30T17:11:43.772984] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-30T17:11:43.773045] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-30T17:11:43.798438] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-10-30T17:11:43.799137] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-30T17:11:43.800129] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-30T17:11:44.177313] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T17:11:44.206092] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:44.497491] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-30T17:11:45.297495] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-30T17:11:45.489540] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T17:11:45.969156] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-30T17:11:45.981052] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-30T17:11:45.981187] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-30T17:11:46.102585] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-30T17:11:46.397050] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-30T17:11:46.397137] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-30T17:11:46.397918] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-30T17:11:46.397981] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-30T17:11:46.399442] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54158 (keeping 200 days of data) [2025-10-30T17:11:46.714504] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-30T17:11:46.735545] [DEBUG] [LOCAL ] AMC: Primary data saved (54158 records). [2025-10-30T17:11:46.735707] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-30T17:11:46.735809] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AMC took 40.4s. Estimated remaining: 4h 23m 13s. Rate: 8.6 symbols/min [2025-10-30T17:11:46.913792] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:11:46.910241] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-30T17:11:46.962207] [DEBUG] [LOCAL ] AMPX: Loaded 52563 existing records from primary storage. [2025-10-30T17:11:46.962489] [INFO ] [MAIN ] AMPX: Loaded 52563 existing records. [2025-10-30T17:11:47.162492] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:11:47.162790] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-30T17:11:47.162849] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-30T17:11:47.163372] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-30T17:11:47.163546] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-30T17:11:47.375721] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T17:11:47.566107] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:11:47.697481] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-30T17:11:48.098572] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T17:11:48.497554] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-30T17:11:49.297468] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-30T17:11:49.413607] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-30T17:11:49.692046] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T17:11:50.097506] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-30T17:11:50.439497] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T17:11:50.897503] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-30T17:11:51.267198] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T17:11:51.697518] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-30T17:11:52.140185] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T17:11:52.497520] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-30T17:11:53.060806] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:11:53.297493] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-30T17:11:53.488406] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T17:11:54.097490] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-30T17:11:54.434521] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T17:11:54.897482] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-30T17:11:55.124607] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T17:11:55.697540] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-30T17:11:56.364309] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-30T17:11:56.497525] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-30T17:11:56.578444] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T17:11:57.297504] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-30T17:11:57.792567] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T17:11:58.097517] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-30T17:11:58.482173] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:11:58.897525] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-30T17:11:59.588948] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T17:11:59.697502] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-30T17:12:00.179634] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T17:12:00.497556] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-30T17:12:01.130570] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T17:12:01.297520] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-30T17:12:01.968233] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T17:12:02.097519] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-30T17:12:02.415678] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:12:02.897493] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-30T17:12:03.697499] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-30T17:12:03.869252] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T17:12:03.961439] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-30T17:12:04.497497] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-30T17:12:04.813350] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:12:05.297501] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-30T17:12:05.953724] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T17:12:06.097473] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-30T17:12:06.626540] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T17:12:06.897502] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-30T17:12:07.697510] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-30T17:12:07.942210] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T17:12:08.026798] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-30T17:12:08.497497] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-30T17:12:09.297565] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-30T17:12:10.097555] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-30T17:12:10.278297] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T17:12:10.285345] [INFO ] [REMOTE ] AMP: Full fetch complete (47583 records). [2025-10-30T17:12:10.285437] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-30T17:12:10.620194] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-10-30T17:12:10.720386] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-30T17:12:10.720475] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-30T17:12:10.721017] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-30T17:12:10.721078] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-30T17:12:10.722122] [DEBUG] [LOCAL ] AMP: Trimmed 47583 records to 31551 (keeping 200 days of data) [2025-10-30T17:12:10.900700] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-30T17:12:10.922970] [DEBUG] [LOCAL ] AMP: Primary data saved (31551 records). [2025-10-30T17:12:10.923178] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-30T17:12:10.923268] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMP took 27.3s. Estimated remaining: 4h 29m 29s. Rate: 8.4 symbols/min [2025-10-30T17:12:11.108414] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:11.108782] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-10-30T17:12:11.108873] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-10-30T17:12:11.109085] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-30T17:12:11.109231] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-30T17:12:11.109322] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-30T17:12:11.109396] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-30T17:12:11.417045] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-30T17:12:11.518630] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:11.697484] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-30T17:12:12.391429] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T17:12:12.468606] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-30T17:12:12.480237] [INFO ] [REMOTE ] AMH: Full fetch complete (75156 records). [2025-10-30T17:12:12.480368] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-30T17:12:12.502579] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-30T17:12:12.869922] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-30T17:12:12.870017] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-30T17:12:12.870805] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-30T17:12:12.870867] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-30T17:12:12.872241] [DEBUG] [LOCAL ] AMH: Trimmed 75156 records to 52180 (keeping 200 days of data) [2025-10-30T17:12:13.181217] [DEBUG] [LOCAL ] AMH: Primary data saved (52180 records). [2025-10-30T17:12:13.181348] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-30T17:12:13.181430] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMH took 32.4s. Estimated remaining: 4h 27m 34s. Rate: 8.5 symbols/min [2025-10-30T17:12:13.302684] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-30T17:12:13.362226] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:13.362581] [DEBUG] [LOCAL ] AMR: No existing data file found in primary storage. [2025-10-30T17:12:13.362709] [WARN ] [MAIN ] AMR: No existing data found, performing full refresh instead. [2025-10-30T17:12:13.362886] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-30T17:12:13.362933] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-30T17:12:13.362976] [DEBUG] [LOCAL ] AMR: No primary data file found to delete. [2025-10-30T17:12:13.363008] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-30T17:12:13.674693] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T17:12:13.786742] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:13.850427] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-30T17:12:13.861955] [INFO ] [REMOTE ] AMPX: Full fetch complete (75320 records). [2025-10-30T17:12:13.862081] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-30T17:12:14.107013] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-30T17:12:14.258882] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-30T17:12:14.258960] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-30T17:12:14.259696] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-30T17:12:14.259767] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-30T17:12:14.261136] [DEBUG] [LOCAL ] AMPX: Trimmed 75320 records to 52953 (keeping 200 days of data) [2025-10-30T17:12:14.496012] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T17:12:14.593619] [DEBUG] [LOCAL ] AMPX: Primary data saved (52953 records). [2025-10-30T17:12:14.593773] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-30T17:12:14.594455] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMPX took 27.9s. Estimated remaining: 4h 25m 23s. Rate: 8.5 symbols/min [2025-10-30T17:12:14.759236] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:14.795561] [DEBUG] [LOCAL ] AMRC: Loaded 38154 existing records from primary storage. [2025-10-30T17:12:14.795834] [INFO ] [MAIN ] AMRC: Loaded 38154 existing records. [2025-10-30T17:12:14.901109] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-30T17:12:14.985794] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:12:14.986068] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-30T17:12:14.986216] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-30T17:12:14.992049] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-30T17:12:14.999483] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-30T17:12:15.046332] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T17:12:15.375705] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:15.697517] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-30T17:12:16.255282] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T17:12:16.502573] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-30T17:12:16.512936] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T17:12:17.297515] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-30T17:12:17.714370] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T17:12:17.722985] [INFO ] [REMOTE ] AMN: Full fetch complete (59909 records). [2025-10-30T17:12:17.723113] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-30T17:12:17.723803] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:12:17.723884] [FATAL] [MAIN ] AMN: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:12:17.723926] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:12:17.723996] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-30T17:12:17.724058] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-30T17:12:17.724092] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-10-30T17:12:17.724277] [DEBUG] [LOCAL ] AMN: Deleted derivative data file. [2025-10-30T17:12:17.724365] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMN took 35.6s. Estimated remaining: 4h 23m 52s. Rate: 8.6 symbols/min [2025-10-30T17:12:17.907416] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:17.907625] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-30T17:12:17.907721] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-30T17:12:17.907861] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-30T17:12:17.907932] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-30T17:12:17.907999] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-30T17:12:17.908050] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-30T17:12:18.102609] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-30T17:12:18.287784] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:18.309250] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T17:12:18.897471] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-30T17:12:19.022039] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T17:12:19.697534] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-30T17:12:19.837683] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:12:19.838016] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-30T17:12:19.838127] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:12:19.838217] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-30T17:12:19.838304] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:12:19.838394] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-30T17:12:19.838498] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-30T17:12:19.838543] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-30T17:12:19.838586] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-30T17:12:19.838637] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 2.1s. Estimated remaining: 4h 22m 1s. Rate: 8.6 symbols/min [2025-10-30T17:12:20.023628] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:20.058388] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T17:12:20.110049] [DEBUG] [LOCAL ] AMT: Loaded 52411 existing records from primary storage. [2025-10-30T17:12:20.110356] [INFO ] [MAIN ] AMT: Loaded 52411 existing records. [2025-10-30T17:12:20.292868] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:12:20.293054] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-30T17:12:20.293101] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-30T17:12:20.293411] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-30T17:12:20.293466] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-30T17:12:20.502739] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-30T17:12:20.646707] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:21.297478] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-30T17:12:21.428955] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T17:12:22.097502] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-30T17:12:22.220694] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T17:12:22.897477] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-30T17:12:23.018140] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:12:23.697482] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-30T17:12:23.844896] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T17:12:24.497516] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-30T17:12:25.294876] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-30T17:12:25.299353] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-30T17:12:25.565242] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T17:12:26.097474] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-30T17:12:26.157275] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T17:12:26.897461] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-30T17:12:27.110134] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T17:12:27.697710] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-30T17:12:28.051321] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T17:12:28.497520] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-30T17:12:28.801787] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T17:12:29.297538] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-30T17:12:29.720851] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T17:12:30.097480] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-30T17:12:30.199340] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T17:12:30.897488] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-30T17:12:31.323120] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T17:12:31.697720] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-30T17:12:31.842600] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T17:12:32.490841] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-30T17:12:32.497444] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-30T17:12:33.297462] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-30T17:12:33.447362] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-30T17:12:34.097486] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-30T17:12:34.744898] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T17:12:34.897513] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-30T17:12:35.432840] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T17:12:35.442979] [INFO ] [REMOTE ] AMPY: Full fetch complete (53996 records). [2025-10-30T17:12:35.443100] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-30T17:12:35.703925] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-30T17:12:35.824193] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-30T17:12:35.824279] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-30T17:12:35.824906] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-30T17:12:35.824969] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-30T17:12:35.826115] [DEBUG] [LOCAL ] AMPY: Trimmed 53996 records to 39678 (keeping 200 days of data) [2025-10-30T17:12:36.041248] [DEBUG] [LOCAL ] AMPY: Primary data saved (39678 records). [2025-10-30T17:12:36.041372] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-30T17:12:36.041439] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMPY took 25.1s. Estimated remaining: 4h 25m 9s. Rate: 8.5 symbols/min [2025-10-30T17:12:36.206569] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:36.224679] [DEBUG] [LOCAL ] AMTB: Loaded 20547 existing records from primary storage. [2025-10-30T17:12:36.225502] [INFO ] [MAIN ] AMTB: Loaded 20547 existing records. [2025-10-30T17:12:36.401675] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:12:36.401900] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-30T17:12:36.401947] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-30T17:12:36.402171] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-30T17:12:36.402209] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-30T17:12:36.499619] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-30T17:12:36.753746] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:36.785500] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-30T17:12:36.999201] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T17:12:37.297557] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-30T17:12:37.640869] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T17:12:38.047521] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-30T17:12:38.097507] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-30T17:12:38.693487] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-30T17:12:38.897510] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-30T17:12:39.697473] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-30T17:12:39.760828] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T17:12:40.497495] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-30T17:12:40.924731] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T17:12:41.297506] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-30T17:12:41.459726] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T17:12:42.097521] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-30T17:12:42.279064] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T17:12:42.897472] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-30T17:12:42.945895] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T17:12:43.697499] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-30T17:12:43.909390] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T17:12:43.915701] [INFO ] [REMOTE ] AMR: Full fetch complete (40411 records). [2025-10-30T17:12:43.915856] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-30T17:12:44.285358] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-30T17:12:44.285457] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-30T17:12:44.285931] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-30T17:12:44.285993] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-30T17:12:44.286887] [DEBUG] [LOCAL ] AMR: Trimmed 40411 records to 28476 (keeping 200 days of data) [2025-10-30T17:12:44.454758] [DEBUG] [LOCAL ] AMR: Primary data saved (28476 records). [2025-10-30T17:12:44.454871] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-30T17:12:44.454937] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMR took 31.3s. Estimated remaining: 4h 25m 31s. Rate: 8.5 symbols/min [2025-10-30T17:12:44.497836] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-30T17:12:44.600582] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-30T17:12:44.651206] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:44.656612] [DEBUG] [LOCAL ] AMTD: Loaded 3811 existing records from primary storage. [2025-10-30T17:12:44.656838] [INFO ] [MAIN ] AMTD: Loaded 3811 existing records. [2025-10-30T17:12:44.851522] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:12:44.851739] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-30T17:12:44.851791] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-30T17:12:44.851914] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-30T17:12:44.851951] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-30T17:12:45.209131] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:45.297487] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-30T17:12:45.772296] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T17:12:45.936057] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-30T17:12:46.097489] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-30T17:12:46.897568] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-30T17:12:47.526892] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T17:12:47.697477] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-30T17:12:47.744690] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T17:12:48.497509] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-30T17:12:48.886600] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T17:12:49.297495] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-30T17:12:49.693832] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T17:12:49.713104] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T17:12:50.097501] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-30T17:12:50.897503] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-30T17:12:51.470120] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T17:12:51.697465] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-30T17:12:51.768627] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T17:12:52.397229] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T17:12:52.497494] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-30T17:12:53.297508] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-30T17:12:53.373593] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-30T17:12:53.580273] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-30T17:12:54.097506] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-30T17:12:54.897499] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-30T17:12:55.536252] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T17:12:55.548972] [INFO ] [REMOTE ] AMRC: Full fetch complete (54725 records). [2025-10-30T17:12:55.549103] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-30T17:12:55.702689] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-30T17:12:55.949372] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-30T17:12:55.949463] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-30T17:12:55.950165] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-30T17:12:55.950233] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-30T17:12:55.951524] [DEBUG] [LOCAL ] AMRC: Trimmed 54725 records to 38408 (keeping 200 days of data) [2025-10-30T17:12:56.168446] [DEBUG] [LOCAL ] AMRC: Primary data saved (38408 records). [2025-10-30T17:12:56.168588] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-30T17:12:56.169320] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMRC took 41.6s. Estimated remaining: 4h 27m 0s. Rate: 8.5 symbols/min [2025-10-30T17:12:56.341113] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:56.385507] [DEBUG] [LOCAL ] AMTM: Loaded 50043 existing records from primary storage. [2025-10-30T17:12:56.385876] [INFO ] [MAIN ] AMTM: Loaded 50043 existing records. [2025-10-30T17:12:56.513036] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-30T17:12:56.575868] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:12:56.576499] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-30T17:12:56.576692] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-30T17:12:56.582238] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-30T17:12:56.593262] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-30T17:12:56.599680] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T17:12:56.936540] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-30T17:12:56.984669] [INFO ] [REMOTE ] AMT: Full fetch complete (76165 records). [2025-10-30T17:12:56.984508] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T17:12:57.024949] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:57.019427] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-30T17:12:57.302622] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-30T17:12:57.434794] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-30T17:12:57.434867] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-30T17:12:57.435573] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-30T17:12:57.435613] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-30T17:12:57.437073] [DEBUG] [LOCAL ] AMT: Trimmed 76165 records to 52800 (keeping 200 days of data) [2025-10-30T17:12:57.754478] [DEBUG] [LOCAL ] AMT: Primary data saved (52800 records). [2025-10-30T17:12:57.754600] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-30T17:12:57.755511] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMT took 37.9s. Estimated remaining: 4h 25m 0s. Rate: 8.5 symbols/min [2025-10-30T17:12:57.924357] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:12:57.934879] [DEBUG] [LOCAL ] AMWL: Loaded 9987 existing records from primary storage. [2025-10-30T17:12:57.935091] [INFO ] [MAIN ] AMWL: Loaded 9987 existing records. [2025-10-30T17:12:58.068470] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-30T17:12:58.099776] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-30T17:12:58.129997] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:12:58.130287] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-30T17:12:58.130335] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-30T17:12:58.130503] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-30T17:12:58.130549] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-30T17:12:58.491503] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:12:58.897502] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-30T17:12:59.518324] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T17:12:59.697498] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-30T17:12:59.898485] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-30T17:12:59.903879] [INFO ] [REMOTE ] AMTB: Full fetch complete (29974 records). [2025-10-30T17:12:59.903977] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-30T17:13:00.307210] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-30T17:13:00.307284] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-30T17:13:00.307717] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-30T17:13:00.307782] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-30T17:13:00.308466] [DEBUG] [LOCAL ] AMTB: Trimmed 29974 records to 20768 (keeping 200 days of data) [2025-10-30T17:13:00.429450] [DEBUG] [LOCAL ] AMTB: Primary data saved (20768 records). [2025-10-30T17:13:00.429545] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-30T17:13:00.429620] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMTB took 24.4s. Estimated remaining: 4h 23m 24s. Rate: 8.6 symbols/min [2025-10-30T17:13:00.505548] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-30T17:13:00.605706] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:13:00.647821] [DEBUG] [LOCAL ] AMX: Loaded 49045 existing records from primary storage. [2025-10-30T17:13:00.648168] [INFO ] [MAIN ] AMX: Loaded 49045 existing records. [2025-10-30T17:13:00.822885] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:13:00.823093] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-30T17:13:00.823140] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-30T17:13:00.823565] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-30T17:13:00.823629] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-30T17:13:01.177405] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:13:01.297491] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-30T17:13:01.617985] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-30T17:13:02.097501] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-30T17:13:02.897516] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-30T17:13:02.970823] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-30T17:13:03.347365] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T17:13:03.672206] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-30T17:13:03.697459] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-30T17:13:04.346088] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (3.05 seconds). [2025-10-30T17:13:04.497499] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-30T17:13:05.297512] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-30T17:13:05.638933] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-30T17:13:05.851123] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T17:13:05.908381] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-30T17:13:06.097477] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-30T17:13:06.897499] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-30T17:13:07.254096] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T17:13:07.353197] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T17:13:07.697489] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-30T17:13:08.077888] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T17:13:08.497507] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-30T17:13:09.297482] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-30T17:13:09.652930] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T17:13:09.655195] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T17:13:10.097504] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-30T17:13:10.625718] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-30T17:13:10.627099] [INFO ] [REMOTE ] AMTD: Full fetch complete (5352 records). [2025-10-30T17:13:10.627170] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-30T17:13:10.627522] [FATAL] [VALIDATOR ] AMTD: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:13:10.627612] [FATAL] [MAIN ] AMTD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:13:10.627697] [WARN ] [MAIN ] AMTD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:13:10.627770] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-30T17:13:10.627834] [DEBUG] [LOCAL ] AMTD: No primary data file found to delete. [2025-10-30T17:13:10.627870] [INFO ] [LOCAL ] AMTD: Starting deletion of derivative data. [2025-10-30T17:13:10.628068] [DEBUG] [LOCAL ] AMTD: Deleted derivative data file. [2025-10-30T17:13:10.628246] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMTD took 26.2s. Estimated remaining: 4h 24m 21s. Rate: 8.5 symbols/min [2025-10-30T17:13:10.809810] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:13:10.838012] [DEBUG] [LOCAL ] AN: Loaded 30883 existing records from primary storage. [2025-10-30T17:13:10.838270] [INFO ] [MAIN ] AN: Loaded 30883 existing records. [2025-10-30T17:13:10.902679] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-30T17:13:11.023295] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:13:11.023524] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-30T17:13:11.023572] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-30T17:13:11.023830] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-30T17:13:11.023886] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-30T17:13:11.390707] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:13:11.697477] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-30T17:13:11.720711] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T17:13:12.497473] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-30T17:13:12.973962] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T17:13:13.050939] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-30T17:13:13.297537] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-30T17:13:14.097517] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-30T17:13:14.539571] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-30T17:13:14.541940] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T17:13:14.897499] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-30T17:13:15.697486] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-30T17:13:16.076008] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T17:13:16.497504] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-30T17:13:16.944510] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T17:13:17.053445] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T17:13:17.297504] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-30T17:13:17.775320] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-30T17:13:18.097534] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-30T17:13:18.897492] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-30T17:13:19.202940] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T17:13:19.697514] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-30T17:13:20.281551] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:13:20.497534] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-30T17:13:20.702385] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:13:21.297510] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-30T17:13:21.712457] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T17:13:22.098124] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-30T17:13:22.214599] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T17:13:22.897495] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-30T17:13:23.495747] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:13:23.697481] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-30T17:13:23.823250] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T17:13:24.472261] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T17:13:24.497504] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-30T17:13:25.297473] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-30T17:13:25.337252] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T17:13:25.775829] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-30T17:13:26.097494] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-30T17:13:26.897505] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-30T17:13:27.300722] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T17:13:27.697498] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-30T17:13:28.408247] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T17:13:28.418695] [INFO ] [REMOTE ] AMTM: Full fetch complete (73359 records). [2025-10-30T17:13:28.418815] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-30T17:13:28.502777] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-30T17:13:28.806683] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-30T17:13:28.806787] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-30T17:13:28.807494] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-30T17:13:28.807537] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-30T17:13:28.809073] [DEBUG] [LOCAL ] AMTM: Trimmed 73359 records to 50389 (keeping 200 days of data) [2025-10-30T17:13:29.091112] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T17:13:29.118499] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T17:13:29.149399] [DEBUG] [LOCAL ] AMTM: Primary data saved (50389 records). [2025-10-30T17:13:29.149500] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-30T17:13:29.150173] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMTM took 33.0s. Estimated remaining: 4h 28m 3s. Rate: 8.4 symbols/min [2025-10-30T17:13:29.301003] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-30T17:13:29.320301] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:13:29.370293] [DEBUG] [LOCAL ] ANET: Loaded 53764 existing records from primary storage. [2025-10-30T17:13:29.370585] [INFO ] [MAIN ] ANET: Loaded 53764 existing records. [2025-10-30T17:13:29.580275] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:13:29.580476] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-30T17:13:29.580524] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-30T17:13:29.580877] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-30T17:13:29.580933] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-30T17:13:29.959262] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:13:30.097460] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-30T17:13:30.141521] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T17:13:30.145316] [INFO ] [REMOTE ] AMWL: Full fetch complete (14847 records). [2025-10-30T17:13:30.145384] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-30T17:13:30.508542] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-30T17:13:30.508621] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-30T17:13:30.508928] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-30T17:13:30.508979] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-30T17:13:30.509437] [DEBUG] [LOCAL ] AMWL: Trimmed 14847 records to 10068 (keeping 200 days of data) [2025-10-30T17:13:30.563124] [DEBUG] [LOCAL ] AMWL: Primary data saved (10068 records). [2025-10-30T17:13:30.563249] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-30T17:13:30.563338] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMWL took 32.8s. Estimated remaining: 4h 26m 3s. Rate: 8.5 symbols/min [2025-10-30T17:13:30.732915] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:13:30.780475] [DEBUG] [LOCAL ] ANF: Loaded 51976 existing records from primary storage. [2025-10-30T17:13:30.780850] [INFO ] [MAIN ] ANF: Loaded 51976 existing records. [2025-10-30T17:13:30.902555] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-30T17:13:30.962662] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:13:30.962853] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-30T17:13:30.962902] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-30T17:13:30.963230] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-30T17:13:30.963288] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-30T17:13:31.318531] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:13:31.697467] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-30T17:13:31.796795] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T17:13:32.260563] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T17:13:32.497509] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-30T17:13:33.000939] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T17:13:33.297562] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-30T17:13:34.007934] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T17:13:34.097471] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-30T17:13:34.302766] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-30T17:13:34.897469] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-30T17:13:35.097251] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T17:13:35.697566] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-30T17:13:36.497931] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-30T17:13:36.627913] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-30T17:13:37.170961] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-30T17:13:37.297542] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-30T17:13:37.474964] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-30T17:13:37.481980] [INFO ] [REMOTE ] AN: Full fetch complete (47187 records). [2025-10-30T17:13:37.482098] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-30T17:13:37.860868] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-30T17:13:37.860969] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-30T17:13:37.861508] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-30T17:13:37.861551] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-30T17:13:37.862559] [DEBUG] [LOCAL ] AN: Trimmed 47187 records to 31085 (keeping 200 days of data) [2025-10-30T17:13:38.039986] [DEBUG] [LOCAL ] AN: Primary data saved (31085 records). [2025-10-30T17:13:38.040106] [INFO ] [MAIN ] AN: Full history saved. [2025-10-30T17:13:38.040181] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AN took 27.4s. Estimated remaining: 4h 26m 4s. Rate: 8.5 symbols/min [2025-10-30T17:13:38.103674] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-30T17:13:38.221475] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:13:38.221677] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-30T17:13:38.221731] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-30T17:13:38.221846] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-30T17:13:38.221888] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-30T17:13:38.221930] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-30T17:13:38.221973] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-30T17:13:38.591437] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:13:38.897467] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-30T17:13:39.048048] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:13:39.048584] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-30T17:13:39.050444] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-30T17:13:39.050529] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:13:39.062087] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-30T17:13:39.062491] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:13:39.062574] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-30T17:13:39.062664] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-30T17:13:39.062722] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-30T17:13:39.062768] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-30T17:13:39.062817] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. ANGX took 1.0s. Estimated remaining: 4h 23m 59s. Rate: 8.5 symbols/min [2025-10-30T17:13:39.236330] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:13:39.273953] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T17:13:39.291032] [DEBUG] [LOCAL ] ANRO: Loaded 19933 existing records from primary storage. [2025-10-30T17:13:39.291261] [INFO ] [MAIN ] ANRO: Loaded 19933 existing records. [2025-10-30T17:13:39.474680] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:13:39.474875] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-30T17:13:39.474922] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-30T17:13:39.475130] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-30T17:13:39.475184] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-30T17:13:39.702666] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-30T17:13:39.823978] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:13:40.497508] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-30T17:13:41.037860] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T17:13:41.049346] [INFO ] [REMOTE ] AMX: Full fetch complete (71073 records). [2025-10-30T17:13:41.049519] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-30T17:13:41.303117] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-30T17:13:41.440115] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T17:13:41.476588] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-30T17:13:41.476695] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-30T17:13:41.477521] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-30T17:13:41.477585] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-30T17:13:41.478969] [DEBUG] [LOCAL ] AMX: Trimmed 71073 records to 49419 (keeping 200 days of data) [2025-10-30T17:13:41.767457] [DEBUG] [LOCAL ] AMX: Primary data saved (49419 records). [2025-10-30T17:13:41.767588] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-30T17:13:41.768492] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. AMX took 41.3s. Estimated remaining: 4h 22m 29s. Rate: 8.6 symbols/min [2025-10-30T17:13:42.097575] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-30T17:13:42.601277] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T17:13:42.728974] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T17:13:42.897506] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-30T17:13:43.697513] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-30T17:13:43.841166] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T17:13:44.497547] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-30T17:13:45.184011] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T17:13:45.280954] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T17:13:45.297459] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-30T17:13:46.097483] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-30T17:13:46.124531] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-30T17:13:46.897509] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-30T17:13:47.700490] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-30T17:13:47.710696] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T17:13:48.088972] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-30T17:13:48.497466] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-30T17:13:49.297536] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-30T17:13:49.344500] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-30T17:13:49.369024] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T17:13:50.097504] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-30T17:13:50.719285] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T17:13:50.897471] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-30T17:13:51.020915] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-30T17:13:51.697517] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-30T17:13:52.242097] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:13:52.328929] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T17:13:52.497505] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-30T17:13:53.297505] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-30T17:13:53.781731] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T17:13:54.097500] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-30T17:13:54.305603] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T17:13:54.313258] [INFO ] [REMOTE ] ANRO: Full fetch complete (31162 records). [2025-10-30T17:13:54.313402] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-30T17:13:54.709058] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-30T17:13:54.709138] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-30T17:13:54.709556] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-30T17:13:54.709598] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-30T17:13:54.710357] [DEBUG] [LOCAL ] ANRO: Trimmed 31162 records to 20216 (keeping 200 days of data) [2025-10-30T17:13:54.818491] [DEBUG] [LOCAL ] ANRO: Primary data saved (20216 records). [2025-10-30T17:13:54.818606] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-30T17:13:54.818703] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANRO took 15.8s. Estimated remaining: 4h 24m 17s. Rate: 8.5 symbols/min [2025-10-30T17:13:54.897550] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-30T17:13:55.376639] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T17:13:55.697547] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-30T17:13:56.974290] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T17:13:56.991322] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-30T17:13:56.991940] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-30T17:13:57.297504] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-30T17:13:58.220443] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:13:58.231873] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-30T17:13:59.180586] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-30T17:13:59.192304] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-30T17:13:59.950154] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-30T17:13:59.961956] [INFO ] [REMOTE ] ANF: Full fetch complete (75773 records). [2025-10-30T17:13:59.962118] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-30T17:14:00.369500] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-30T17:14:00.369589] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-30T17:14:00.370334] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-30T17:14:00.370397] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-30T17:14:00.371822] [DEBUG] [LOCAL ] ANF: Trimmed 75773 records to 52347 (keeping 200 days of data) [2025-10-30T17:14:00.702504] [DEBUG] [LOCAL ] ANF: Primary data saved (52347 records). [2025-10-30T17:14:00.702700] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-30T17:14:00.702796] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANF took 30.1s. Estimated remaining: 4h 23m 48s. Rate: 8.5 symbols/min [2025-10-30T17:14:01.647362] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-30T17:14:01.659110] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-30T17:14:04.249864] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-30T17:14:04.262370] [INFO ] [REMOTE ] ANET: Full fetch complete (77943 records). [2025-10-30T17:14:04.262699] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-30T17:14:04.668447] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-30T17:14:04.668539] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-30T17:14:04.669378] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-30T17:14:04.669446] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-30T17:14:04.670977] [DEBUG] [LOCAL ] ANET: Trimmed 77943 records to 54154 (keeping 200 days of data) [2025-10-30T17:14:04.989927] [DEBUG] [LOCAL ] ANET: Primary data saved (54154 records). [2025-10-30T17:14:04.990071] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-30T17:14:04.990794] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANET took 35.8s. Estimated remaining: 4h 22m 49s. Rate: 8.5 symbols/min [2025-10-30T17:14:05.651568] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:05.698536] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:05.735058] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:05.731894] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:05.737427] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-30T17:14:05.737614] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-30T17:14:05.738238] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-30T17:14:05.738286] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-30T17:14:05.738444] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-30T17:14:05.738612] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-30T17:14:05.899701] [DEBUG] [LOCAL ] ANVS: Loaded 24184 existing records from primary storage. [2025-10-30T17:14:05.930314] [DEBUG] [LOCAL ] AOMR: Loaded 15986 existing records from primary storage. [2025-10-30T17:14:05.930797] [INFO ] [MAIN ] ANVS: Loaded 24184 existing records. [2025-10-30T17:14:05.930937] [INFO ] [MAIN ] AOMR: Loaded 15986 existing records. [2025-10-30T17:14:05.947252] [DEBUG] [LOCAL ] AOD: Loaded 30356 existing records from primary storage. [2025-10-30T17:14:06.133681] [INFO ] [MAIN ] AOD: Loaded 30356 existing records. [2025-10-30T17:14:06.534803] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:06.580034] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-30T17:14:06.585980] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-30T17:14:06.626373] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:06.642624] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-30T17:14:06.660849] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-30T17:14:06.697194] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-30T17:14:06.697540] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-30T17:14:06.724800] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-30T17:14:06.752253] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:06.752441] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-30T17:14:06.774396] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-30T17:14:06.786593] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-30T17:14:06.774223] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:06.824694] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-30T17:14:06.832191] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-30T17:14:06.842849] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-30T17:14:07.092240] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:14:07.295708] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-30T17:14:07.362556] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:14:07.513380] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-30T17:14:07.657414] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:14:07.722382] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-30T17:14:07.885068] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-30T17:14:07.901881] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-30T17:14:07.962894] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-30T17:14:07.963026] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 3.0s. Estimated remaining: 4h 21m 27s. Rate: 8.6 symbols/min [2025-10-30T17:14:07.966708] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:07.980708] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:07.995870] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-30T17:14:07.984869] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:08.020444] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-30T17:14:08.029585] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-30T17:14:08.155054] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:08.194351] [DEBUG] [LOCAL ] AON: Loaded 44821 existing records from primary storage. [2025-10-30T17:14:08.194711] [INFO ] [MAIN ] AON: Loaded 44821 existing records. [2025-10-30T17:14:08.380764] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:08.380962] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-30T17:14:08.381010] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-30T17:14:08.381451] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-30T17:14:08.381507] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-30T17:14:08.699765] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T17:14:08.722357] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-30T17:14:08.759914] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:08.760218] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-30T17:14:09.085789] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-30T17:14:09.093499] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-30T17:14:09.110636] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T17:14:09.116581] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-30T17:14:09.449852] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T17:14:09.454050] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-30T17:14:10.012691] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T17:14:10.018872] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-30T17:14:10.102290] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:14:10.109332] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-30T17:14:10.199212] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T17:14:10.208335] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-30T17:14:10.323788] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-30T17:14:10.327798] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-30T17:14:10.832164] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T17:14:10.897461] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-30T17:14:10.953922] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T17:14:11.250638] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T17:14:11.267202] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T17:14:11.697468] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-30T17:14:11.864174] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T17:14:12.497505] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-30T17:14:12.964454] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T17:14:13.135124] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T17:14:13.297490] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-30T17:14:14.097516] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-30T17:14:14.479351] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T17:14:14.895185] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T17:14:14.900210] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-30T17:14:15.465197] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T17:14:15.697532] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-30T17:14:16.497517] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-30T17:14:16.685955] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-30T17:14:17.265911] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-30T17:14:17.297470] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-30T17:14:17.979501] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-30T17:14:18.097502] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-30T17:14:18.897485] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-30T17:14:18.963956] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:14:19.697528] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-30T17:14:19.793110] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T17:14:20.497533] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-30T17:14:21.080144] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T17:14:21.297472] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-30T17:14:21.313487] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T17:14:22.097502] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-30T17:14:22.276336] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T17:14:22.731494] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-30T17:14:22.897498] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-30T17:14:23.697497] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-30T17:14:23.912052] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T17:14:24.497513] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-30T17:14:24.577835] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T17:14:25.194384] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T17:14:25.297494] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-30T17:14:26.097465] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-30T17:14:26.222809] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T17:14:26.795839] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T17:14:26.897479] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-30T17:14:27.609767] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T17:14:27.612959] [INFO ] [REMOTE ] AOMR: Full fetch complete (23120 records). [2025-10-30T17:14:27.613033] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-30T17:14:27.613437] [FATAL] [VALIDATOR ] AOMR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:14:27.613533] [FATAL] [MAIN ] AOMR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:14:27.613606] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:14:27.613722] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-30T17:14:27.613794] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-30T17:14:27.613829] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-10-30T17:14:27.614011] [DEBUG] [LOCAL ] AOMR: Deleted derivative data file. [2025-10-30T17:14:27.614102] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. AOMR took 22.6s. Estimated remaining: 4h 25m 13s. Rate: 8.5 symbols/min [2025-10-30T17:14:27.702593] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-30T17:14:27.793296] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:27.819201] [DEBUG] [LOCAL ] AORT: Loaded 28551 existing records from primary storage. [2025-10-30T17:14:27.819497] [INFO ] [MAIN ] AORT: Loaded 28551 existing records. [2025-10-30T17:14:28.008094] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:28.008341] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-30T17:14:28.008390] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-30T17:14:28.009802] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-30T17:14:28.009880] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-30T17:14:28.420139] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:28.497460] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-30T17:14:28.899106] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T17:14:28.906880] [INFO ] [REMOTE ] AOD: Full fetch complete (44579 records). [2025-10-30T17:14:28.906985] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-30T17:14:29.288139] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-30T17:14:29.288216] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-30T17:14:29.288714] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-30T17:14:29.288775] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-30T17:14:29.289725] [DEBUG] [LOCAL ] AOD: Trimmed 44579 records to 30603 (keeping 200 days of data) [2025-10-30T17:14:29.339115] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-30T17:14:29.492611] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-30T17:14:29.501344] [DEBUG] [LOCAL ] AOD: Primary data saved (30603 records). [2025-10-30T17:14:29.501543] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-30T17:14:29.501636] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. AOD took 24.5s. Estimated remaining: 4h 23m 31s. Rate: 8.5 symbols/min [2025-10-30T17:14:29.501774] [INFO ] [REMOTE ] ANVS: Full fetch complete (36771 records). [2025-10-30T17:14:29.522757] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-30T17:14:29.838151] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:30.066766] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-30T17:14:30.066850] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-30T17:14:30.067272] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-30T17:14:30.067311] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-30T17:14:30.068262] [DEBUG] [LOCAL ] ANVS: Trimmed 36771 records to 24308 (keeping 200 days of data) [2025-10-30T17:14:30.112921] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-30T17:14:30.162218] [DEBUG] [LOCAL ] AOS: Loaded 48556 existing records from primary storage. [2025-10-30T17:14:30.166900] [INFO ] [MAIN ] AOS: Loaded 48556 existing records. [2025-10-30T17:14:30.373660] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:30.377159] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-30T17:14:30.377595] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-30T17:14:30.378920] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-30T17:14:30.379374] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-30T17:14:30.548221] [DEBUG] [LOCAL ] ANVS: Primary data saved (24308 records). [2025-10-30T17:14:30.584782] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-30T17:14:30.624051] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. ANVS took 25.6s. Estimated remaining: 4h 21m 37s. Rate: 8.6 symbols/min [2025-10-30T17:14:30.902859] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:30.947711] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-30T17:14:30.948583] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:30.976706] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-30T17:14:30.990029] [DEBUG] [LOCAL ] AP: Loaded 7529 existing records from primary storage. [2025-10-30T17:14:30.990588] [INFO ] [MAIN ] AP: Loaded 7529 existing records. [2025-10-30T17:14:31.165245] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:31.165451] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-30T17:14:31.165518] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-30T17:14:31.165690] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-30T17:14:31.165745] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-30T17:14:31.508344] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T17:14:31.570792] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:31.697486] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-30T17:14:32.174134] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:14:32.497474] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-30T17:14:33.214416] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T17:14:33.297507] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-30T17:14:33.814622] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T17:14:34.097498] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-30T17:14:34.328498] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:14:34.585793] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T17:14:34.897521] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-30T17:14:35.252404] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-30T17:14:35.697496] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-30T17:14:36.043042] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-30T17:14:36.497502] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-30T17:14:37.297500] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-30T17:14:37.956888] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T17:14:38.097500] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-30T17:14:38.490699] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T17:14:38.897480] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-30T17:14:38.919577] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-30T17:14:39.697524] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-30T17:14:40.497823] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-30T17:14:40.497746] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-30T17:14:40.653321] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T17:14:40.947122] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T17:14:41.297507] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-30T17:14:41.940046] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T17:14:42.097498] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-30T17:14:42.645164] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T17:14:42.897490] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-30T17:14:43.697499] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-30T17:14:44.067859] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T17:14:44.349073] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T17:14:44.497589] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-30T17:14:45.242372] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-30T17:14:45.297507] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-30T17:14:45.797900] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T17:14:46.097493] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-30T17:14:46.897534] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-30T17:14:47.067139] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:14:47.697496] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-30T17:14:48.124669] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T17:14:48.136809] [INFO ] [REMOTE ] AON: Full fetch complete (65350 records). [2025-10-30T17:14:48.136942] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-30T17:14:48.503345] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-30T17:14:48.559686] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-30T17:14:48.559786] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-30T17:14:48.560427] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-30T17:14:48.560473] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-30T17:14:48.561700] [DEBUG] [LOCAL ] AON: Trimmed 65350 records to 45185 (keeping 200 days of data) [2025-10-30T17:14:48.828012] [DEBUG] [LOCAL ] AON: Primary data saved (45185 records). [2025-10-30T17:14:48.828120] [INFO ] [MAIN ] AON: Full history saved. [2025-10-30T17:14:48.828200] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AON took 40.9s. Estimated remaining: 4h 24m 50s. Rate: 8.5 symbols/min [2025-10-30T17:14:48.997459] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:49.028305] [DEBUG] [LOCAL ] APAM: Loaded 35248 existing records from primary storage. [2025-10-30T17:14:49.028798] [INFO ] [MAIN ] APAM: Loaded 35248 existing records. [2025-10-30T17:14:49.143297] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-30T17:14:49.156499] [INFO ] [REMOTE ] AP: Full fetch complete (9243 records). [2025-10-30T17:14:49.156702] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-30T17:14:49.172794] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:14:49.186126] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:14:49.196699] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:14:49.227022] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-30T17:14:49.226816] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:49.227434] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-30T17:14:49.227631] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-30T17:14:49.227569] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-30T17:14:49.227898] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-30T17:14:49.228149] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-30T17:14:49.228282] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AP took 18.6s. Estimated remaining: 4h 22m 44s. Rate: 8.5 symbols/min [2025-10-30T17:14:49.233799] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-30T17:14:49.285668] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-30T17:14:49.311681] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-30T17:14:49.505021] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-30T17:14:49.528125] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:14:49.871475] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:49.872728] [DEBUG] [LOCAL ] APD: Loaded 45249 existing records from primary storage. [2025-10-30T17:14:49.872922] [INFO ] [MAIN ] APD: Loaded 45249 existing records. [2025-10-30T17:14:50.046291] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:14:50.046625] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-30T17:14:50.046706] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-30T17:14:50.047153] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-30T17:14:50.047191] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-30T17:14:50.105082] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-30T17:14:50.389240] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-30T17:14:50.460130] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:14:50.897513] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-30T17:14:51.485015] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T17:14:51.697500] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-30T17:14:51.989363] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T17:14:52.497503] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-30T17:14:52.906221] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T17:14:53.297504] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-30T17:14:53.723398] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:14:54.097525] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-30T17:14:54.636392] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:14:54.897475] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-30T17:14:55.232076] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T17:14:55.697508] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-30T17:14:56.191096] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T17:14:56.497504] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-30T17:14:56.709885] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T17:14:57.297511] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-30T17:14:57.579993] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T17:14:58.097465] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-30T17:14:58.792823] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T17:14:58.897512] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-30T17:14:59.206305] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T17:14:59.697475] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-30T17:15:00.286538] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T17:15:00.497497] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-30T17:15:01.045683] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T17:15:01.297501] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-30T17:15:02.097505] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-30T17:15:02.777828] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-30T17:15:02.897497] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-30T17:15:03.537985] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-30T17:15:03.697480] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-30T17:15:04.232416] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T17:15:04.238187] [INFO ] [REMOTE ] AORT: Full fetch complete (42240 records). [2025-10-30T17:15:04.238276] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-30T17:15:04.238864] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:15:04.238949] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:15:04.238991] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:15:04.239030] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-30T17:15:04.239084] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-30T17:15:04.239119] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-10-30T17:15:04.239279] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-10-30T17:15:04.239347] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AORT took 36.6s. Estimated remaining: 4h 24m 58s. Rate: 8.5 symbols/min [2025-10-30T17:15:04.408810] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:04.436623] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-30T17:15:04.491557] [DEBUG] [LOCAL ] APG: Loaded 50611 existing records from primary storage. [2025-10-30T17:15:04.491885] [INFO ] [MAIN ] APG: Loaded 50611 existing records. [2025-10-30T17:15:04.502869] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-30T17:15:04.669934] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:15:04.670132] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-30T17:15:04.670179] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-30T17:15:04.670617] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-30T17:15:04.670695] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-30T17:15:05.024978] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:05.052352] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T17:15:05.297479] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-30T17:15:06.078022] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-30T17:15:06.088237] [INFO ] [REMOTE ] AOS: Full fetch complete (70762 records). [2025-10-30T17:15:06.088377] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-30T17:15:06.089030] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:15:06.089120] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:15:06.089163] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:15:06.089202] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-30T17:15:06.089271] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-30T17:15:06.089330] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-30T17:15:06.089499] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-30T17:15:06.089603] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. AOS took 36.6s. Estimated remaining: 4h 23m 19s. Rate: 8.5 symbols/min [2025-10-30T17:15:06.102637] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-30T17:15:06.258224] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:06.305235] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-30T17:15:06.305534] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-30T17:15:06.478108] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:15:06.478327] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-30T17:15:06.478374] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-30T17:15:06.478904] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-30T17:15:06.478959] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-30T17:15:06.839797] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:06.897465] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-30T17:15:07.093695] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-30T17:15:07.311859] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T17:15:07.697495] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-30T17:15:08.236694] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:15:08.497467] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-30T17:15:08.707955] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T17:15:09.297502] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-30T17:15:09.705563] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T17:15:10.097479] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-30T17:15:10.173201] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T17:15:10.897540] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-30T17:15:11.625954] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-30T17:15:11.697477] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-30T17:15:11.805536] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-30T17:15:12.497527] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-30T17:15:13.014809] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:15:13.297485] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-30T17:15:13.706128] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T17:15:14.097519] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-30T17:15:14.591680] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T17:15:14.897485] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-30T17:15:15.249000] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-30T17:15:15.256876] [INFO ] [REMOTE ] APAM: Full fetch complete (51972 records). [2025-10-30T17:15:15.257004] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-30T17:15:15.644153] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-30T17:15:15.644229] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-30T17:15:15.644821] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-30T17:15:15.644919] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-30T17:15:15.645955] [DEBUG] [LOCAL ] APAM: Trimmed 51972 records to 35513 (keeping 200 days of data) [2025-10-30T17:15:15.700693] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-30T17:15:15.860471] [DEBUG] [LOCAL ] APAM: Primary data saved (35513 records). [2025-10-30T17:15:15.860604] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-30T17:15:15.860705] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. APAM took 27.0s. Estimated remaining: 4h 23m 59s. Rate: 8.5 symbols/min [2025-10-30T17:15:16.026787] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:16.072926] [DEBUG] [LOCAL ] APLE: Loaded 51888 existing records from primary storage. [2025-10-30T17:15:16.073222] [INFO ] [MAIN ] APLE: Loaded 51888 existing records. [2025-10-30T17:15:16.245897] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:15:16.246119] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-30T17:15:16.246166] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-30T17:15:16.246719] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-30T17:15:16.246773] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-30T17:15:16.499423] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-30T17:15:16.612536] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:16.646323] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-30T17:15:17.080248] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T17:15:17.297562] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-30T17:15:17.747888] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T17:15:18.097527] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-30T17:15:18.554720] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:15:18.897506] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-30T17:15:19.334361] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:15:19.697552] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-30T17:15:20.321735] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T17:15:20.497512] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-30T17:15:20.929837] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:15:21.297519] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-30T17:15:22.097471] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-30T17:15:22.251676] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-30T17:15:22.679739] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T17:15:22.897501] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-30T17:15:23.477956] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T17:15:23.697510] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-30T17:15:24.043993] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T17:15:24.497524] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-30T17:15:25.297467] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-30T17:15:25.426499] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-30T17:15:25.437013] [INFO ] [REMOTE ] APD: Full fetch complete (67190 records). [2025-10-30T17:15:25.437143] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-30T17:15:25.841392] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-30T17:15:25.841513] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-30T17:15:25.842359] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-30T17:15:25.842461] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-30T17:15:25.844449] [DEBUG] [LOCAL ] APD: Trimmed 67190 records to 45618 (keeping 200 days of data) [2025-10-30T17:15:25.980735] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T17:15:26.100492] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-30T17:15:26.169167] [DEBUG] [LOCAL ] APD: Primary data saved (45618 records). [2025-10-30T17:15:26.169287] [INFO ] [MAIN ] APD: Full history saved. [2025-10-30T17:15:26.169362] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APD took 36.9s. Estimated remaining: 4h 24m 47s. Rate: 8.4 symbols/min [2025-10-30T17:15:26.335145] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:26.383513] [DEBUG] [LOCAL ] APO: Loaded 53366 existing records from primary storage. [2025-10-30T17:15:26.383819] [INFO ] [MAIN ] APO: Loaded 53366 existing records. [2025-10-30T17:15:26.567150] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:15:26.567370] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-30T17:15:26.567423] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-30T17:15:26.567966] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-30T17:15:26.568028] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-30T17:15:26.906068] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-30T17:15:26.955290] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:26.978157] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-30T17:15:27.355804] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T17:15:27.697516] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-30T17:15:28.413209] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-30T17:15:28.497502] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-30T17:15:28.992183] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T17:15:29.297524] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-30T17:15:29.902343] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T17:15:30.097541] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-30T17:15:30.396372] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T17:15:30.897522] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-30T17:15:31.479275] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T17:15:31.697496] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-30T17:15:31.980886] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T17:15:32.497494] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-30T17:15:33.240024] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-30T17:15:33.297470] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-30T17:15:33.865938] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T17:15:34.097465] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-30T17:15:34.619900] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-30T17:15:34.897508] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-30T17:15:35.675590] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-30T17:15:35.697511] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-30T17:15:36.497525] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-30T17:15:36.564903] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T17:15:36.577567] [INFO ] [REMOTE ] APLE: Full fetch complete (74807 records). [2025-10-30T17:15:36.577753] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-30T17:15:36.997385] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-30T17:15:36.997492] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-30T17:15:36.998328] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-30T17:15:36.998404] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-30T17:15:37.000381] [DEBUG] [LOCAL ] APLE: Trimmed 74807 records to 52271 (keeping 200 days of data) [2025-10-30T17:15:37.302183] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-30T17:15:37.420570] [DEBUG] [LOCAL ] APLE: Primary data saved (52271 records). [2025-10-30T17:15:37.420943] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-30T17:15:37.421132] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APLE took 21.6s. Estimated remaining: 4h 25m 51s. Rate: 8.4 symbols/min [2025-10-30T17:15:37.680750] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:37.681274] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-30T17:15:37.681503] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-30T17:15:37.704733] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-30T17:15:37.724402] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-30T17:15:37.724691] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-30T17:15:37.725425] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-30T17:15:37.733872] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-30T17:15:38.098866] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-30T17:15:38.166478] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:38.237299] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T17:15:38.248574] [INFO ] [REMOTE ] APG: Full fetch complete (72299 records). [2025-10-30T17:15:38.248737] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-30T17:15:38.645535] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-30T17:15:38.645708] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-30T17:15:38.646560] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-30T17:15:38.646664] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-30T17:15:38.648197] [DEBUG] [LOCAL ] APG: Trimmed 72299 records to 50991 (keeping 200 days of data) [2025-10-30T17:15:38.918831] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-30T17:15:38.987926] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-30T17:15:39.007897] [DEBUG] [LOCAL ] APG: Primary data saved (50991 records). [2025-10-30T17:15:39.007993] [INFO ] [MAIN ] APG: Full history saved. [2025-10-30T17:15:39.008916] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APG took 34.8s. Estimated remaining: 4h 24m 10s. Rate: 8.5 symbols/min [2025-10-30T17:15:39.183579] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:39.183789] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-30T17:15:39.183832] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-30T17:15:39.183963] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-30T17:15:39.184029] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-30T17:15:39.184089] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-30T17:15:39.184123] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-30T17:15:39.485392] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-30T17:15:39.560620] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:39.697499] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-30T17:15:39.805041] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-30T17:15:40.497479] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-30T17:15:41.054388] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T17:15:41.297496] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-30T17:15:41.964377] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T17:15:42.097535] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-30T17:15:42.897499] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-30T17:15:43.283117] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-30T17:15:43.294512] [INFO ] [REMOTE ] APH: Full fetch complete (77481 records). [2025-10-30T17:15:43.294626] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-30T17:15:43.295492] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:15:43.295584] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:15:43.295678] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:15:43.295749] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-30T17:15:43.295813] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-30T17:15:43.295849] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-10-30T17:15:43.296028] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-10-30T17:15:43.296142] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APH took 37.2s. Estimated remaining: 4h 23m 16s. Rate: 8.5 symbols/min [2025-10-30T17:15:43.404625] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T17:15:43.481777] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:43.551260] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T17:15:43.562263] [DEBUG] [LOCAL ] AQN: Loaded 51558 existing records from primary storage. [2025-10-30T17:15:43.563156] [INFO ] [MAIN ] AQN: Loaded 51558 existing records. [2025-10-30T17:15:43.709074] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-30T17:15:43.749312] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:15:43.749954] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-30T17:15:43.750012] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-30T17:15:43.751016] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-30T17:15:43.751142] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-30T17:15:44.100957] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:44.497518] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-30T17:15:45.099388] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:15:45.297506] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-30T17:15:45.863814] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T17:15:45.931704] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T17:15:46.097504] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-30T17:15:46.609136] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-30T17:15:46.897498] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-30T17:15:47.371120] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T17:15:47.697501] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-30T17:15:48.218998] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-30T17:15:48.497536] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-30T17:15:49.297531] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-30T17:15:49.742908] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T17:15:50.097513] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-30T17:15:50.655564] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T17:15:50.880588] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-30T17:15:50.897452] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-30T17:15:51.697504] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-30T17:15:52.475006] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-30T17:15:52.497464] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-30T17:15:52.981073] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T17:15:53.297504] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-30T17:15:53.830260] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T17:15:54.097491] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-30T17:15:54.347790] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T17:15:54.487592] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T17:15:54.897498] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-30T17:15:55.408923] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T17:15:55.697495] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-30T17:15:56.178176] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-30T17:15:56.180025] [INFO ] [REMOTE ] APOS: Full fetch complete (10191 records). [2025-10-30T17:15:56.180098] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-30T17:15:56.500508] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-30T17:15:56.538940] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-30T17:15:56.539010] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-30T17:15:56.539239] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-30T17:15:56.539278] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-30T17:15:56.539724] [DEBUG] [LOCAL ] APOS: Trimmed 10191 records to 6849 (keeping 200 days of data) [2025-10-30T17:15:56.583312] [DEBUG] [LOCAL ] APOS: Primary data saved (6849 records). [2025-10-30T17:15:56.583456] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-30T17:15:56.583546] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APOS took 19.2s. Estimated remaining: 4h 24m 52s. Rate: 8.4 symbols/min [2025-10-30T17:15:56.751935] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:15:56.752089] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-10-30T17:15:56.752127] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-10-30T17:15:56.752239] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-30T17:15:56.752282] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-30T17:15:56.752325] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-10-30T17:15:56.752357] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-30T17:15:57.107216] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:15:57.297501] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-30T17:15:57.904423] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T17:15:58.097501] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-30T17:15:58.517007] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-30T17:15:58.738363] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T17:15:58.897503] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-30T17:15:59.697498] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-30T17:16:00.064531] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T17:16:00.497509] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-30T17:16:01.297536] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-30T17:16:01.366248] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T17:16:01.778007] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-30T17:16:01.793332] [INFO ] [REMOTE ] APO: Full fetch complete (77450 records). [2025-10-30T17:16:01.793526] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-30T17:16:02.110677] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-30T17:16:02.264619] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-30T17:16:02.264739] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-30T17:16:02.265480] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-30T17:16:02.265521] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-30T17:16:02.267034] [DEBUG] [LOCAL ] APO: Trimmed 77450 records to 53756 (keeping 200 days of data) [2025-10-30T17:16:02.600897] [DEBUG] [LOCAL ] APO: Primary data saved (53756 records). [2025-10-30T17:16:02.601062] [INFO ] [MAIN ] APO: Full history saved. [2025-10-30T17:16:02.602057] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APO took 36.4s. Estimated remaining: 4h 24m 27s. Rate: 8.4 symbols/min [2025-10-30T17:16:02.723777] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-30T17:16:02.809045] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:02.809238] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-30T17:16:02.809288] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-30T17:16:02.809592] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-30T17:16:02.809635] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-30T17:16:02.809770] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-30T17:16:02.809844] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-30T17:16:02.902625] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-30T17:16:03.183476] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:03.584568] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T17:16:03.697465] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-30T17:16:03.879166] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-30T17:16:04.199944] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-30T17:16:04.497483] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-30T17:16:05.057596] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T17:16:05.297519] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-30T17:16:06.097500] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-30T17:16:06.851549] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-30T17:16:06.897524] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-30T17:16:07.232391] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-30T17:16:07.697587] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-30T17:16:07.799387] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-30T17:16:08.497577] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-30T17:16:09.297500] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-30T17:16:09.345451] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-30T17:16:09.699617] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T17:16:09.876613] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:16:10.097564] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-30T17:16:10.897524] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-30T17:16:11.293020] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T17:16:11.440390] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:16:11.697524] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-30T17:16:12.497520] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-30T17:16:13.036801] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:16:13.297566] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-30T17:16:13.701350] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T17:16:14.097509] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-30T17:16:14.865917] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T17:16:14.897465] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-30T17:16:15.237148] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T17:16:15.697491] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-30T17:16:16.482587] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T17:16:16.494382] [INFO ] [REMOTE ] APTV: Full fetch complete (75702 records). [2025-10-30T17:16:16.494518] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-30T17:16:16.507366] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-30T17:16:16.910546] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-30T17:16:16.910678] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-30T17:16:16.911415] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-30T17:16:16.911457] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-30T17:16:16.912843] [DEBUG] [LOCAL ] APTV: Trimmed 75702 records to 52090 (keeping 200 days of data) [2025-10-30T17:16:17.222252] [DEBUG] [LOCAL ] APTV: Primary data saved (52090 records). [2025-10-30T17:16:17.222549] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-30T17:16:17.222685] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. APTV took 38.2s. Estimated remaining: 4h 26m 23s. Rate: 8.4 symbols/min [2025-10-30T17:16:17.302291] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-30T17:16:17.395581] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:17.431016] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-30T17:16:17.476634] [DEBUG] [LOCAL ] ARCO: Loaded 43879 existing records from primary storage. [2025-10-30T17:16:17.476964] [INFO ] [MAIN ] ARCO: Loaded 43879 existing records. [2025-10-30T17:16:17.653891] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:16:17.654116] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-30T17:16:17.654163] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-30T17:16:17.654573] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-30T17:16:17.654628] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-30T17:16:17.940082] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-30T17:16:17.968570] [INFO ] [REMOTE ] AQNB: Full fetch complete (5330 records). [2025-10-30T17:16:17.968748] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-30T17:16:18.125805] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-30T17:16:18.148078] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:18.350598] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-30T17:16:18.560428] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-30T17:16:18.560554] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-30T17:16:18.560948] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-30T17:16:18.561036] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-30T17:16:18.561550] [DEBUG] [LOCAL ] AQNB: Trimmed 5330 records to 3688 (keeping 200 days of data) [2025-10-30T17:16:18.588779] [DEBUG] [LOCAL ] AQNB: Primary data saved (3688 records). [2025-10-30T17:16:18.588946] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-30T17:16:18.589036] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. AQNB took 22.0s. Estimated remaining: 4h 24m 41s. Rate: 8.4 symbols/min [2025-10-30T17:16:18.798272] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:18.816610] [DEBUG] [LOCAL ] ARDC: Loaded 14841 existing records from primary storage. [2025-10-30T17:16:18.817035] [INFO ] [MAIN ] ARDC: Loaded 14841 existing records. [2025-10-30T17:16:18.902723] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-30T17:16:19.011188] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:16:19.011481] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-30T17:16:19.011536] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-30T17:16:19.011848] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-30T17:16:19.011928] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-30T17:16:19.413244] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:19.446556] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:16:19.697526] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-30T17:16:20.114319] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T17:16:20.497572] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-30T17:16:21.174974] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-30T17:16:21.175412] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T17:16:21.297535] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-30T17:16:21.889784] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-30T17:16:22.097492] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-30T17:16:22.897501] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-30T17:16:23.570793] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-30T17:16:23.634721] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-30T17:16:23.697584] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-30T17:16:24.497752] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-30T17:16:24.954433] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:16:25.297558] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-30T17:16:25.988486] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T17:16:26.097539] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-30T17:16:26.578538] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T17:16:26.897552] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-30T17:16:27.502629] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-30T17:16:27.513951] [INFO ] [REMOTE ] AQN: Full fetch complete (75282 records). [2025-10-30T17:16:27.514080] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-30T17:16:27.712416] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-30T17:16:27.915366] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-30T17:16:27.915450] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-30T17:16:27.916246] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-30T17:16:27.916313] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-30T17:16:27.917768] [DEBUG] [LOCAL ] AQN: Trimmed 75282 records to 51912 (keeping 200 days of data) [2025-10-30T17:16:28.227944] [DEBUG] [LOCAL ] AQN: Primary data saved (51912 records). [2025-10-30T17:16:28.228081] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-30T17:16:28.228161] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 44.9s. Estimated remaining: 4h 25m 15s. Rate: 8.4 symbols/min [2025-10-30T17:16:28.406804] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:28.452796] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T17:16:28.474786] [DEBUG] [LOCAL ] ARDT: Loaded 27314 existing records from primary storage. [2025-10-30T17:16:28.475044] [INFO ] [MAIN ] ARDT: Loaded 27314 existing records. [2025-10-30T17:16:28.506890] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-30T17:16:28.662886] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:16:28.663137] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-30T17:16:28.663188] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-30T17:16:28.663432] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-30T17:16:28.663489] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-30T17:16:29.068391] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:29.100490] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:16:29.251881] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-30T17:16:29.297490] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-30T17:16:29.938707] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T17:16:30.097502] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-30T17:16:30.897500] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-30T17:16:31.441624] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T17:16:31.630289] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T17:16:31.697526] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-30T17:16:32.497532] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-30T17:16:32.843243] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T17:16:33.297487] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-30T17:16:33.473044] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T17:16:34.097510] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-30T17:16:34.786750] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-30T17:16:34.897485] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-30T17:16:34.975409] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T17:16:35.594200] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T17:16:35.697495] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-30T17:16:36.497515] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-30T17:16:36.808588] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T17:16:37.297493] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-30T17:16:38.097465] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-30T17:16:38.099155] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T17:16:38.111439] [INFO ] [REMOTE ] AR: Full fetch complete (77346 records). [2025-10-30T17:16:38.111563] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-30T17:16:38.112274] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:16:38.112360] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:16:38.112433] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:16:38.112507] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-30T17:16:38.112570] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-30T17:16:38.112607] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-30T17:16:38.112682] [DEBUG] [LOCAL ] AR: No derivative data file found to delete. [2025-10-30T17:16:38.112759] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. AR took 35.5s. Estimated remaining: 4h 25m 52s. Rate: 8.4 symbols/min [2025-10-30T17:16:38.325970] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:38.326214] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-30T17:16:38.326264] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-30T17:16:38.326372] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-30T17:16:38.326441] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-30T17:16:38.326498] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-30T17:16:38.326532] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-30T17:16:38.662824] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T17:16:38.710530] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:38.897554] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-30T17:16:39.176791] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T17:16:39.472236] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T17:16:39.697517] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-30T17:16:40.497543] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-30T17:16:41.111952] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T17:16:41.200873] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T17:16:41.297505] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-30T17:16:42.097545] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-30T17:16:42.414572] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T17:16:42.897474] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-30T17:16:43.070436] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:16:43.697469] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-30T17:16:44.252091] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T17:16:44.497527] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-30T17:16:44.625389] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T17:16:45.297505] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-30T17:16:45.416633] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-30T17:16:45.420935] [INFO ] [REMOTE ] ARDC: Full fetch complete (21555 records). [2025-10-30T17:16:45.421010] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-30T17:16:45.421429] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:16:45.421514] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:16:45.421559] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:16:45.421633] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-30T17:16:45.421748] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-30T17:16:45.421813] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-30T17:16:45.422056] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-30T17:16:45.422147] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. ARDC took 26.8s. Estimated remaining: 4h 25m 47s. Rate: 8.4 symbols/min [2025-10-30T17:16:45.610847] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:45.655463] [DEBUG] [LOCAL ] ARES: Loaded 49566 existing records from primary storage. [2025-10-30T17:16:45.655805] [INFO ] [MAIN ] ARES: Loaded 49566 existing records. [2025-10-30T17:16:45.845139] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:16:45.845342] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-30T17:16:45.845390] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-30T17:16:45.845757] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-30T17:16:45.845814] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-30T17:16:46.104443] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-30T17:16:46.228411] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:46.436779] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T17:16:46.897516] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-30T17:16:47.347588] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T17:16:47.697477] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-30T17:16:47.896739] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:16:48.497467] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-30T17:16:48.587763] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-30T17:16:49.297505] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-30T17:16:49.783260] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T17:16:50.097504] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-30T17:16:50.663572] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T17:16:50.897471] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-30T17:16:50.930798] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T17:16:51.697569] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-30T17:16:52.160399] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T17:16:52.169599] [INFO ] [REMOTE ] ARCO: Full fetch complete (64282 records). [2025-10-30T17:16:52.169801] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-30T17:16:52.170562] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:16:52.170685] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:16:52.170739] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:16:52.170788] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-30T17:16:52.170845] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-30T17:16:52.170882] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-30T17:16:52.171047] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-30T17:16:52.171848] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. ARCO took 34.9s. Estimated remaining: 4h 25m 33s. Rate: 8.4 symbols/min [2025-10-30T17:16:52.346571] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:52.384129] [DEBUG] [LOCAL ] ARI: Loaded 43052 existing records from primary storage. [2025-10-30T17:16:52.384424] [INFO ] [MAIN ] ARI: Loaded 43052 existing records. [2025-10-30T17:16:52.502549] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-30T17:16:52.565294] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:16:52.565486] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-30T17:16:52.565534] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-30T17:16:52.565951] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-30T17:16:52.566009] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-30T17:16:52.934989] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:52.953286] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T17:16:52.960098] [INFO ] [REMOTE ] ARDT: Full fetch complete (41760 records). [2025-10-30T17:16:52.960180] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-30T17:16:53.305501] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-30T17:16:53.345485] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-30T17:16:53.345558] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-30T17:16:53.346070] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-30T17:16:53.346131] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-30T17:16:53.347005] [DEBUG] [LOCAL ] ARDT: Trimmed 41760 records to 27504 (keeping 200 days of data) [2025-10-30T17:16:53.498926] [DEBUG] [LOCAL ] ARDT: Primary data saved (27504 records). [2025-10-30T17:16:53.499047] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-30T17:16:53.499125] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDT took 25.3s. Estimated remaining: 4h 23m 55s. Rate: 8.4 symbols/min [2025-10-30T17:16:53.680909] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:16:53.721702] [DEBUG] [LOCAL ] ARLO: Loaded 43539 existing records from primary storage. [2025-10-30T17:16:53.722007] [INFO ] [MAIN ] ARLO: Loaded 43539 existing records. [2025-10-30T17:16:53.924217] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:16:53.924547] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-30T17:16:53.924607] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-30T17:16:53.925040] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-30T17:16:53.925096] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-30T17:16:54.110781] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-30T17:16:54.297570] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:16:54.331094] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-30T17:16:54.831768] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-30T17:16:54.897499] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-30T17:16:55.480521] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T17:16:55.697498] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-30T17:16:56.333086] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T17:16:56.497545] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-30T17:16:56.895442] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:16:57.297509] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-30T17:16:58.029521] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T17:16:58.097504] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-30T17:16:58.632630] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T17:16:58.897498] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-30T17:16:59.697472] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-30T17:16:59.899018] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-30T17:17:00.236528] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:17:00.497523] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-30T17:17:01.297549] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-30T17:17:01.934478] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-30T17:17:02.097515] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-30T17:17:02.391347] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-30T17:17:02.897515] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-30T17:17:03.697496] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-30T17:17:03.996195] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-10-30T17:17:04.239565] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T17:17:04.497508] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-30T17:17:04.770504] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-30T17:17:05.095840] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T17:17:05.297495] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-30T17:17:05.757240] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T17:17:06.097498] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-30T17:17:06.645965] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T17:17:06.897504] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-30T17:17:07.101348] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-30T17:17:07.697555] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-30T17:17:08.373146] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-30T17:17:08.497521] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-30T17:17:08.980478] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T17:17:09.297516] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-30T17:17:09.733052] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T17:17:10.097521] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-30T17:17:10.535895] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T17:17:10.897509] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-30T17:17:11.474627] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T17:17:11.697565] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-30T17:17:12.355895] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T17:17:12.497504] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-30T17:17:13.297469] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-30T17:17:13.388752] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T17:17:13.399964] [INFO ] [REMOTE ] ARE: Full fetch complete (72732 records). [2025-10-30T17:17:13.400151] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-30T17:17:13.401052] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:17:13.401173] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:17:13.401219] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:17:13.401288] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-30T17:17:13.401352] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-30T17:17:13.401390] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-30T17:17:13.401430] [DEBUG] [LOCAL ] ARE: No derivative data file found to delete. [2025-10-30T17:17:13.401486] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 35.3s. Estimated remaining: 4h 27m 6s. Rate: 8.3 symbols/min [2025-10-30T17:17:13.594120] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:13.594455] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-10-30T17:17:13.594510] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-10-30T17:17:13.594632] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-30T17:17:13.594729] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-30T17:17:13.594790] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-30T17:17:13.594910] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-30T17:17:13.725820] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T17:17:13.978919] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:14.097494] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-30T17:17:14.422818] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T17:17:14.897495] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-30T17:17:15.653212] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T17:17:15.697501] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-30T17:17:15.845731] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-30T17:17:16.497532] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-30T17:17:17.297527] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-30T17:17:17.688497] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-30T17:17:17.699957] [INFO ] [REMOTE ] ARES: Full fetch complete (71942 records). [2025-10-30T17:17:17.700091] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-30T17:17:18.108325] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-30T17:17:18.108742] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-30T17:17:18.109563] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-30T17:17:18.110415] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-30T17:17:18.110888] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-30T17:17:18.136843] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-30T17:17:18.135587] [DEBUG] [LOCAL ] ARES: Trimmed 71942 records to 49951 (keeping 200 days of data) [2025-10-30T17:17:18.450911] [DEBUG] [LOCAL ] ARES: Primary data saved (49951 records). [2025-10-30T17:17:18.451200] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-30T17:17:18.452163] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARES took 33.0s. Estimated remaining: 4h 26m 26s. Rate: 8.3 symbols/min [2025-10-30T17:17:18.623529] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:18.623934] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-30T17:17:18.624007] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-30T17:17:18.624138] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-30T17:17:18.624270] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-30T17:17:18.624348] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-30T17:17:18.624394] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-30T17:17:18.820389] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-30T17:17:18.903704] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-30T17:17:19.027717] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:19.316717] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T17:17:19.697520] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-30T17:17:20.497468] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-30T17:17:20.560475] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-30T17:17:20.569751] [INFO ] [REMOTE ] ARI: Full fetch complete (62129 records). [2025-10-30T17:17:20.569892] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-30T17:17:20.957070] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-30T17:17:20.957231] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-30T17:17:20.957964] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-30T17:17:20.958095] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-30T17:17:20.959456] [DEBUG] [LOCAL ] ARI: Trimmed 62129 records to 43367 (keeping 200 days of data) [2025-10-30T17:17:21.208503] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-30T17:17:21.253679] [DEBUG] [LOCAL ] ARI: Primary data saved (43367 records). [2025-10-30T17:17:21.253813] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-30T17:17:21.254415] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARI took 29.1s. Estimated remaining: 4h 25m 11s. Rate: 8.4 symbols/min [2025-10-30T17:17:21.303677] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-30T17:17:21.421500] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:21.421708] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-30T17:17:21.421762] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-30T17:17:21.421876] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-30T17:17:21.421918] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-30T17:17:21.421959] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-30T17:17:21.421992] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-30T17:17:21.773843] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:21.833952] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:17:22.097459] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-30T17:17:22.563597] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:17:22.897459] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-30T17:17:23.401631] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T17:17:23.697510] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-30T17:17:24.473404] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T17:17:24.497545] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-30T17:17:24.996372] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T17:17:25.297486] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-30T17:17:26.097471] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-30T17:17:26.230358] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-30T17:17:26.414160] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:17:26.897508] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-30T17:17:27.405161] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T17:17:27.697510] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-30T17:17:28.260272] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:17:28.497510] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-30T17:17:28.884822] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T17:17:29.297543] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-30T17:17:29.588008] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T17:17:30.097519] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-30T17:17:30.459416] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T17:17:30.897509] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-30T17:17:31.400018] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T17:17:31.697535] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-30T17:17:32.101706] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T17:17:32.497520] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-30T17:17:33.297503] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-30T17:17:33.362701] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-30T17:17:33.645395] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T17:17:34.097523] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-30T17:17:34.898858] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-30T17:17:34.908220] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T17:17:34.919417] [INFO ] [REMOTE ] ARLO: Full fetch complete (63367 records). [2025-10-30T17:17:34.919586] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-30T17:17:35.355077] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-30T17:17:35.355169] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-30T17:17:35.355908] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-30T17:17:35.355979] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-30T17:17:35.357426] [DEBUG] [LOCAL ] ARLO: Trimmed 63367 records to 43883 (keeping 200 days of data) [2025-10-30T17:17:35.609952] [DEBUG] [LOCAL ] ARLO: Primary data saved (43883 records). [2025-10-30T17:17:35.610101] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-30T17:17:35.610192] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARLO took 42.1s. Estimated remaining: 4h 26m 53s. Rate: 8.3 symbols/min [2025-10-30T17:17:35.703004] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-30T17:17:35.784461] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:35.784860] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-10-30T17:17:35.784937] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-10-30T17:17:35.785126] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-30T17:17:35.785180] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-30T17:17:35.785223] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-30T17:17:35.785255] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-30T17:17:36.155107] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:36.182896] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:17:36.223870] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-30T17:17:36.497500] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-30T17:17:37.046899] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T17:17:37.058251] [INFO ] [REMOTE ] ARMK: Full fetch complete (72937 records). [2025-10-30T17:17:37.058445] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-30T17:17:37.306309] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-30T17:17:37.483313] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-30T17:17:37.483401] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-30T17:17:37.484135] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-30T17:17:37.484203] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-30T17:17:37.485587] [DEBUG] [LOCAL ] ARMK: Trimmed 72937 records to 50603 (keeping 200 days of data) [2025-10-30T17:17:37.778544] [DEBUG] [LOCAL ] ARMK: Primary data saved (50603 records). [2025-10-30T17:17:37.778704] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-30T17:17:37.778791] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARMK took 24.4s. Estimated remaining: 4h 25m 30s. Rate: 8.4 symbols/min [2025-10-30T17:17:37.953898] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:37.954212] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-30T17:17:37.954447] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-30T17:17:37.954757] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-30T17:17:37.955024] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-30T17:17:37.955294] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-30T17:17:37.955451] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-30T17:17:38.102095] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-30T17:17:38.277010] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-30T17:17:38.373341] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:38.402013] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T17:17:38.897501] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-30T17:17:39.051207] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:17:39.051500] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-30T17:17:39.051588] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:17:39.051636] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-30T17:17:39.051724] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:17:39.051818] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-30T17:17:39.051890] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-30T17:17:39.051945] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-30T17:17:39.051987] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-30T17:17:39.052032] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. ARX took 1.3s. Estimated remaining: 4h 23m 54s. Rate: 8.4 symbols/min [2025-10-30T17:17:39.226150] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:39.226380] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-10-30T17:17:39.226469] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-10-30T17:17:39.226594] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-30T17:17:39.226637] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-30T17:17:39.226724] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-30T17:17:39.226763] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-30T17:17:39.604467] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:39.630416] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T17:17:39.697530] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-30T17:17:40.497512] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-30T17:17:40.708199] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T17:17:41.297540] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-30T17:17:41.794257] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T17:17:42.097541] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-30T17:17:42.430381] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T17:17:42.897498] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-30T17:17:43.484930] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T17:17:43.697561] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-30T17:17:44.229310] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T17:17:44.497565] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-30T17:17:44.980215] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T17:17:45.297495] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-30T17:17:45.825953] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T17:17:46.097549] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-30T17:17:46.609915] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T17:17:46.897537] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-30T17:17:47.482786] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T17:17:47.697565] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-30T17:17:48.237863] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:17:48.497539] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-30T17:17:48.867736] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T17:17:49.297557] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-30T17:17:49.985855] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T17:17:50.097465] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-30T17:17:50.548233] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T17:17:50.897506] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-30T17:17:51.147518] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-30T17:17:51.697507] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-30T17:17:52.497480] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-30T17:17:52.674527] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T17:17:52.687144] [INFO ] [REMOTE ] ARR: Full fetch complete (75131 records). [2025-10-30T17:17:52.687318] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-30T17:17:52.688213] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:17:52.688310] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:17:52.688354] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:17:52.688395] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-30T17:17:52.688452] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-30T17:17:52.688492] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-30T17:17:52.688533] [DEBUG] [LOCAL ] ARR: No derivative data file found to delete. [2025-10-30T17:17:52.688589] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. ARR took 31.4s. Estimated remaining: 4h 25m 24s. Rate: 8.4 symbols/min [2025-10-30T17:17:52.855750] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:52.871975] [DEBUG] [LOCAL ] ASA: Loaded 15903 existing records from primary storage. [2025-10-30T17:17:52.872217] [INFO ] [MAIN ] ASA: Loaded 15903 existing records. [2025-10-30T17:17:53.054841] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:17:53.055038] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-30T17:17:53.055085] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-30T17:17:53.055333] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-30T17:17:53.055388] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-30T17:17:53.300891] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-30T17:17:53.412235] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:53.444064] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-30T17:17:53.614632] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T17:17:54.097498] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-30T17:17:54.338051] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T17:17:54.897491] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-30T17:17:55.512564] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-30T17:17:55.697500] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-30T17:17:56.498142] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T17:17:56.498229] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-30T17:17:56.511195] [INFO ] [REMOTE ] AROC: Full fetch complete (71471 records). [2025-10-30T17:17:56.511479] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-30T17:17:56.709854] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T17:17:56.933232] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-30T17:17:56.933318] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-30T17:17:56.934059] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-30T17:17:56.934123] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-30T17:17:56.935477] [DEBUG] [LOCAL ] AROC: Trimmed 71471 records to 49373 (keeping 200 days of data) [2025-10-30T17:17:57.225670] [DEBUG] [LOCAL ] AROC: Primary data saved (49373 records). [2025-10-30T17:17:57.225801] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-30T17:17:57.225883] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. AROC took 38.8s. Estimated remaining: 4h 24m 38s. Rate: 8.4 symbols/min [2025-10-30T17:17:57.305127] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-30T17:17:57.402997] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:17:57.403144] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-30T17:17:57.403182] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-30T17:17:57.403364] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-30T17:17:57.403419] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-30T17:17:57.403463] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-30T17:17:57.403496] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-30T17:17:57.769015] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:17:57.803959] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T17:17:58.015596] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-30T17:17:58.097516] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-30T17:17:58.635807] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-30T17:17:58.897511] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-30T17:17:59.697516] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-30T17:18:00.463882] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T17:18:00.497453] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-30T17:18:00.888747] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T17:18:01.297508] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-30T17:18:02.097500] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-30T17:18:02.173044] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T17:18:02.266833] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T17:18:02.897503] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-30T17:18:03.531581] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T17:18:03.697498] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-30T17:18:04.502696] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-30T17:18:04.526032] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T17:18:04.539675] [INFO ] [REMOTE ] AS: Full fetch complete (76953 records). [2025-10-30T17:18:04.539856] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-30T17:18:04.928774] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-30T17:18:04.928852] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-30T17:18:04.929583] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-30T17:18:04.929624] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-30T17:18:04.931059] [DEBUG] [LOCAL ] AS: Trimmed 76953 records to 53585 (keeping 200 days of data) [2025-10-30T17:18:05.176791] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T17:18:05.302923] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-30T17:18:05.307212] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-30T17:18:05.328783] [DEBUG] [LOCAL ] AS: Primary data saved (53585 records). [2025-10-30T17:18:05.328950] [INFO ] [MAIN ] AS: Full history saved. [2025-10-30T17:18:05.329040] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. AS took 26.3s. Estimated remaining: 4h 24m 44s. Rate: 8.4 symbols/min [2025-10-30T17:18:05.513603] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:18:05.557518] [DEBUG] [LOCAL ] ASB: Loaded 49645 existing records from primary storage. [2025-10-30T17:18:05.557869] [INFO ] [MAIN ] ASB: Loaded 49645 existing records. [2025-10-30T17:18:05.734125] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:18:05.734320] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-30T17:18:05.734367] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-30T17:18:05.735000] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-30T17:18:05.735057] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-30T17:18:06.089356] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:18:06.097452] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-30T17:18:06.162802] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T17:18:06.897499] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-30T17:18:07.322255] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T17:18:07.697514] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-30T17:18:08.108365] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T17:18:08.497549] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-30T17:18:08.687472] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:18:09.178706] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-30T17:18:09.297497] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-30T17:18:10.097480] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-30T17:18:10.432327] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T17:18:10.440757] [INFO ] [REMOTE ] ARW: Full fetch complete (48505 records). [2025-10-30T17:18:10.440914] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-30T17:18:10.441622] [FATAL] [VALIDATOR ] ARW: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:18:10.441899] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:18:10.441970] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:18:10.442046] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-30T17:18:10.442113] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-30T17:18:10.442152] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-10-30T17:18:10.442221] [DEBUG] [LOCAL ] ARW: No derivative data file found to delete. [2025-10-30T17:18:10.442301] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. ARW took 34.8s. Estimated remaining: 4h 24m 7s. Rate: 8.4 symbols/min [2025-10-30T17:18:10.656571] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:18:10.661364] [DEBUG] [LOCAL ] ASBA: Loaded 3421 existing records from primary storage. [2025-10-30T17:18:10.661544] [INFO ] [MAIN ] ASBA: Loaded 3421 existing records. [2025-10-30T17:18:10.884742] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:18:10.884982] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-30T17:18:10.885049] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-30T17:18:10.885219] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-30T17:18:10.885276] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-30T17:18:10.906512] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-30T17:18:11.257550] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:18:11.477666] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-30T17:18:11.627480] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T17:18:11.697462] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-30T17:18:12.497532] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-30T17:18:12.911765] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T17:18:13.297500] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-30T17:18:13.312723] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T17:18:14.097576] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-30T17:18:14.741481] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T17:18:14.897523] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-30T17:18:15.410869] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-30T17:18:15.483699] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-30T17:18:15.697495] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-30T17:18:16.284803] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-30T17:18:16.497494] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-30T17:18:17.297471] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-30T17:18:17.346780] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T17:18:18.097543] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-30T17:18:18.485533] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T17:18:18.897480] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-30T17:18:19.280836] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T17:18:19.492673] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:18:19.697511] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-30T17:18:20.223894] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T17:18:20.497498] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-30T17:18:21.297499] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-30T17:18:21.734006] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T17:18:22.097570] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-30T17:18:22.284034] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T17:18:22.290892] [INFO ] [REMOTE ] ASA: Full fetch complete (21132 records). [2025-10-30T17:18:22.291102] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-30T17:18:22.586079] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T17:18:22.708188] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-30T17:18:22.708271] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-30T17:18:22.708687] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-30T17:18:22.708764] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-30T17:18:22.709461] [DEBUG] [LOCAL ] ASA: Trimmed 21132 records to 16045 (keeping 200 days of data) [2025-10-30T17:18:22.804718] [DEBUG] [LOCAL ] ASA: Primary data saved (16045 records). [2025-10-30T17:18:22.804854] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-30T17:18:22.804935] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. ASA took 30.1s. Estimated remaining: 4h 25m 15s. Rate: 8.3 symbols/min [2025-10-30T17:18:22.905682] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-30T17:18:22.983940] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:18:23.017709] [DEBUG] [LOCAL ] ASC: Loaded 36904 existing records from primary storage. [2025-10-30T17:18:23.018024] [INFO ] [MAIN ] ASC: Loaded 36904 existing records. [2025-10-30T17:18:23.207458] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:18:23.207708] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-30T17:18:23.207767] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-30T17:18:23.208112] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-30T17:18:23.208151] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-30T17:18:23.568577] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:18:23.697476] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-30T17:18:24.316710] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-30T17:18:24.497549] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-30T17:18:24.861326] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T17:18:25.297515] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-30T17:18:26.000476] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T17:18:26.097529] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-30T17:18:26.512783] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T17:18:26.897525] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-30T17:18:27.316013] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T17:18:27.697522] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-30T17:18:28.155770] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-30T17:18:28.366593] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-30T17:18:28.497524] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-30T17:18:29.297585] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-30T17:18:29.919740] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T17:18:30.097501] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-30T17:18:30.701955] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T17:18:30.897504] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-30T17:18:31.429522] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T17:18:31.697509] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-30T17:18:32.208700] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T17:18:32.338208] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T17:18:32.354232] [INFO ] [REMOTE ] ASB: Full fetch complete (72383 records). [2025-10-30T17:18:32.354374] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-30T17:18:32.501046] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-30T17:18:32.742115] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-30T17:18:32.742191] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-30T17:18:32.742913] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-30T17:18:32.742974] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-30T17:18:32.744276] [DEBUG] [LOCAL ] ASB: Trimmed 72383 records to 50031 (keeping 200 days of data) [2025-10-30T17:18:32.950251] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-30T17:18:33.041860] [DEBUG] [LOCAL ] ASB: Primary data saved (50031 records). [2025-10-30T17:18:33.041989] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-30T17:18:33.042888] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASB took 27.7s. Estimated remaining: 4h 25m 52s. Rate: 8.3 symbols/min [2025-10-30T17:18:33.207861] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:18:33.225337] [DEBUG] [LOCAL ] ASG: Loaded 19053 existing records from primary storage. [2025-10-30T17:18:33.225585] [INFO ] [MAIN ] ASG: Loaded 19053 existing records. [2025-10-30T17:18:33.302680] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-30T17:18:33.402631] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:18:33.402834] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-30T17:18:33.402881] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-30T17:18:33.403093] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-30T17:18:33.403130] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-30T17:18:33.758986] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:18:33.759287] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T17:18:34.097558] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-30T17:18:34.897560] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-30T17:18:35.113097] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T17:18:35.260320] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T17:18:35.697548] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-30T17:18:36.497505] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-30T17:18:36.847147] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T17:18:37.297496] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-30T17:18:37.414619] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:18:38.097508] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-30T17:18:38.267088] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T17:18:38.772414] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T17:18:38.897484] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-30T17:18:39.546193] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T17:18:39.547869] [INFO ] [REMOTE ] ASBA: Full fetch complete (5160 records). [2025-10-30T17:18:39.547966] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-30T17:18:39.702621] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-30T17:18:39.983470] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-30T17:18:39.983553] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-30T17:18:39.983762] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-30T17:18:39.983825] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-30T17:18:39.984219] [DEBUG] [LOCAL ] ASBA: Trimmed 5160 records to 3492 (keeping 200 days of data) [2025-10-30T17:18:40.008603] [DEBUG] [LOCAL ] ASBA: Primary data saved (3492 records). [2025-10-30T17:18:40.008767] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-30T17:18:40.008856] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASBA took 29.6s. Estimated remaining: 4h 25m 41s. Rate: 8.3 symbols/min [2025-10-30T17:18:40.211593] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:18:40.233412] [DEBUG] [LOCAL ] ASGI: Loaded 22616 existing records from primary storage. [2025-10-30T17:18:40.233698] [INFO ] [MAIN ] ASGI: Loaded 22616 existing records. [2025-10-30T17:18:40.432200] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:18:40.432436] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-30T17:18:40.432507] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-30T17:18:40.432895] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-30T17:18:40.432965] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-30T17:18:40.502776] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-30T17:18:40.842235] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:18:40.867887] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T17:18:41.297483] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-30T17:18:41.338221] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T17:18:42.097462] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-30T17:18:42.140221] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T17:18:42.897489] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-30T17:18:43.363246] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T17:18:43.559189] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-30T17:18:43.697531] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-30T17:18:44.497493] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-30T17:18:44.533611] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T17:18:45.226165] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T17:18:45.297466] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-30T17:18:46.045447] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T17:18:46.097481] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-30T17:18:46.897544] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-30T17:18:47.667819] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-30T17:18:47.697456] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-30T17:18:47.805128] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-30T17:18:47.816994] [INFO ] [REMOTE ] ASAN: Full fetch complete (76235 records). [2025-10-30T17:18:47.817186] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-30T17:18:47.817921] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:18:47.818008] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:18:47.818052] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:18:47.818093] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-30T17:18:47.818151] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-30T17:18:47.818188] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-10-30T17:18:47.818229] [DEBUG] [LOCAL ] ASAN: No derivative data file found to delete. [2025-10-30T17:18:47.818287] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASAN took 50.6s. Estimated remaining: 4h 25m 42s. Rate: 8.3 symbols/min [2025-10-30T17:18:47.997055] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:18:47.997267] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-10-30T17:18:47.997312] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-10-30T17:18:47.997418] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-30T17:18:47.997458] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-30T17:18:47.997499] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-30T17:18:47.997530] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-30T17:18:48.349010] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:18:48.497494] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-30T17:18:48.929238] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:18:49.257786] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-30T17:18:49.297472] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-30T17:18:49.991216] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T17:18:50.097512] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-30T17:18:50.860483] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T17:18:50.897463] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-30T17:18:51.697472] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-30T17:18:51.731781] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-30T17:18:52.473990] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T17:18:52.497453] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-30T17:18:53.297468] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-30T17:18:53.341598] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-30T17:18:54.097533] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-30T17:18:54.543547] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T17:18:54.551801] [INFO ] [REMOTE ] ASC: Full fetch complete (55719 records). [2025-10-30T17:18:54.551911] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-30T17:18:54.902087] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-30T17:18:54.939255] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-30T17:18:54.939321] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-30T17:18:54.940016] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-30T17:18:54.940096] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-30T17:18:54.941228] [DEBUG] [LOCAL ] ASC: Trimmed 55719 records to 37172 (keeping 200 days of data) [2025-10-30T17:18:55.154957] [DEBUG] [LOCAL ] ASC: Primary data saved (37172 records). [2025-10-30T17:18:55.155097] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-30T17:18:55.155706] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASC took 32.4s. Estimated remaining: 4h 25m 37s. Rate: 8.3 symbols/min [2025-10-30T17:18:55.364556] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T17:18:55.517186] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T17:18:55.697488] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-30T17:18:56.497457] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-30T17:18:56.705328] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T17:18:57.257919] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-30T17:18:57.297475] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-30T17:18:58.097513] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-30T17:18:58.514327] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T17:18:58.897492] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-30T17:18:59.020884] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-30T17:18:59.697520] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-30T17:19:00.219239] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T17:19:00.497502] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-30T17:19:00.785428] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T17:19:00.791066] [INFO ] [REMOTE ] ASGI: Full fetch complete (32587 records). [2025-10-30T17:19:00.791213] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-30T17:19:01.175245] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-30T17:19:01.175335] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-30T17:19:01.175773] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-30T17:19:01.175835] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-30T17:19:01.176829] [DEBUG] [LOCAL ] ASGI: Trimmed 32587 records to 22821 (keeping 200 days of data) [2025-10-30T17:19:01.303582] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-30T17:19:01.312228] [DEBUG] [LOCAL ] ASGI: Primary data saved (22821 records). [2025-10-30T17:19:01.313265] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-30T17:19:01.313355] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASGI took 21.3s. Estimated remaining: 4h 25m 15s. Rate: 8.3 symbols/min [2025-10-30T17:19:04.498036] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (4.00 seconds). [2025-10-30T17:19:04.502399] [INFO ] [REMOTE ] ASG: Full fetch complete (30408 records). [2025-10-30T17:19:04.502507] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-30T17:19:04.869998] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-30T17:19:04.870066] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-30T17:19:04.870476] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-30T17:19:04.870515] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-30T17:19:04.871194] [DEBUG] [LOCAL ] ASG: Trimmed 30408 records to 19163 (keeping 200 days of data) [2025-10-30T17:19:04.977423] [DEBUG] [LOCAL ] ASG: Primary data saved (19163 records). [2025-10-30T17:19:04.977549] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-30T17:19:04.977624] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASG took 31.9s. Estimated remaining: 4h 24m 18s. Rate: 8.4 symbols/min [2025-10-30T17:19:05.304169] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (4.00 seconds). [2025-10-30T17:19:05.311020] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-30T17:19:06.532182] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T17:19:06.542585] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-30T17:19:07.851098] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T17:19:07.859602] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-30T17:19:08.887481] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T17:19:08.895954] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-30T17:19:10.170829] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T17:19:10.179276] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-30T17:19:11.606752] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T17:19:11.615496] [INFO ] [REMOTE ] ASGN: Full fetch complete (53816 records). [2025-10-30T17:19:11.615592] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-30T17:19:11.616219] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:19:11.616302] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:19:11.616370] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:19:11.616464] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-30T17:19:11.616528] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-30T17:19:11.616564] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-10-30T17:19:11.616603] [DEBUG] [LOCAL ] ASGN: No derivative data file found to delete. [2025-10-30T17:19:11.616700] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASGN took 23.8s. Estimated remaining: 4h 24m 4s. Rate: 8.4 symbols/min [2025-10-30T17:19:12.166814] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:12.205711] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:12.313257] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:12.357087] [DEBUG] [LOCAL ] ASIX: Loaded 22683 existing records from primary storage. [2025-10-30T17:19:12.356626] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:12.358041] [INFO ] [MAIN ] ASIX: Loaded 22683 existing records. [2025-10-30T17:19:12.465411] [DEBUG] [LOCAL ] ASR: Loaded 9402 existing records from primary storage. [2025-10-30T17:19:12.479204] [INFO ] [MAIN ] ASR: Loaded 9402 existing records. [2025-10-30T17:19:12.569378] [DEBUG] [LOCAL ] ASH: Loaded 36975 existing records from primary storage. [2025-10-30T17:19:12.599733] [INFO ] [MAIN ] ASH: Loaded 36975 existing records. [2025-10-30T17:19:12.656552] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:19:12.680215] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-30T17:19:12.722066] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-30T17:19:12.728155] [DEBUG] [LOCAL ] ASPN: Loaded 49744 existing records from primary storage. [2025-10-30T17:19:12.748874] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-30T17:19:12.769958] [INFO ] [MAIN ] ASPN: Loaded 49744 existing records. [2025-10-30T17:19:12.769835] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-30T17:19:13.269532] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:19:13.273333] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-30T17:19:13.289009] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-30T17:19:13.273006] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:19:13.339164] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-30T17:19:13.342118] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:19:13.343709] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-30T17:19:13.322635] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-30T17:19:13.362926] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-30T17:19:13.372240] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-30T17:19:13.401928] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-30T17:19:13.416382] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-30T17:19:13.441355] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-30T17:19:13.421704] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-30T17:19:13.499253] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-30T17:19:14.048137] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:14.096176] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-30T17:19:14.518532] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:14.549237] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-30T17:19:14.604730] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:14.616456] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-30T17:19:14.648667] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:14.648993] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-30T17:19:15.112832] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T17:19:15.121841] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-30T17:19:15.175799] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T17:19:15.178356] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-30T17:19:15.666073] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T17:19:15.670169] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-30T17:19:15.854365] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T17:19:15.853417] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:19:15.863495] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-30T17:19:15.869885] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-30T17:19:16.084794] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T17:19:16.095178] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-30T17:19:16.480794] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T17:19:16.482904] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-30T17:19:16.619805] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-30T17:19:16.624593] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-30T17:19:16.851930] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:19:16.859454] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-30T17:19:16.943444] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-30T17:19:16.946226] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-30T17:19:17.436260] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:19:17.445910] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-30T17:19:17.508233] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-30T17:19:17.562767] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-30T17:19:17.998415] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T17:19:18.097508] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-30T17:19:18.714679] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T17:19:18.897500] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-30T17:19:19.373219] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T17:19:19.461956] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T17:19:19.697509] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-30T17:19:20.444341] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T17:19:20.497485] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-30T17:19:21.297532] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-30T17:19:21.355960] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T17:19:21.934317] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-30T17:19:22.097482] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-30T17:19:22.726421] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T17:19:22.897495] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-30T17:19:23.697513] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-30T17:19:24.110764] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T17:19:24.497493] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-30T17:19:24.658343] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T17:19:25.297565] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-30T17:19:25.757770] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T17:19:26.097562] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-30T17:19:26.505601] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T17:19:26.693520] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T17:19:26.897495] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-30T17:19:27.697516] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-30T17:19:27.960470] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T17:19:28.497516] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-30T17:19:28.905611] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T17:19:29.023299] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T17:19:29.297497] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-30T17:19:30.097466] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-30T17:19:30.135371] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-30T17:19:30.897491] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-30T17:19:31.162998] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-30T17:19:31.697485] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-30T17:19:32.032226] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T17:19:32.459418] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T17:19:32.461831] [INFO ] [REMOTE ] ASR: Full fetch complete (12665 records). [2025-10-30T17:19:32.461900] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-30T17:19:32.502730] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-30T17:19:32.829801] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-30T17:19:32.829880] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-30T17:19:32.830190] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-30T17:19:32.830229] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-30T17:19:32.830710] [DEBUG] [LOCAL ] ASR: Trimmed 12665 records to 9477 (keeping 200 days of data) [2025-10-30T17:19:32.889848] [DEBUG] [LOCAL ] ASR: Primary data saved (9477 records). [2025-10-30T17:19:32.889978] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-30T17:19:32.890055] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASR took 21.3s. Estimated remaining: 4h 27m 10s. Rate: 8.3 symbols/min [2025-10-30T17:19:33.056118] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:33.105976] [DEBUG] [LOCAL ] ASX: Loaded 52851 existing records from primary storage. [2025-10-30T17:19:33.106285] [INFO ] [MAIN ] ASX: Loaded 52851 existing records. [2025-10-30T17:19:33.292492] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:19:33.292768] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-30T17:19:33.292835] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-30T17:19:33.293312] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-30T17:19:33.293379] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-30T17:19:33.304699] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-30T17:19:33.764618] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:33.863635] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T17:19:34.097491] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-30T17:19:34.463013] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T17:19:34.897484] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-30T17:19:35.305008] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T17:19:35.697484] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-30T17:19:35.836697] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T17:19:35.841950] [INFO ] [REMOTE ] ASIX: Full fetch complete (31150 records). [2025-10-30T17:19:35.842026] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-30T17:19:36.210317] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-30T17:19:36.210390] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-30T17:19:36.210796] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-30T17:19:36.210874] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-30T17:19:36.211557] [DEBUG] [LOCAL ] ASIX: Trimmed 31150 records to 22882 (keeping 200 days of data) [2025-10-30T17:19:36.341745] [DEBUG] [LOCAL ] ASIX: Primary data saved (22882 records). [2025-10-30T17:19:36.341859] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-30T17:19:36.341933] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASIX took 24.7s. Estimated remaining: 4h 26m 10s. Rate: 8.3 symbols/min [2025-10-30T17:19:36.510985] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-30T17:19:36.513562] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:36.514598] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-10-30T17:19:36.514666] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-10-30T17:19:36.514780] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-30T17:19:36.514821] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-30T17:19:36.514865] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-10-30T17:19:36.514896] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-30T17:19:36.869498] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:37.297489] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-30T17:19:37.956824] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-30T17:19:38.097459] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-30T17:19:38.394032] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-30T17:19:38.697871] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T17:19:38.897486] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-30T17:19:39.386683] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T17:19:39.395262] [INFO ] [REMOTE ] ASH: Full fetch complete (55587 records). [2025-10-30T17:19:39.395390] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-30T17:19:39.702619] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-30T17:19:39.773671] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-30T17:19:39.773759] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-30T17:19:39.774335] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-30T17:19:39.774430] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-30T17:19:39.775817] [DEBUG] [LOCAL ] ASH: Trimmed 55587 records to 37277 (keeping 200 days of data) [2025-10-30T17:19:39.993827] [DEBUG] [LOCAL ] ASH: Primary data saved (37277 records). [2025-10-30T17:19:39.993959] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-30T17:19:39.994038] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASH took 28.4s. Estimated remaining: 4h 25m 14s. Rate: 8.3 symbols/min [2025-10-30T17:19:40.164021] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:40.192322] [DEBUG] [LOCAL ] ATGE: Loaded 29806 existing records from primary storage. [2025-10-30T17:19:40.192592] [INFO ] [MAIN ] ATGE: Loaded 29806 existing records. [2025-10-30T17:19:40.378619] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:19:40.378909] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-30T17:19:40.378961] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-30T17:19:40.379253] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-30T17:19:40.379303] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-30T17:19:40.499341] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-30T17:19:40.754022] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:40.788187] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-30T17:19:40.800267] [INFO ] [REMOTE ] ASPN: Full fetch complete (72197 records). [2025-10-30T17:19:40.800518] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-30T17:19:40.801461] [FATAL] [VALIDATOR ] ASPN: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:19:40.801554] [FATAL] [MAIN ] ASPN: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:19:40.801599] [WARN ] [MAIN ] ASPN: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:19:40.801700] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-30T17:19:40.801794] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-10-30T17:19:40.801833] [INFO ] [LOCAL ] ASPN: Starting deletion of derivative data. [2025-10-30T17:19:40.802194] [DEBUG] [LOCAL ] ASPN: Deleted derivative data file. [2025-10-30T17:19:40.802475] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASPN took 29.2s. Estimated remaining: 4h 23m 41s. Rate: 8.4 symbols/min [2025-10-30T17:19:40.970190] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:19:40.998992] [DEBUG] [LOCAL ] ATHM: Loaded 30389 existing records from primary storage. [2025-10-30T17:19:40.999281] [INFO ] [MAIN ] ATHM: Loaded 30389 existing records. [2025-10-30T17:19:41.185215] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:19:41.185586] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-30T17:19:41.185735] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-30T17:19:41.186045] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-30T17:19:41.186181] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-30T17:19:41.297728] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-30T17:19:41.394837] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-30T17:19:41.591402] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:19:41.681555] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T17:19:42.097489] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-30T17:19:42.336112] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T17:19:42.897516] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-30T17:19:43.415186] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:19:43.697495] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-30T17:19:43.929092] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T17:19:44.497506] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-30T17:19:45.117639] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T17:19:45.297495] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-30T17:19:45.650623] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T17:19:46.097513] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-30T17:19:46.680190] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T17:19:46.897508] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-30T17:19:47.141900] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T17:19:47.697544] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-30T17:19:48.152756] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T17:19:48.497505] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-30T17:19:49.175442] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T17:19:49.297501] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-30T17:19:50.033722] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T17:19:50.097474] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-30T17:19:50.294060] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:19:50.897482] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-30T17:19:51.268902] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-30T17:19:51.697530] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-30T17:19:51.923041] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:19:52.497503] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-30T17:19:52.944088] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T17:19:53.297556] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-30T17:19:53.576999] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-30T17:19:54.097486] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-30T17:19:54.447331] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T17:19:54.897508] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-30T17:19:55.070260] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T17:19:55.697497] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-30T17:19:56.332523] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T17:19:56.497505] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-30T17:19:56.768854] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-30T17:19:57.297466] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-30T17:19:57.416817] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T17:19:58.097462] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-30T17:19:58.189025] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T17:19:58.897467] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-30T17:19:59.053685] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T17:19:59.696741] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-30T17:19:59.702042] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-30T17:20:00.497484] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-30T17:20:00.807010] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T17:20:01.297503] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-30T17:20:01.966743] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-30T17:20:02.097497] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-30T17:20:02.897550] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-30T17:20:03.227495] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T17:20:03.680943] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T17:20:03.697502] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-30T17:20:04.497575] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-30T17:20:04.791040] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T17:20:04.798259] [INFO ] [REMOTE ] ATHM: Full fetch complete (48592 records). [2025-10-30T17:20:04.798486] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-30T17:20:04.799437] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:20:04.799558] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:20:04.799602] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:20:04.799670] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-30T17:20:04.799784] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-30T17:20:04.799860] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-10-30T17:20:04.800129] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-10-30T17:20:04.800231] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ATHM took 24.0s. Estimated remaining: 4h 27m 18s. Rate: 8.2 symbols/min [2025-10-30T17:20:04.989933] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:05.001972] [DEBUG] [LOCAL ] ATHS: Loaded 6258 existing records from primary storage. [2025-10-30T17:20:05.002246] [INFO ] [MAIN ] ATHS: Loaded 6258 existing records. [2025-10-30T17:20:05.179024] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:05.179259] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-30T17:20:05.179316] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-30T17:20:05.179496] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-30T17:20:05.179532] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-30T17:20:05.298842] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-30T17:20:05.550188] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:05.579442] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (4.28 seconds). [2025-10-30T17:20:05.637122] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T17:20:06.097458] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-30T17:20:06.302907] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T17:20:06.897526] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-30T17:20:07.454868] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T17:20:07.697520] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-30T17:20:08.218139] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-30T17:20:08.231229] [INFO ] [REMOTE ] ASX: Full fetch complete (76796 records). [2025-10-30T17:20:08.231426] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-30T17:20:08.502677] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-30T17:20:08.742804] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-30T17:20:08.742930] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-30T17:20:08.744080] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-30T17:20:08.744226] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-30T17:20:08.746291] [DEBUG] [LOCAL ] ASX: Trimmed 76796 records to 53241 (keeping 200 days of data) [2025-10-30T17:20:08.884006] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T17:20:09.145516] [DEBUG] [LOCAL ] ASX: Primary data saved (53241 records). [2025-10-30T17:20:09.145675] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-30T17:20:09.145775] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ASX took 36.3s. Estimated remaining: 4h 26m 32s. Rate: 8.3 symbols/min [2025-10-30T17:20:09.302639] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-30T17:20:09.350982] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:09.400324] [DEBUG] [LOCAL ] ATI: Loaded 51265 existing records from primary storage. [2025-10-30T17:20:09.400661] [INFO ] [MAIN ] ATI: Loaded 51265 existing records. [2025-10-30T17:20:09.616142] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:09.616519] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-30T17:20:09.616594] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-30T17:20:09.617114] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-30T17:20:09.617171] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-30T17:20:09.775924] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T17:20:09.960969] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T17:20:10.013594] [INFO ] [REMOTE ] ATEN: Full fetch complete (56181 records). [2025-10-30T17:20:10.027255] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-30T17:20:10.039063] [FATAL] [VALIDATOR ] ATEN: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:20:10.044318] [FATAL] [MAIN ] ATEN: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:20:10.049521] [WARN ] [MAIN ] ATEN: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:20:10.054744] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-30T17:20:10.079244] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-10-30T17:20:10.089441] [INFO ] [LOCAL ] ATEN: Starting deletion of derivative data. [2025-10-30T17:20:10.097735] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-30T17:20:10.096340] [DEBUG] [LOCAL ] ATEN: No derivative data file found to delete. [2025-10-30T17:20:10.100476] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ATEN took 33.8s. Estimated remaining: 4h 25m 2s. Rate: 8.3 symbols/min [2025-10-30T17:20:10.137307] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:10.349621] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:10.385297] [DEBUG] [LOCAL ] ATKR: Loaded 34257 existing records from primary storage. [2025-10-30T17:20:10.385707] [INFO ] [MAIN ] ATKR: Loaded 34257 existing records. [2025-10-30T17:20:10.570914] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:10.571216] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-30T17:20:10.571269] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-30T17:20:10.571850] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-30T17:20:10.571908] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-30T17:20:10.902590] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-30T17:20:10.976195] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:11.270752] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T17:20:11.455731] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-30T17:20:11.697548] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-30T17:20:12.497705] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-30T17:20:12.925099] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:20:13.297505] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-30T17:20:14.097491] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-30T17:20:14.514030] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T17:20:14.542767] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T17:20:14.897503] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-30T17:20:15.034518] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-30T17:20:15.040514] [INFO ] [REMOTE ] ATGE: Full fetch complete (45128 records). [2025-10-30T17:20:15.040617] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-30T17:20:15.041254] [FATAL] [VALIDATOR ] ATGE: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:20:15.041340] [FATAL] [MAIN ] ATGE: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:20:15.041382] [WARN ] [MAIN ] ATGE: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:20:15.041420] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-30T17:20:15.041474] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-10-30T17:20:15.041512] [INFO ] [LOCAL ] ATGE: Starting deletion of derivative data. [2025-10-30T17:20:15.041724] [DEBUG] [LOCAL ] ATGE: Deleted derivative data file. [2025-10-30T17:20:15.041824] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATGE took 35.0s. Estimated remaining: 4h 24m 24s. Rate: 8.3 symbols/min [2025-10-30T17:20:15.210790] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:15.243623] [DEBUG] [LOCAL ] ATMU: Loaded 38046 existing records from primary storage. [2025-10-30T17:20:15.243922] [INFO ] [MAIN ] ATMU: Loaded 38046 existing records. [2025-10-30T17:20:15.419360] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:15.419556] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-30T17:20:15.419603] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-30T17:20:15.419920] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-30T17:20:15.419972] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-30T17:20:15.702705] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-30T17:20:15.770429] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:16.497465] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-30T17:20:16.528636] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-30T17:20:16.921987] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-30T17:20:16.968937] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T17:20:17.297499] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-30T17:20:18.097485] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-30T17:20:18.508503] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T17:20:18.897570] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-30T17:20:19.117788] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T17:20:19.697554] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-30T17:20:20.378939] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T17:20:20.497521] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-30T17:20:20.690886] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T17:20:21.297487] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-30T17:20:21.780960] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T17:20:22.097491] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-30T17:20:22.695095] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:20:22.897488] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-30T17:20:23.076122] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T17:20:23.553031] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-30T17:20:23.697737] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-30T17:20:24.497501] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-30T17:20:24.797888] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T17:20:25.297513] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-30T17:20:25.716747] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-30T17:20:25.851331] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T17:20:26.097487] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-30T17:20:26.897494] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-30T17:20:27.196203] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-30T17:20:27.353890] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T17:20:27.697551] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-30T17:20:28.099577] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T17:20:28.497550] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-30T17:20:29.297497] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-30T17:20:29.732696] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T17:20:30.097554] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-30T17:20:30.766179] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-30T17:20:30.768019] [INFO ] [REMOTE ] ATHS: Full fetch complete (9476 records). [2025-10-30T17:20:30.768094] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-30T17:20:30.899205] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-30T17:20:31.203140] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-30T17:20:31.242068] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-30T17:20:31.258729] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-30T17:20:31.257633] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-30T17:20:31.258888] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-30T17:20:31.270262] [DEBUG] [LOCAL ] ATHS: Trimmed 9476 records to 6294 (keeping 200 days of data) [2025-10-30T17:20:31.310726] [DEBUG] [LOCAL ] ATHS: Primary data saved (6294 records). [2025-10-30T17:20:31.310841] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-30T17:20:31.310919] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHS took 26.5s. Estimated remaining: 4h 26m 15s. Rate: 8.3 symbols/min [2025-10-30T17:20:31.502123] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:31.543390] [DEBUG] [LOCAL ] ATO: Loaded 41182 existing records from primary storage. [2025-10-30T17:20:31.543786] [INFO ] [MAIN ] ATO: Loaded 41182 existing records. [2025-10-30T17:20:31.698880] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-30T17:20:31.737259] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:31.737800] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-30T17:20:31.737866] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-30T17:20:31.738402] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-30T17:20:31.738590] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-30T17:20:32.036117] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T17:20:32.153802] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:32.497498] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-30T17:20:32.858416] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T17:20:33.297465] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-30T17:20:33.476414] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T17:20:34.097528] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-30T17:20:34.481574] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:20:34.897529] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-30T17:20:35.697524] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-30T17:20:35.742042] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-30T17:20:36.035682] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T17:20:36.497536] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-30T17:20:36.703318] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-30T17:20:37.297538] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-30T17:20:37.730494] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:20:38.097469] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-30T17:20:38.288486] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-30T17:20:38.897587] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-30T17:20:39.650312] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T17:20:39.662459] [INFO ] [REMOTE ] ATI: Full fetch complete (74232 records). [2025-10-30T17:20:39.662802] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-30T17:20:39.702877] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-30T17:20:40.110527] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-30T17:20:40.110720] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-30T17:20:40.111865] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-30T17:20:40.112041] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-30T17:20:40.145063] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T17:20:40.143999] [DEBUG] [LOCAL ] ATI: Trimmed 74232 records to 51636 (keeping 200 days of data) [2025-10-30T17:20:40.501151] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-30T17:20:40.515214] [DEBUG] [LOCAL ] ATI: Primary data saved (51636 records). [2025-10-30T17:20:40.515428] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-30T17:20:40.515534] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATI took 31.4s. Estimated remaining: 4h 26m 32s. Rate: 8.2 symbols/min [2025-10-30T17:20:40.703668] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:40.743602] [DEBUG] [LOCAL ] ATR: Loaded 30454 existing records from primary storage. [2025-10-30T17:20:40.744046] [INFO ] [MAIN ] ATR: Loaded 30454 existing records. [2025-10-30T17:20:40.945165] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:40.945595] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-30T17:20:40.945747] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-30T17:20:40.946412] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-30T17:20:40.946538] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-30T17:20:41.173430] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-30T17:20:41.302704] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-30T17:20:41.377264] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:41.583382] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T17:20:42.097499] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-30T17:20:42.538706] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T17:20:42.897524] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-30T17:20:43.019698] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:20:43.697508] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-30T17:20:44.140177] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T17:20:44.148616] [INFO ] [REMOTE ] ATMU: Full fetch complete (56541 records). [2025-10-30T17:20:44.148797] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-30T17:20:44.502614] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-30T17:20:44.544088] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-30T17:20:44.544172] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-30T17:20:44.544801] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-30T17:20:44.544865] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-30T17:20:44.546073] [DEBUG] [LOCAL ] ATMU: Trimmed 56541 records to 38328 (keeping 200 days of data) [2025-10-30T17:20:44.769228] [DEBUG] [LOCAL ] ATMU: Primary data saved (38328 records). [2025-10-30T17:20:44.769361] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-30T17:20:44.770070] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATMU took 29.7s. Estimated remaining: 4h 25m 46s. Rate: 8.3 symbols/min [2025-10-30T17:20:44.942964] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:44.959375] [DEBUG] [LOCAL ] ATS: Loaded 16477 existing records from primary storage. [2025-10-30T17:20:44.959596] [INFO ] [MAIN ] ATS: Loaded 16477 existing records. [2025-10-30T17:20:45.136805] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:45.137362] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-30T17:20:45.137510] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-30T17:20:45.137887] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-30T17:20:45.137954] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-30T17:20:45.306330] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-30T17:20:45.394426] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-30T17:20:45.553679] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:45.577398] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T17:20:46.097504] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-30T17:20:46.746608] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T17:20:46.897532] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-30T17:20:47.120974] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T17:20:47.697526] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-30T17:20:47.945850] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T17:20:47.957440] [INFO ] [REMOTE ] ATKR: Full fetch complete (52795 records). [2025-10-30T17:20:47.957701] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-30T17:20:48.432534] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-30T17:20:48.432623] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-30T17:20:48.433380] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-30T17:20:48.433446] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-30T17:20:48.434769] [DEBUG] [LOCAL ] ATKR: Trimmed 52795 records to 34484 (keeping 200 days of data) [2025-10-30T17:20:48.500770] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-30T17:20:48.670462] [DEBUG] [LOCAL ] ATKR: Primary data saved (34484 records). [2025-10-30T17:20:48.670609] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-30T17:20:48.670727] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATKR took 38.6s. Estimated remaining: 4h 24m 56s. Rate: 8.3 symbols/min [2025-10-30T17:20:48.842321] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:20:48.882599] [DEBUG] [LOCAL ] ATUS: Loaded 49981 existing records from primary storage. [2025-10-30T17:20:48.883127] [INFO ] [MAIN ] ATUS: Loaded 49981 existing records. [2025-10-30T17:20:49.064993] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:20:49.065317] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-30T17:20:49.065385] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-30T17:20:49.065847] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-30T17:20:49.065907] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-30T17:20:49.189454] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-30T17:20:49.306069] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-30T17:20:49.466221] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:20:49.479058] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T17:20:50.097506] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-30T17:20:50.518231] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T17:20:50.897505] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-30T17:20:51.207586] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T17:20:51.697495] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-30T17:20:52.344785] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T17:20:52.497520] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-30T17:20:52.930858] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T17:20:53.208629] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-30T17:20:53.297505] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-30T17:20:53.880395] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-30T17:20:54.097513] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-30T17:20:54.897526] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-30T17:20:55.573499] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-30T17:20:55.697493] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-30T17:20:56.357243] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T17:20:56.401726] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-30T17:20:56.497504] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-30T17:20:57.066763] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-30T17:20:57.297498] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-30T17:20:58.097484] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-30T17:20:58.644567] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T17:20:58.897529] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-30T17:20:59.250036] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T17:20:59.697497] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-30T17:21:00.497751] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-30T17:21:00.515892] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-30T17:21:00.538296] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T17:21:00.537869] [INFO ] [REMOTE ] ATO: Full fetch complete (60511 records). [2025-10-30T17:21:00.538488] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-30T17:21:00.952352] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-30T17:21:00.952459] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-30T17:21:00.953113] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-30T17:21:00.953175] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-30T17:21:00.954344] [DEBUG] [LOCAL ] ATO: Trimmed 60511 records to 41461 (keeping 200 days of data) [2025-10-30T17:21:01.210541] [DEBUG] [LOCAL ] ATO: Primary data saved (41461 records). [2025-10-30T17:21:01.210708] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-30T17:21:01.210811] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATO took 29.9s. Estimated remaining: 4h 25m 56s. Rate: 8.2 symbols/min [2025-10-30T17:21:01.302694] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-30T17:21:01.383818] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:01.437365] [DEBUG] [LOCAL ] AU: Loaded 53072 existing records from primary storage. [2025-10-30T17:21:01.437755] [INFO ] [MAIN ] AU: Loaded 53072 existing records. [2025-10-30T17:21:01.638447] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:21:01.638714] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-30T17:21:01.638815] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-30T17:21:01.639077] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-30T17:21:01.639118] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-30T17:21:02.019066] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:02.064133] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-30T17:21:02.097458] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-30T17:21:02.641209] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:21:02.897507] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-30T17:21:03.335170] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T17:21:03.687551] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-30T17:21:03.697466] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-30T17:21:04.497544] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-30T17:21:04.889432] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T17:21:05.297472] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-30T17:21:05.927338] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T17:21:06.031131] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T17:21:06.097499] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-30T17:21:06.897528] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-30T17:21:07.436401] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:21:07.697541] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-30T17:21:07.933730] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T17:21:08.497518] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-30T17:21:08.906477] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T17:21:09.297498] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-30T17:21:09.970782] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-30T17:21:10.097504] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-30T17:21:10.614230] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:21:10.845994] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-30T17:21:10.897482] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-30T17:21:11.697483] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-30T17:21:11.787947] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T17:21:11.791233] [INFO ] [REMOTE ] ATS: Full fetch complete (25103 records). [2025-10-30T17:21:11.791315] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-30T17:21:12.155662] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-30T17:21:12.155792] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-30T17:21:12.156180] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-30T17:21:12.156222] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-30T17:21:12.157035] [DEBUG] [LOCAL ] ATS: Trimmed 25103 records to 16622 (keeping 200 days of data) [2025-10-30T17:21:12.253251] [DEBUG] [LOCAL ] ATS: Primary data saved (16622 records). [2025-10-30T17:21:12.253427] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-30T17:21:12.253558] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATS took 27.5s. Estimated remaining: 4h 26m 36s. Rate: 8.2 symbols/min [2025-10-30T17:21:12.422144] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:12.471137] [DEBUG] [LOCAL ] AUB: Loaded 45587 existing records from primary storage. [2025-10-30T17:21:12.471539] [INFO ] [MAIN ] AUB: Loaded 45587 existing records. [2025-10-30T17:21:12.505292] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-30T17:21:12.653129] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:21:12.653334] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-30T17:21:12.653381] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-30T17:21:12.653938] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-30T17:21:12.653994] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-30T17:21:13.014100] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:13.310021] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-30T17:21:13.320724] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-30T17:21:13.705305] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T17:21:14.097566] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-30T17:21:14.468760] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T17:21:14.897544] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-30T17:21:15.697534] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-30T17:21:15.849716] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-30T17:21:16.224214] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T17:21:16.497544] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-30T17:21:16.674701] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T17:21:17.297568] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-30T17:21:18.097473] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-30T17:21:18.217354] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-30T17:21:18.392806] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T17:21:18.897526] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-30T17:21:19.538588] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T17:21:19.549885] [INFO ] [REMOTE ] ATUS: Full fetch complete (71454 records). [2025-10-30T17:21:19.550033] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-30T17:21:19.702595] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-30T17:21:19.968832] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-30T17:21:19.968921] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-30T17:21:19.969629] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-30T17:21:19.969717] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-30T17:21:19.971144] [DEBUG] [LOCAL ] ATUS: Trimmed 71454 records to 50351 (keeping 200 days of data) [2025-10-30T17:21:20.255996] [DEBUG] [LOCAL ] ATUS: Primary data saved (50351 records). [2025-10-30T17:21:20.256156] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-30T17:21:20.256369] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATUS took 31.6s. Estimated remaining: 4h 26m 38s. Rate: 8.2 symbols/min [2025-10-30T17:21:20.458195] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:20.501181] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-30T17:21:20.512520] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-30T17:21:20.501794] [DEBUG] [LOCAL ] AUNA: Loaded 5412 existing records from primary storage. [2025-10-30T17:21:20.515339] [INFO ] [MAIN ] AUNA: Loaded 5412 existing records. [2025-10-30T17:21:20.696578] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:21:20.696853] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-30T17:21:20.696904] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-30T17:21:20.697088] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-30T17:21:20.697136] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-30T17:21:21.051632] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:21.072121] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T17:21:21.079154] [INFO ] [REMOTE ] ATR: Full fetch complete (44192 records). [2025-10-30T17:21:21.079297] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-30T17:21:21.303253] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-30T17:21:21.447959] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-30T17:21:21.448046] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-30T17:21:21.448564] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-30T17:21:21.448604] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-30T17:21:21.449629] [DEBUG] [LOCAL ] ATR: Trimmed 44192 records to 30764 (keeping 200 days of data) [2025-10-30T17:21:21.638631] [DEBUG] [LOCAL ] ATR: Primary data saved (30764 records). [2025-10-30T17:21:21.638781] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-30T17:21:21.638857] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. ATR took 41.1s. Estimated remaining: 4h 25m 17s. Rate: 8.3 symbols/min [2025-10-30T17:21:21.808029] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:21.840159] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T17:21:21.875550] [DEBUG] [LOCAL ] AVA: Loaded 37936 existing records from primary storage. [2025-10-30T17:21:21.875840] [INFO ] [MAIN ] AVA: Loaded 37936 existing records. [2025-10-30T17:21:22.051138] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:21:22.051366] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-30T17:21:22.051417] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-30T17:21:22.051821] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-30T17:21:22.051877] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-30T17:21:22.106806] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-30T17:21:22.400442] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:22.785764] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T17:21:22.897460] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-30T17:21:23.233496] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-30T17:21:23.332343] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-30T17:21:23.697513] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-30T17:21:24.199617] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-30T17:21:24.497511] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-30T17:21:25.297536] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-30T17:21:25.674321] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T17:21:25.776405] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T17:21:26.097482] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-30T17:21:26.469064] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T17:21:26.897501] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-30T17:21:27.493851] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T17:21:27.697499] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-30T17:21:28.137606] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-30T17:21:28.497533] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-30T17:21:29.297520] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-30T17:21:29.776507] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:21:30.097495] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-30T17:21:30.342821] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T17:21:30.897509] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-30T17:21:31.271586] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T17:21:31.697519] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-30T17:21:32.284375] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T17:21:32.497519] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-30T17:21:32.646129] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T17:21:33.297516] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-30T17:21:33.948577] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-30T17:21:34.097495] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-30T17:21:34.523118] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T17:21:34.572412] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-30T17:21:34.897487] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-30T17:21:35.388473] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T17:21:35.697501] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-30T17:21:36.497506] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-30T17:21:37.297504] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-30T17:21:37.636202] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-30T17:21:37.648216] [INFO ] [REMOTE ] AU: Full fetch complete (76270 records). [2025-10-30T17:21:37.648347] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-30T17:21:37.649186] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:21:37.649277] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:21:37.649322] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:21:37.649363] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-30T17:21:37.649418] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-30T17:21:37.649454] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-10-30T17:21:37.649693] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-10-30T17:21:37.650533] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. AU took 36.4s. Estimated remaining: 4h 26m 58s. Rate: 8.2 symbols/min [2025-10-30T17:21:37.864445] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:37.875995] [DEBUG] [LOCAL ] AVAL: Loaded 8228 existing records from primary storage. [2025-10-30T17:21:37.876233] [INFO ] [MAIN ] AVAL: Loaded 8228 existing records. [2025-10-30T17:21:37.943218] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T17:21:37.989171] [INFO ] [REMOTE ] AUNA: Full fetch complete (7907 records). [2025-10-30T17:21:37.989335] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-30T17:21:38.098668] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-30T17:21:38.239907] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:21:38.250757] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-30T17:21:38.256217] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-30T17:21:38.258463] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-30T17:21:38.291676] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-30T17:21:38.328037] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-30T17:21:38.670110] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-30T17:21:38.684761] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-30T17:21:38.685855] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-30T17:21:38.685933] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-30T17:21:38.721164] [DEBUG] [LOCAL ] AUNA: Trimmed 7907 records to 5493 (keeping 200 days of data) [2025-10-30T17:21:38.821361] [DEBUG] [LOCAL ] AUNA: Primary data saved (5493 records). [2025-10-30T17:21:38.832203] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-30T17:21:38.837426] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. AUNA took 18.6s. Estimated remaining: 4h 25m 35s. Rate: 8.2 symbols/min [2025-10-30T17:21:38.930765] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-30T17:21:38.973435] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:39.074481] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:39.111286] [DEBUG] [LOCAL ] AVB: Loaded 41864 existing records from primary storage. [2025-10-30T17:21:39.111564] [INFO ] [MAIN ] AVB: Loaded 41864 existing records. [2025-10-30T17:21:39.288799] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:21:39.289080] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-30T17:21:39.289203] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-30T17:21:39.289689] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-30T17:21:39.289748] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-30T17:21:39.463795] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T17:21:39.691724] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:39.697459] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-30T17:21:40.259166] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T17:21:40.497502] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-30T17:21:40.598771] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T17:21:41.297500] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-30T17:21:41.755741] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:21:42.097497] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-30T17:21:42.437028] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T17:21:42.798446] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T17:21:42.897516] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-30T17:21:43.697503] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-30T17:21:44.015360] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T17:21:44.324227] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T17:21:44.497518] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-30T17:21:45.078878] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-30T17:21:45.297499] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-30T17:21:45.782424] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T17:21:46.097694] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-30T17:21:46.573352] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-30T17:21:46.897503] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-30T17:21:47.443557] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T17:21:47.697486] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-30T17:21:48.497543] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-30T17:21:49.093545] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T17:21:49.104094] [INFO ] [REMOTE ] AUB: Full fetch complete (66485 records). [2025-10-30T17:21:49.104277] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-30T17:21:49.308584] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-30T17:21:49.493345] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-30T17:21:49.493437] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-30T17:21:49.494158] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-30T17:21:49.494228] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-30T17:21:49.495600] [DEBUG] [LOCAL ] AUB: Trimmed 66485 records to 45919 (keeping 200 days of data) [2025-10-30T17:21:49.770802] [DEBUG] [LOCAL ] AUB: Primary data saved (45919 records). [2025-10-30T17:21:49.770928] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-30T17:21:49.771586] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. AUB took 37.5s. Estimated remaining: 4h 26m 12s. Rate: 8.2 symbols/min [2025-10-30T17:21:49.927448] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T17:21:49.955829] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T17:21:49.981838] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:49.990305] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-30T17:21:49.990677] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-30T17:21:49.990802] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-30T17:21:49.990848] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-30T17:21:49.990891] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-30T17:21:49.990924] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-30T17:21:50.102698] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-30T17:21:50.340754] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:50.897492] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-30T17:21:51.066325] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:21:51.066614] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-30T17:21:51.066719] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:21:51.066792] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-30T17:21:51.066857] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:21:51.066964] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-30T17:21:51.067027] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-30T17:21:51.067064] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-30T17:21:51.067104] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-30T17:21:51.067147] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 1.3s. Estimated remaining: 4h 24m 52s. Rate: 8.3 symbols/min [2025-10-30T17:21:51.231142] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:51.231333] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-10-30T17:21:51.231375] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-10-30T17:21:51.231481] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-30T17:21:51.231521] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-30T17:21:51.231562] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-30T17:21:51.231592] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-30T17:21:51.586738] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:51.697477] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-30T17:21:51.724873] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-30T17:21:52.497546] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-30T17:21:52.963838] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T17:21:53.297488] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-30T17:21:53.693892] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T17:21:53.950075] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-30T17:21:54.097462] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-30T17:21:54.770753] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-30T17:21:54.773559] [INFO ] [REMOTE ] AVAL: Full fetch complete (15192 records). [2025-10-30T17:21:54.773628] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-30T17:21:54.909538] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-30T17:21:55.131509] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-30T17:21:55.131591] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-30T17:21:55.131964] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-30T17:21:55.132013] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-30T17:21:55.132545] [DEBUG] [LOCAL ] AVAL: Trimmed 15192 records to 8361 (keeping 200 days of data) [2025-10-30T17:21:55.181155] [DEBUG] [LOCAL ] AVAL: Primary data saved (8361 records). [2025-10-30T17:21:55.181287] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-30T17:21:55.181368] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AVAL took 17.5s. Estimated remaining: 4h 24m 7s. Rate: 8.3 symbols/min [2025-10-30T17:21:55.348603] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:21:55.366799] [DEBUG] [LOCAL ] AVK: Loaded 18394 existing records from primary storage. [2025-10-30T17:21:55.367036] [INFO ] [MAIN ] AVK: Loaded 18394 existing records. [2025-10-30T17:21:55.540813] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:21:55.541051] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-30T17:21:55.541110] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-30T17:21:55.541354] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-30T17:21:55.541393] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-30T17:21:55.709373] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-30T17:21:55.916520] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:21:55.933427] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T17:21:56.497492] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-30T17:21:57.207681] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T17:21:57.297462] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-30T17:21:57.489532] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T17:21:58.097484] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-30T17:21:58.676419] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T17:21:58.727514] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T17:21:58.897474] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-30T17:21:59.500457] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-30T17:21:59.697474] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-30T17:22:00.497522] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-30T17:22:01.169535] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T17:22:01.297625] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-30T17:22:01.913356] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T17:22:01.957149] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T17:22:02.097487] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-30T17:22:02.897477] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-30T17:22:03.035393] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T17:22:03.697515] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-30T17:22:04.419221] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T17:22:04.506594] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-30T17:22:04.508905] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T17:22:05.297471] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-30T17:22:05.332075] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T17:22:06.097514] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-30T17:22:06.546303] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T17:22:06.897487] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-30T17:22:07.167235] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-30T17:22:07.697494] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-30T17:22:08.237825] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:22:08.497498] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-30T17:22:09.126838] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T17:22:09.137619] [INFO ] [REMOTE ] AVA: Full fetch complete (55503 records). [2025-10-30T17:22:09.137923] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-30T17:22:09.302748] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-30T17:22:09.631119] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T17:22:09.630377] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-30T17:22:09.635247] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-30T17:22:09.636910] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-30T17:22:09.636980] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-30T17:22:09.638550] [DEBUG] [LOCAL ] AVA: Trimmed 55503 records to 38192 (keeping 200 days of data) [2025-10-30T17:22:09.866615] [DEBUG] [LOCAL ] AVA: Primary data saved (38192 records). [2025-10-30T17:22:09.866795] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-30T17:22:09.866884] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVA took 48.2s. Estimated remaining: 4h 25m 29s. Rate: 8.2 symbols/min [2025-10-30T17:22:10.049687] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:22:10.081795] [DEBUG] [LOCAL ] AVNS: Loaded 33218 existing records from primary storage. [2025-10-30T17:22:10.082060] [INFO ] [MAIN ] AVNS: Loaded 33218 existing records. [2025-10-30T17:22:10.102771] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-30T17:22:10.272681] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:22:10.272883] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-30T17:22:10.272933] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-30T17:22:10.273280] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-30T17:22:10.273320] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-30T17:22:10.666573] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:22:10.693813] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T17:22:10.703414] [INFO ] [REMOTE ] AVB: Full fetch complete (59772 records). [2025-10-30T17:22:10.703584] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-30T17:22:10.714590] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T17:22:10.905924] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-30T17:22:11.101015] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-30T17:22:11.101139] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-30T17:22:11.101795] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-30T17:22:11.101857] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-30T17:22:11.103026] [DEBUG] [LOCAL ] AVB: Trimmed 59772 records to 42232 (keeping 200 days of data) [2025-10-30T17:22:11.361388] [DEBUG] [LOCAL ] AVB: Primary data saved (42232 records). [2025-10-30T17:22:11.361505] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-30T17:22:11.361580] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVB took 32.5s. Estimated remaining: 4h 24m 12s. Rate: 8.3 symbols/min [2025-10-30T17:22:11.530415] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:22:11.565248] [DEBUG] [LOCAL ] AVNT: Loaded 38002 existing records from primary storage. [2025-10-30T17:22:11.565513] [INFO ] [MAIN ] AVNT: Loaded 38002 existing records. [2025-10-30T17:22:11.705151] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-30T17:22:11.749595] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:22:11.749778] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-30T17:22:11.749827] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-30T17:22:11.750070] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-30T17:22:11.750108] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-30T17:22:12.113708] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:22:12.144831] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:22:12.497479] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-30T17:22:12.655293] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T17:22:13.297518] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-30T17:22:13.692694] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:22:14.097475] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-30T17:22:14.168995] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T17:22:14.897469] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-30T17:22:15.078711] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T17:22:15.697476] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-30T17:22:15.767354] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:22:16.497459] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-30T17:22:16.653807] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T17:22:17.297488] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-30T17:22:17.440058] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-30T17:22:18.085545] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T17:22:18.097445] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-30T17:22:18.897491] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-30T17:22:19.102290] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:22:19.681972] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T17:22:19.697450] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-30T17:22:20.497501] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-30T17:22:20.528089] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T17:22:20.532226] [INFO ] [REMOTE ] AVD: Full fetch complete (32127 records). [2025-10-30T17:22:20.532339] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-30T17:22:20.532932] [FATAL] [VALIDATOR ] AVD: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:22:20.533021] [FATAL] [MAIN ] AVD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:22:20.533066] [WARN ] [MAIN ] AVD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:22:20.533153] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-30T17:22:20.533216] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-30T17:22:20.533251] [INFO ] [LOCAL ] AVD: Starting deletion of derivative data. [2025-10-30T17:22:20.533291] [DEBUG] [LOCAL ] AVD: No derivative data file found to delete. [2025-10-30T17:22:20.533346] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVD took 29.5s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min [2025-10-30T17:22:20.739360] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:22:20.797793] [DEBUG] [LOCAL ] AVTR: Loaded 53570 existing records from primary storage. [2025-10-30T17:22:20.798190] [INFO ] [MAIN ] AVTR: Loaded 53570 existing records. [2025-10-30T17:22:21.021831] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:22:21.022052] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-30T17:22:21.022099] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-30T17:22:21.022584] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-30T17:22:21.022620] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-30T17:22:21.302684] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-30T17:22:21.375792] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:22:21.621278] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T17:22:22.097476] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-30T17:22:22.168113] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T17:22:22.897506] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-30T17:22:23.067948] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T17:22:23.697473] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-30T17:22:23.746207] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T17:22:24.497541] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-30T17:22:25.093855] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:22:25.297521] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-30T17:22:25.330459] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T17:22:25.335812] [INFO ] [REMOTE ] AVK: Full fetch complete (26798 records). [2025-10-30T17:22:25.335910] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-30T17:22:25.714488] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-30T17:22:25.714586] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-30T17:22:25.715012] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-30T17:22:25.715075] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-30T17:22:25.716042] [DEBUG] [LOCAL ] AVK: Trimmed 26798 records to 18543 (keeping 200 days of data) [2025-10-30T17:22:25.834105] [DEBUG] [LOCAL ] AVK: Primary data saved (18543 records). [2025-10-30T17:22:25.834252] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-30T17:22:25.834394] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVK took 30.7s. Estimated remaining: 4h 23m 57s. Rate: 8.3 symbols/min [2025-10-30T17:22:26.011061] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:22:26.049151] [DEBUG] [LOCAL ] AVY: Loaded 37767 existing records from primary storage. [2025-10-30T17:22:26.049437] [INFO ] [MAIN ] AVY: Loaded 37767 existing records. [2025-10-30T17:22:26.105111] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-30T17:22:26.237208] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:22:26.237906] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-30T17:22:26.238075] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-30T17:22:26.238402] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-30T17:22:26.238458] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-30T17:22:26.646418] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T17:22:26.649986] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:22:26.897515] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-30T17:22:26.977362] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:22:27.697552] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-30T17:22:28.203429] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-30T17:22:28.497543] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-30T17:22:28.708769] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T17:22:29.298083] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-30T17:22:29.530019] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:22:30.097508] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-30T17:22:30.626126] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T17:22:30.883082] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-30T17:22:30.897449] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-30T17:22:31.697765] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-30T17:22:31.912634] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T17:22:32.497538] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-30T17:22:32.941199] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T17:22:33.297521] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-30T17:22:33.495871] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:22:34.097489] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-30T17:22:34.462212] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T17:22:34.897531] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-30T17:22:35.354977] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-30T17:22:35.697568] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-30T17:22:36.290029] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:22:36.497530] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-30T17:22:36.915823] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T17:22:37.297501] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-30T17:22:37.910759] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T17:22:38.097503] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-30T17:22:38.305746] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-30T17:22:38.897524] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-30T17:22:38.947356] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T17:22:39.697496] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-30T17:22:40.317472] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T17:22:40.497548] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-30T17:22:40.927339] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T17:22:41.297507] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-30T17:22:41.713787] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-30T17:22:41.723163] [INFO ] [REMOTE ] AVNT: Full fetch complete (55898 records). [2025-10-30T17:22:41.723402] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-30T17:22:42.105789] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-30T17:22:42.161901] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-30T17:22:42.161984] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-30T17:22:42.162569] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-30T17:22:42.162611] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-30T17:22:42.163794] [DEBUG] [LOCAL ] AVNT: Trimmed 55898 records to 38263 (keeping 200 days of data) [2025-10-30T17:22:42.394925] [DEBUG] [LOCAL ] AVNT: Primary data saved (38263 records). [2025-10-30T17:22:42.395073] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-30T17:22:42.396074] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVNT took 31.0s. Estimated remaining: 4h 25m 39s. Rate: 8.2 symbols/min [2025-10-30T17:22:42.567176] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:22:42.592795] [DEBUG] [LOCAL ] AWF: Loaded 23833 existing records from primary storage. [2025-10-30T17:22:42.593047] [INFO ] [MAIN ] AWF: Loaded 23833 existing records. [2025-10-30T17:22:42.775379] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:22:42.775873] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-30T17:22:42.775982] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-30T17:22:42.776506] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-30T17:22:42.776569] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-30T17:22:42.900913] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-30T17:22:43.092282] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-30T17:22:43.216497] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:22:43.237008] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T17:22:43.244429] [INFO ] [REMOTE ] AVNS: Full fetch complete (48049 records). [2025-10-30T17:22:43.244549] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-30T17:22:43.630035] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-30T17:22:43.630161] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-30T17:22:43.630945] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-30T17:22:43.631025] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-30T17:22:43.632186] [DEBUG] [LOCAL ] AVNS: Trimmed 48049 records to 33418 (keeping 200 days of data) [2025-10-30T17:22:43.716337] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-30T17:22:43.830377] [DEBUG] [LOCAL ] AVNS: Primary data saved (33418 records). [2025-10-30T17:22:43.830509] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-30T17:22:43.830943] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVNS took 34.0s. Estimated remaining: 4h 24m 23s. Rate: 8.2 symbols/min [2025-10-30T17:22:44.009942] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:22:44.031009] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T17:22:44.056503] [DEBUG] [LOCAL ] AWI: Loaded 24986 existing records from primary storage. [2025-10-30T17:22:44.056787] [INFO ] [MAIN ] AWI: Loaded 24986 existing records. [2025-10-30T17:22:44.230992] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:22:44.231188] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-30T17:22:44.231233] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-30T17:22:44.231571] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-30T17:22:44.231626] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-30T17:22:44.500352] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-30T17:22:44.644515] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:22:44.646180] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-30T17:22:45.297515] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-30T17:22:46.041627] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T17:22:46.097469] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-30T17:22:46.707637] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-30T17:22:46.897498] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-30T17:22:47.146873] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T17:22:47.697514] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-30T17:22:48.280090] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T17:22:48.497488] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-30T17:22:48.643184] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T17:22:49.297500] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-30T17:22:49.724214] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:22:50.097539] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-30T17:22:50.597908] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T17:22:50.897489] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-30T17:22:50.982816] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-30T17:22:51.697517] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-30T17:22:52.371500] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T17:22:52.381545] [INFO ] [REMOTE ] AVY: Full fetch complete (56640 records). [2025-10-30T17:22:52.381756] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-30T17:22:52.502622] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-30T17:22:52.731307] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:22:52.817056] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-30T17:22:52.817147] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-30T17:22:52.817869] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-30T17:22:52.817950] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-30T17:22:52.819284] [DEBUG] [LOCAL ] AVY: Trimmed 56640 records to 38046 (keeping 200 days of data) [2025-10-30T17:22:53.159853] [DEBUG] [LOCAL ] AVY: Primary data saved (38046 records). [2025-10-30T17:22:53.160060] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-30T17:22:53.160176] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AVY took 27.3s. Estimated remaining: 4h 24m 39s. Rate: 8.2 symbols/min [2025-10-30T17:22:53.302837] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-30T17:22:53.440081] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:22:53.506415] [DEBUG] [LOCAL ] AWK: Loaded 48231 existing records from primary storage. [2025-10-30T17:22:53.506933] [INFO ] [MAIN ] AWK: Loaded 48231 existing records. [2025-10-30T17:22:53.781387] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:22:53.781843] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-30T17:22:53.781922] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-30T17:22:53.782541] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-30T17:22:53.782675] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-30T17:22:54.099432] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-30T17:22:54.278683] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-30T17:22:54.371242] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:22:54.388924] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T17:22:54.897559] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-30T17:22:55.121088] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T17:22:55.697503] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-30T17:22:56.255794] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T17:22:56.497536] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-30T17:22:56.626836] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T17:22:57.297472] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-30T17:22:57.591579] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T17:22:58.000379] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-30T17:22:58.097461] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-30T17:22:58.897474] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-30T17:22:59.064318] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:22:59.697552] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-30T17:23:00.497519] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-30T17:23:01.297518] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-30T17:23:04.714522] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-10-30T17:23:04.721291] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-30T17:23:05.041389] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (6.14 seconds). [2025-10-30T17:23:05.046563] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-30T17:23:05.439235] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (4.94 seconds). [2025-10-30T17:23:05.448937] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-30T17:23:05.988807] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (6.29 seconds). [2025-10-30T17:23:06.016279] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T17:23:06.016509] [INFO ] [REMOTE ] AVTR: Full fetch complete (77286 records). [2025-10-30T17:23:06.022221] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-30T17:23:06.023074] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-30T17:23:06.024273] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:23:06.024363] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:23:06.024406] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:23:06.024445] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-30T17:23:06.024494] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-30T17:23:06.024528] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-10-30T17:23:06.024752] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-10-30T17:23:06.025272] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVTR took 45.5s. Estimated remaining: 4h 25m 36s. Rate: 8.2 symbols/min [2025-10-30T17:23:06.216508] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:06.242229] [DEBUG] [LOCAL ] AWP: Loaded 21334 existing records from primary storage. [2025-10-30T17:23:06.242602] [INFO ] [MAIN ] AWP: Loaded 21334 existing records. [2025-10-30T17:23:06.361855] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-30T17:23:06.396309] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-30T17:23:06.484628] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:06.484900] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-30T17:23:06.484952] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-30T17:23:06.485192] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-30T17:23:06.485254] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-30T17:23:06.865543] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:06.866045] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-30T17:23:06.916132] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T17:23:06.924468] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-30T17:23:07.007714] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-30T17:23:07.271860] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T17:23:07.697527] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-30T17:23:07.789366] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T17:23:08.064564] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:23:08.497462] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-30T17:23:08.573721] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T17:23:09.126964] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T17:23:09.297491] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-30T17:23:10.097556] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-30T17:23:10.290273] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T17:23:10.298226] [INFO ] [REMOTE ] AWF: Full fetch complete (35702 records). [2025-10-30T17:23:10.298391] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-30T17:23:10.298996] [FATAL] [VALIDATOR ] AWF: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:23:10.299132] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:23:10.299190] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:23:10.299257] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-30T17:23:10.299321] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-30T17:23:10.299355] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-10-30T17:23:10.299512] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-10-30T17:23:10.299585] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AWF took 27.9s. Estimated remaining: 4h 24m 54s. Rate: 8.2 symbols/min [2025-10-30T17:23:10.472568] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:10.493034] [DEBUG] [LOCAL ] AWR: Loaded 22408 existing records from primary storage. [2025-10-30T17:23:10.493308] [INFO ] [MAIN ] AWR: Loaded 22408 existing records. [2025-10-30T17:23:10.703005] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:10.703296] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-30T17:23:10.703350] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-30T17:23:10.703604] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-30T17:23:10.703699] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-30T17:23:10.902679] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-30T17:23:11.071404] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:11.455985] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T17:23:11.697533] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-30T17:23:11.965431] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T17:23:12.497730] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-30T17:23:12.965577] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T17:23:13.230713] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-30T17:23:13.297478] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-30T17:23:14.097552] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-30T17:23:14.429992] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T17:23:14.897496] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-30T17:23:15.323057] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T17:23:15.329615] [INFO ] [REMOTE ] AWI: Full fetch complete (36495 records). [2025-10-30T17:23:15.329763] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-30T17:23:15.702721] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-30T17:23:15.787871] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-30T17:23:15.787956] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-30T17:23:15.788486] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-30T17:23:15.788556] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-30T17:23:15.789501] [DEBUG] [LOCAL ] AWI: Trimmed 36495 records to 25172 (keeping 200 days of data) [2025-10-30T17:23:15.959550] [DEBUG] [LOCAL ] AWI: Primary data saved (25172 records). [2025-10-30T17:23:15.959707] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-30T17:23:15.959802] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWI took 32.1s. Estimated remaining: 4h 24m 28s. Rate: 8.2 symbols/min [2025-10-30T17:23:16.171594] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:16.199406] [DEBUG] [LOCAL ] AX: Loaded 27152 existing records from primary storage. [2025-10-30T17:23:16.199921] [INFO ] [MAIN ] AX: Loaded 27152 existing records. [2025-10-30T17:23:16.397328] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:16.397714] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-30T17:23:16.397796] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-30T17:23:16.398146] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-30T17:23:16.398294] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-30T17:23:16.499354] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-30T17:23:16.696231] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-30T17:23:16.767712] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T17:23:16.821775] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:17.297519] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-30T17:23:17.380824] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T17:23:18.097515] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-30T17:23:18.707436] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T17:23:18.897523] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-30T17:23:19.337542] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:23:19.697583] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-30T17:23:20.500849] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-30T17:23:20.500263] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-30T17:23:20.503972] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T17:23:21.304686] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-30T17:23:21.309016] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T17:23:22.097541] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-30T17:23:22.897506] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-30T17:23:22.897435] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T17:23:22.910774] [INFO ] [REMOTE ] AWK: Full fetch complete (70932 records). [2025-10-30T17:23:22.910943] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-30T17:23:23.319430] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-30T17:23:23.319765] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-30T17:23:23.320490] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-30T17:23:23.320565] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-30T17:23:23.340764] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T17:23:23.348182] [DEBUG] [LOCAL ] AWK: Trimmed 70932 records to 48611 (keeping 200 days of data) [2025-10-30T17:23:23.659959] [DEBUG] [LOCAL ] AWK: Primary data saved (48611 records). [2025-10-30T17:23:23.660137] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-30T17:23:23.660917] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWK took 30.5s. Estimated remaining: 4h 24m 25s. Rate: 8.2 symbols/min [2025-10-30T17:23:23.707853] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-30T17:23:23.874000] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:23.882195] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T17:23:23.937466] [DEBUG] [LOCAL ] AXL: Loaded 50522 existing records from primary storage. [2025-10-30T17:23:23.937793] [INFO ] [MAIN ] AXL: Loaded 50522 existing records. [2025-10-30T17:23:24.128896] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:24.129100] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-30T17:23:24.129148] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-30T17:23:24.129570] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-30T17:23:24.129611] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-30T17:23:24.505093] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-30T17:23:24.529714] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:24.713308] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T17:23:25.297483] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-30T17:23:25.327618] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T17:23:26.097476] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-30T17:23:26.170134] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T17:23:26.897470] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-30T17:23:27.166994] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T17:23:27.697555] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-30T17:23:27.985678] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T17:23:28.497517] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-30T17:23:28.848519] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T17:23:29.297503] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-30T17:23:29.700500] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:23:29.980985] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T17:23:30.097505] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-30T17:23:30.897487] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-30T17:23:31.403630] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-30T17:23:31.697500] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-30T17:23:31.963002] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T17:23:32.497536] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-30T17:23:32.988043] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T17:23:33.297488] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-30T17:23:33.421900] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T17:23:34.097482] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-30T17:23:34.446694] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T17:23:34.897533] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-30T17:23:35.093703] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T17:23:35.697533] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-30T17:23:35.745174] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T17:23:36.497482] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-30T17:23:36.975731] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:23:37.297526] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-30T17:23:37.318519] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-30T17:23:38.097546] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-30T17:23:38.434170] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T17:23:38.897522] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-30T17:23:38.913456] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T17:23:38.918267] [INFO ] [REMOTE ] AWP: Full fetch complete (31254 records). [2025-10-30T17:23:38.918403] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-30T17:23:39.304169] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-30T17:23:39.304261] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-30T17:23:39.304743] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-30T17:23:39.304807] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-30T17:23:39.305722] [DEBUG] [LOCAL ] AWP: Trimmed 31254 records to 21479 (keeping 200 days of data) [2025-10-30T17:23:39.430184] [DEBUG] [LOCAL ] AWP: Primary data saved (21479 records). [2025-10-30T17:23:39.430306] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-30T17:23:39.430382] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWP took 33.4s. Estimated remaining: 4h 25m 54s. Rate: 8.2 symbols/min [2025-10-30T17:23:39.617149] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:39.668383] [DEBUG] [LOCAL ] AXP: Loaded 53089 existing records from primary storage. [2025-10-30T17:23:39.668699] [INFO ] [MAIN ] AXP: Loaded 53089 existing records. [2025-10-30T17:23:39.711468] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-30T17:23:39.850218] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:39.850437] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-30T17:23:39.850560] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-30T17:23:39.851443] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-30T17:23:39.851499] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-30T17:23:39.974084] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T17:23:40.245590] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:40.497491] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-30T17:23:41.097633] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T17:23:41.297575] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-30T17:23:42.097512] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-30T17:23:42.431579] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-30T17:23:42.623323] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T17:23:42.902609] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-30T17:23:42.913261] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-30T17:23:43.697508] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-30T17:23:44.093385] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T17:23:44.497479] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-30T17:23:44.653468] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T17:23:45.297537] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-30T17:23:46.101576] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-30T17:23:46.108446] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T17:23:46.120575] [INFO ] [REMOTE ] AXL: Full fetch complete (73223 records). [2025-10-30T17:23:46.120753] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-30T17:23:46.317722] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-30T17:23:46.374099] [INFO ] [REMOTE ] AWR: Full fetch complete (32635 records). [2025-10-30T17:23:46.389844] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-30T17:23:46.738427] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-30T17:23:46.745878] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-30T17:23:46.754628] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-30T17:23:46.755450] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-30T17:23:46.866513] [DEBUG] [LOCAL ] AXL: Trimmed 73223 records to 50854 (keeping 200 days of data) [2025-10-30T17:23:46.928876] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-30T17:23:47.036052] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-30T17:23:47.041591] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-30T17:23:47.043790] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-30T17:23:47.051962] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-30T17:23:47.067754] [DEBUG] [LOCAL ] AWR: Trimmed 32635 records to 22593 (keeping 200 days of data) [2025-10-30T17:23:47.367951] [DEBUG] [LOCAL ] AXL: Primary data saved (50854 records). [2025-10-30T17:23:47.371725] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-30T17:23:47.372680] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AXL took 23.7s. Estimated remaining: 4h 25m 53s. Rate: 8.2 symbols/min [2025-10-30T17:23:47.440792] [DEBUG] [LOCAL ] AWR: Primary data saved (22593 records). [2025-10-30T17:23:47.452173] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-30T17:23:47.479030] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AWR took 37.2s. Estimated remaining: 4h 24m 25s. Rate: 8.2 symbols/min [2025-10-30T17:23:47.676309] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:47.774935] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:47.775436] [DEBUG] [LOCAL ] AXR: Loaded 2756 existing records from primary storage. [2025-10-30T17:23:47.776400] [INFO ] [MAIN ] AXR: Loaded 2756 existing records. [2025-10-30T17:23:48.045012] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-30T17:23:48.037201] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:48.074379] [DEBUG] [LOCAL ] AXS: Loaded 38765 existing records from primary storage. [2025-10-30T17:23:48.073468] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-30T17:23:48.074872] [INFO ] [MAIN ] AXS: Loaded 38765 existing records. [2025-10-30T17:23:48.074760] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-30T17:23:48.094502] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-30T17:23:48.081617] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T17:23:48.094693] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-30T17:23:48.146758] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-30T17:23:48.487594] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:48.503831] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-30T17:23:48.503662] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-30T17:23:48.537886] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-30T17:23:48.573342] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-30T17:23:48.587673] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-30T17:23:48.853967] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:49.055943] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:49.297498] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-30T17:23:49.507795] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-30T17:23:49.514221] [INFO ] [REMOTE ] AX: Full fetch complete (41676 records). [2025-10-30T17:23:49.514355] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-30T17:23:49.903624] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-30T17:23:49.903778] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-30T17:23:49.904394] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-30T17:23:49.904504] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-30T17:23:49.905589] [DEBUG] [LOCAL ] AX: Trimmed 41676 records to 27338 (keeping 200 days of data) [2025-10-30T17:23:50.088721] [DEBUG] [LOCAL ] AX: Primary data saved (27338 records). [2025-10-30T17:23:50.089378] [INFO ] [MAIN ] AX: Full history saved. [2025-10-30T17:23:50.090476] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-30T17:23:50.089477] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AX took 34.1s. Estimated remaining: 4h 23m 26s. Rate: 8.2 symbols/min [2025-10-30T17:23:50.100832] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-30T17:23:50.283314] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:23:50.335235] [DEBUG] [LOCAL ] AXTA: Loaded 52301 existing records from primary storage. [2025-10-30T17:23:50.335615] [INFO ] [MAIN ] AXTA: Loaded 52301 existing records. [2025-10-30T17:23:50.527735] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:23:50.528160] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-30T17:23:50.528243] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-30T17:23:50.528616] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-30T17:23:50.528733] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-30T17:23:50.658069] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T17:23:50.858103] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T17:23:50.909922] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-30T17:23:50.954107] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:23:51.201467] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T17:23:51.697480] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-30T17:23:52.497524] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-30T17:23:52.953108] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T17:23:53.297484] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-30T17:23:53.839283] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T17:23:54.097495] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-30T17:23:54.256392] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-30T17:23:54.526495] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-30T17:23:54.897482] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-30T17:23:55.697489] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-30T17:23:55.954250] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T17:23:56.497498] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-30T17:23:57.184284] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-30T17:23:57.297514] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-30T17:23:57.707261] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T17:23:58.097483] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-30T17:23:58.638580] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-30T17:23:58.681004] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T17:23:58.897495] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-30T17:23:59.697496] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-30T17:24:00.178674] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T17:24:00.497517] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-30T17:24:01.032701] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:24:01.297518] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-30T17:24:02.097495] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-30T17:24:02.296938] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-30T17:24:02.765681] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T17:24:02.897461] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-30T17:24:03.249533] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T17:24:03.697471] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-30T17:24:04.126283] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-30T17:24:04.220487] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T17:24:04.497555] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-30T17:24:05.297549] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-30T17:24:05.812397] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T17:24:06.097533] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-30T17:24:06.897473] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-30T17:24:07.034357] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-30T17:24:07.402900] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T17:24:07.697511] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-30T17:24:07.819770] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T17:24:08.089518] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-30T17:24:08.497561] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-30T17:24:09.297494] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-30T17:24:09.637134] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T17:24:09.990157] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T17:24:10.097453] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-30T17:24:10.897518] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-30T17:24:11.697502] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-30T17:24:12.081243] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T17:24:12.354822] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-30T17:24:12.366513] [INFO ] [REMOTE ] AXP: Full fetch complete (77064 records). [2025-10-30T17:24:12.366678] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-30T17:24:12.507841] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-30T17:24:12.766325] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-30T17:24:12.766619] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-30T17:24:12.767469] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-30T17:24:12.767550] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-30T17:24:12.769136] [DEBUG] [LOCAL ] AXP: Trimmed 77064 records to 53476 (keeping 200 days of data) [2025-10-30T17:24:13.008283] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T17:24:13.133300] [DEBUG] [LOCAL ] AXP: Primary data saved (53476 records). [2025-10-30T17:24:13.133438] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-30T17:24:13.134346] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AXP took 33.7s. Estimated remaining: 4h 26m 12s. Rate: 8.1 symbols/min [2025-10-30T17:24:13.297492] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-30T17:24:13.842346] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-30T17:24:13.978721] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T17:24:14.097505] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-30T17:24:14.618828] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-30T17:24:14.620216] [INFO ] [REMOTE ] AXR: Full fetch complete (4205 records). [2025-10-30T17:24:14.620307] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-30T17:24:14.902776] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-30T17:24:15.011577] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-30T17:24:15.011686] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-30T17:24:15.011848] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-30T17:24:15.011889] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-30T17:24:15.012236] [DEBUG] [LOCAL ] AXR: Trimmed 4205 records to 2759 (keeping 200 days of data) [2025-10-30T17:24:15.028137] [DEBUG] [LOCAL ] AXR: Primary data saved (2759 records). [2025-10-30T17:24:15.028199] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-30T17:24:15.028263] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXR took 27.7s. Estimated remaining: 4h 25m 5s. Rate: 8.2 symbols/min [2025-10-30T17:24:15.697540] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-30T17:24:16.030099] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T17:24:16.497499] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-30T17:24:17.414583] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-30T17:24:17.427800] [INFO ] [REMOTE ] AXTA: Full fetch complete (75572 records). [2025-10-30T17:24:17.427997] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-30T17:24:17.869797] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-30T17:24:17.877638] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-30T17:24:17.883735] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-30T17:24:17.892058] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-30T17:24:17.894069] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T17:24:17.903486] [DEBUG] [LOCAL ] AXTA: Trimmed 75572 records to 52690 (keeping 200 days of data) [2025-10-30T17:24:17.904485] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-30T17:24:18.213922] [DEBUG] [LOCAL ] AXTA: Primary data saved (52690 records). [2025-10-30T17:24:18.214062] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-30T17:24:18.214139] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXTA took 28.1s. Estimated remaining: 4h 24m 12s. Rate: 8.2 symbols/min [2025-10-30T17:24:19.064703] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T17:24:19.074844] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-30T17:24:20.304209] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T17:24:20.314352] [INFO ] [REMOTE ] AXS: Full fetch complete (56424 records). [2025-10-30T17:24:20.314530] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-30T17:24:20.727612] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-30T17:24:20.727756] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-30T17:24:20.728564] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-30T17:24:20.728623] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-30T17:24:20.730554] [DEBUG] [LOCAL ] AXS: Trimmed 56424 records to 39085 (keeping 200 days of data) [2025-10-30T17:24:21.000331] [DEBUG] [LOCAL ] AXS: Primary data saved (39085 records). [2025-10-30T17:24:21.000544] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-30T17:24:21.000680] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXS took 33.5s. Estimated remaining: 4h 23m 16s. Rate: 8.2 symbols/min [2025-10-30T17:24:21.534546] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:21.557237] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:21.620435] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:21.699755] [DEBUG] [LOCAL ] AZO: Loaded 10599 existing records from primary storage. [2025-10-30T17:24:21.699260] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:21.699900] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-30T17:24:21.700083] [INFO ] [MAIN ] AZO: Loaded 10599 existing records. [2025-10-30T17:24:21.700151] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-30T17:24:21.750701] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-30T17:24:21.780325] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-30T17:24:21.791167] [DEBUG] [LOCAL ] AYI: Loaded 23371 existing records from primary storage. [2025-10-30T17:24:21.796534] [INFO ] [MAIN ] AYI: Loaded 23371 existing records. [2025-10-30T17:24:21.796710] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-30T17:24:21.831746] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-30T17:24:21.985061] [DEBUG] [LOCAL ] AZZ: Loaded 22966 existing records from primary storage. [2025-10-30T17:24:22.027914] [INFO ] [MAIN ] AZZ: Loaded 22966 existing records. [2025-10-30T17:24:22.264917] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:24:22.249458] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:24:22.305354] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-30T17:24:22.310636] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-30T17:24:22.310543] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-30T17:24:22.343751] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-30T17:24:22.373594] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-30T17:24:22.395122] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-30T17:24:22.395187] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-30T17:24:22.406585] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-30T17:24:22.785754] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:24:22.834968] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-30T17:24:22.835121] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-30T17:24:22.914554] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-30T17:24:22.919937] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-30T17:24:23.108322] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:23.170385] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-30T17:24:23.429131] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:23.468452] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-30T17:24:23.678766] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:23.685388] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-30T17:24:23.778060] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:23.778415] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-30T17:24:24.147673] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T17:24:24.153616] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-30T17:24:24.302046] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:24:24.302257] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-30T17:24:24.302341] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:24:24.302402] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-30T17:24:24.302438] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:24:24.302475] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-30T17:24:24.302526] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-30T17:24:24.302562] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-30T17:24:24.302611] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-30T17:24:24.302675] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.3s. Estimated remaining: 4h 22m 25s. Rate: 8.2 symbols/min [2025-10-30T17:24:24.472855] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:24.480557] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T17:24:24.483291] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-30T17:24:24.529368] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-30T17:24:24.529708] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-30T17:24:24.657175] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T17:24:24.671612] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-30T17:24:24.723307] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:24:24.723675] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-30T17:24:24.723797] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-30T17:24:24.724309] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-30T17:24:24.724374] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-30T17:24:25.027387] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T17:24:25.044488] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-30T17:24:25.115161] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:25.120618] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-30T17:24:25.297476] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-30T17:24:25.620789] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T17:24:25.910301] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T17:24:26.097484] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-30T17:24:26.843823] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-30T17:24:26.897480] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-30T17:24:27.101404] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-30T17:24:27.697502] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-30T17:24:27.856394] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T17:24:28.497493] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-30T17:24:28.667148] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T17:24:29.297545] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-30T17:24:29.525788] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T17:24:30.097517] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-30T17:24:30.834081] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-30T17:24:30.853611] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-30T17:24:30.897478] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-30T17:24:31.475350] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T17:24:31.697493] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-30T17:24:32.309077] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-30T17:24:32.497530] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-30T17:24:32.989707] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-30T17:24:33.297534] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-30T17:24:33.925572] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-30T17:24:34.097490] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-30T17:24:34.897559] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-30T17:24:35.363710] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T17:24:35.658214] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-30T17:24:35.697521] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-30T17:24:36.437514] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-30T17:24:36.440342] [INFO ] [REMOTE ] AZO: Full fetch complete (16075 records). [2025-10-30T17:24:36.440413] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-30T17:24:36.502688] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-30T17:24:36.802090] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-30T17:24:36.802169] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-30T17:24:36.802458] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-30T17:24:36.802497] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-30T17:24:36.803037] [DEBUG] [LOCAL ] AZO: Trimmed 16075 records to 10681 (keeping 200 days of data) [2025-10-30T17:24:36.868896] [DEBUG] [LOCAL ] AZO: Primary data saved (10681 records). [2025-10-30T17:24:36.869022] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-30T17:24:36.869108] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AZO took 15.9s. Estimated remaining: 4h 23m 15s. Rate: 8.2 symbols/min [2025-10-30T17:24:37.037130] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:37.089517] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-30T17:24:37.089853] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-30T17:24:37.264536] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:24:37.264846] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-30T17:24:37.264946] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-30T17:24:37.265549] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-30T17:24:37.265604] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-30T17:24:37.302808] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-30T17:24:37.560003] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T17:24:37.638523] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:38.097505] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-30T17:24:38.897494] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-30T17:24:39.178824] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-30T17:24:39.703429] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-30T17:24:39.705343] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-30T17:24:40.115314] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-30T17:24:40.497545] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-30T17:24:41.297546] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-30T17:24:41.750555] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-30T17:24:42.029885] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T17:24:42.097448] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-30T17:24:42.189595] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-30T17:24:42.897480] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-30T17:24:43.052731] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T17:24:43.697493] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-30T17:24:44.429491] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T17:24:44.497496] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-30T17:24:44.640387] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-30T17:24:45.207230] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:24:45.297492] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-30T17:24:46.097500] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-30T17:24:46.359488] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T17:24:46.365854] [INFO ] [REMOTE ] AZZ: Full fetch complete (32180 records). [2025-10-30T17:24:46.365964] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-30T17:24:46.754795] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-30T17:24:46.754897] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-30T17:24:46.755321] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-30T17:24:46.755363] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-30T17:24:46.756181] [DEBUG] [LOCAL ] AZZ: Trimmed 32180 records to 23132 (keeping 200 days of data) [2025-10-30T17:24:46.897283] [DEBUG] [LOCAL ] AZZ: Primary data saved (23132 records). [2025-10-30T17:24:46.897403] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-30T17:24:46.897483] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AZZ took 25.9s. Estimated remaining: 4h 23m 37s. Rate: 8.2 symbols/min [2025-10-30T17:24:46.897570] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-30T17:24:47.070678] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:47.119892] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-30T17:24:47.120215] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-30T17:24:47.300792] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:24:47.301087] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-30T17:24:47.301144] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-30T17:24:47.307470] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-30T17:24:47.317409] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-30T17:24:47.363380] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T17:24:47.685296] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:47.697486] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-30T17:24:48.497511] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-30T17:24:48.806484] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-30T17:24:49.297521] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-30T17:24:49.769634] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-30T17:24:50.097542] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-30T17:24:50.361774] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-30T17:24:50.897506] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-30T17:24:51.518921] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-30T17:24:51.697543] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-30T17:24:52.192819] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-30T17:24:52.497522] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-30T17:24:52.567947] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T17:24:52.661918] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-30T17:24:53.297491] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-30T17:24:54.049982] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T17:24:54.097464] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-30T17:24:54.457328] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-30T17:24:54.793731] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T17:24:54.897517] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-30T17:24:55.697476] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-30T17:24:55.720009] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T17:24:55.725174] [INFO ] [REMOTE ] AYI: Full fetch complete (35915 records). [2025-10-30T17:24:55.725257] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-30T17:24:56.091366] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-30T17:24:56.091444] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-30T17:24:56.092015] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-30T17:24:56.092078] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-30T17:24:56.092870] [DEBUG] [LOCAL ] AYI: Trimmed 35915 records to 23482 (keeping 200 days of data) [2025-10-30T17:24:56.237069] [DEBUG] [LOCAL ] AYI: Primary data saved (23482 records). [2025-10-30T17:24:56.237188] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-30T17:24:56.237261] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. AYI took 35.2s. Estimated remaining: 4h 23m 51s. Rate: 8.2 symbols/min [2025-10-30T17:24:56.400117] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:24:56.447083] [DEBUG] [LOCAL ] BAH: Loaded 51647 existing records from primary storage. [2025-10-30T17:24:56.447381] [INFO ] [MAIN ] BAH: Loaded 51647 existing records. [2025-10-30T17:24:56.508935] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-30T17:24:56.622189] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:24:56.622371] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-30T17:24:56.622423] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-30T17:24:56.622850] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-30T17:24:56.622905] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-30T17:24:56.969684] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:24:57.297479] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-30T17:24:57.668688] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-30T17:24:58.097487] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-30T17:24:58.737046] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-30T17:24:58.897461] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-30T17:24:59.015469] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-30T17:24:59.697492] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-30T17:25:00.488910] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-30T17:25:00.499973] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-30T17:25:01.226034] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-30T17:25:01.298980] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-30T17:25:01.304860] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-30T17:25:02.097497] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-30T17:25:02.661900] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-30T17:25:02.897523] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-30T17:25:02.932374] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-30T17:25:03.697490] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-30T17:25:04.497551] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-30T17:25:05.144441] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-30T17:25:05.297483] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-30T17:25:06.372235] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-30T17:25:06.385297] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-30T17:25:06.421145] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (3.52 seconds). [2025-10-30T17:25:06.897507] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-30T17:25:08.027176] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-10-30T17:25:08.038378] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-30T17:25:08.107007] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-30T17:25:08.497477] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-30T17:25:08.671998] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (4.17 seconds). [2025-10-30T17:25:08.688093] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-30T17:25:08.688261] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-30T17:25:09.085062] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-30T17:25:09.085244] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-30T17:25:09.086128] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-30T17:25:09.086209] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-30T17:25:09.088113] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54180 (keeping 200 days of data) [2025-10-30T17:25:09.214078] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-30T17:25:09.311114] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-30T17:25:09.470794] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-30T17:25:09.470993] [INFO ] [MAIN ] BA: Full history saved. [2025-10-30T17:25:09.471946] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 45.2s. Estimated remaining: 4h 24m 46s. Rate: 8.2 symbols/min [2025-10-30T17:25:09.639684] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:09.675986] [DEBUG] [LOCAL ] BAK: Loaded 39060 existing records from primary storage. [2025-10-30T17:25:09.676253] [INFO ] [MAIN ] BAK: Loaded 39060 existing records. [2025-10-30T17:25:09.854319] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:25:09.854622] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-30T17:25:09.854787] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-30T17:25:09.855156] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-30T17:25:09.855288] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-30T17:25:10.178688] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-30T17:25:10.228733] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-30T17:25:10.273513] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:10.354991] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-30T17:25:10.897537] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-30T17:25:11.697488] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-30T17:25:11.780112] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-30T17:25:11.830491] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-30T17:25:11.842827] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-30T17:25:11.842998] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-30T17:25:12.270613] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T17:25:12.297057] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-30T17:25:12.297958] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-30T17:25:12.298870] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-30T17:25:12.298934] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-30T17:25:12.300373] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-30T17:25:12.511842] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-30T17:25:12.636927] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-30T17:25:12.637238] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-30T17:25:12.637934] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. BABA took 35.8s. Estimated remaining: 4h 23m 55s. Rate: 8.2 symbols/min [2025-10-30T17:25:12.806711] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:12.855802] [DEBUG] [LOCAL ] BALL: Loaded 51890 existing records from primary storage. [2025-10-30T17:25:12.856124] [INFO ] [MAIN ] BALL: Loaded 51890 existing records. [2025-10-30T17:25:13.036827] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:25:13.037046] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-30T17:25:13.037094] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-30T17:25:13.037333] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-30T17:25:13.037373] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-30T17:25:13.302631] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-30T17:25:13.409080] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:13.687898] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-30T17:25:13.726905] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T17:25:14.097476] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-30T17:25:14.902838] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-30T17:25:14.923280] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-30T17:25:15.697464] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-30T17:25:15.830790] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-30T17:25:16.420920] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-30T17:25:16.497549] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-30T17:25:17.273343] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-30T17:25:17.297469] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-30T17:25:17.525340] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T17:25:18.097489] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-30T17:25:18.844214] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-30T17:25:18.897512] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-30T17:25:19.697517] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-30T17:25:20.339414] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-30T17:25:20.351326] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-30T17:25:20.351469] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-30T17:25:20.505081] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-30T17:25:20.759536] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-30T17:25:20.759705] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-30T17:25:20.760542] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-30T17:25:20.760625] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-30T17:25:20.762492] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54198 (keeping 200 days of data) [2025-10-30T17:25:20.858343] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-30T17:25:20.921582] [INFO ] [REMOTE ] BAH: Full fetch complete (75308 records). [2025-10-30T17:25:20.923419] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-30T17:25:21.312120] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-30T17:25:21.476639] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-30T17:25:21.571843] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-30T17:25:21.585784] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-30T17:25:21.586486] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAC took 34.7s. Estimated remaining: 4h 24m 4s. Rate: 8.2 symbols/min [2025-10-30T17:25:21.705523] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-30T17:25:21.733431] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-30T17:25:21.734465] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-30T17:25:21.739920] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-30T17:25:21.807160] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:21.807871] [DEBUG] [LOCAL ] BAH: Trimmed 75308 records to 52030 (keeping 200 days of data) [2025-10-30T17:25:21.807622] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-30T17:25:21.808513] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-30T17:25:21.808686] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-30T17:25:21.808746] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-30T17:25:21.808791] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-30T17:25:21.808826] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-30T17:25:22.319187] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-30T17:25:22.317199] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:22.351790] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-30T17:25:22.555436] [DEBUG] [LOCAL ] BAH: Primary data saved (52030 records). [2025-10-30T17:25:22.555581] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-30T17:25:22.556606] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAH took 26.3s. Estimated remaining: 4h 22m 51s. Rate: 8.2 symbols/min [2025-10-30T17:25:22.734882] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:22.784953] [DEBUG] [LOCAL ] BAM: Loaded 52064 existing records from primary storage. [2025-10-30T17:25:22.785416] [INFO ] [MAIN ] BAM: Loaded 52064 existing records. [2025-10-30T17:25:22.900921] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-30T17:25:22.971202] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:25:22.971473] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-30T17:25:22.971569] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-30T17:25:22.972135] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-30T17:25:22.972205] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-30T17:25:23.296199] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-30T17:25:23.389708] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:23.441076] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T17:25:23.697517] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-30T17:25:24.116826] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T17:25:24.497591] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-30T17:25:24.878076] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T17:25:25.302667] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-30T17:25:25.325453] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-30T17:25:25.833296] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T17:25:26.097524] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-30T17:25:26.897505] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-30T17:25:27.124821] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T17:25:27.697510] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-30T17:25:28.090696] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-30T17:25:28.426187] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-30T17:25:28.497504] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-30T17:25:29.297506] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-30T17:25:29.710202] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T17:25:30.097528] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-30T17:25:30.478957] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:25:30.897537] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-30T17:25:31.482907] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T17:25:31.697499] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-30T17:25:32.042443] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T17:25:32.497547] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-30T17:25:33.041795] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T17:25:33.297459] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-30T17:25:33.524970] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T17:25:34.097492] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-30T17:25:34.624479] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:25:34.897513] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-30T17:25:35.612404] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T17:25:35.697501] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-30T17:25:36.132893] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T17:25:36.497505] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-30T17:25:36.975600] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T17:25:37.297525] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-30T17:25:37.921045] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T17:25:37.932405] [INFO ] [REMOTE ] BAK: Full fetch complete (56803 records). [2025-10-30T17:25:37.932625] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-30T17:25:38.102808] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-30T17:25:38.464747] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-30T17:25:38.464953] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-30T17:25:38.465782] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-30T17:25:38.466043] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-30T17:25:38.467822] [DEBUG] [LOCAL ] BAK: Trimmed 56803 records to 39381 (keeping 200 days of data) [2025-10-30T17:25:38.596714] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T17:25:38.770764] [DEBUG] [LOCAL ] BAK: Primary data saved (39381 records). [2025-10-30T17:25:38.770980] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-30T17:25:38.771804] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BAK took 29.3s. Estimated remaining: 4h 24m 15s. Rate: 8.2 symbols/min [2025-10-30T17:25:38.898350] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-30T17:25:38.991797] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:39.005703] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T17:25:39.063984] [DEBUG] [LOCAL ] BANC: Loaded 51377 existing records from primary storage. [2025-10-30T17:25:39.064304] [INFO ] [MAIN ] BANC: Loaded 51377 existing records. [2025-10-30T17:25:39.257734] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:25:39.258163] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-30T17:25:39.258238] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-30T17:25:39.258571] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-30T17:25:39.258629] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-30T17:25:39.687097] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:39.697487] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-30T17:25:40.477451] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T17:25:40.497452] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-30T17:25:41.150634] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T17:25:41.297490] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-30T17:25:41.690604] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T17:25:41.829043] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-30T17:25:42.097495] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-30T17:25:42.606687] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-30T17:25:42.897494] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-30T17:25:43.697496] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-30T17:25:43.954434] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T17:25:44.094706] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T17:25:44.497495] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-30T17:25:45.297515] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-30T17:25:45.829757] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T17:25:46.097488] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-30T17:25:46.897497] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-30T17:25:47.214265] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-30T17:25:47.227921] [INFO ] [REMOTE ] BALL: Full fetch complete (75614 records). [2025-10-30T17:25:47.228145] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-30T17:25:47.662245] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-30T17:25:47.662401] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-30T17:25:47.663236] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-30T17:25:47.663300] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-30T17:25:47.665101] [DEBUG] [LOCAL ] BALL: Trimmed 75614 records to 52278 (keeping 200 days of data) [2025-10-30T17:25:47.699801] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-30T17:25:47.758428] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-30T17:25:48.037208] [DEBUG] [LOCAL ] BALL: Primary data saved (52278 records). [2025-10-30T17:25:48.037397] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-30T17:25:48.038486] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BALL took 35.4s. Estimated remaining: 4h 24m 28s. Rate: 8.2 symbols/min [2025-10-30T17:25:48.214958] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:48.279015] [DEBUG] [LOCAL ] BAP: Loaded 24995 existing records from primary storage. [2025-10-30T17:25:48.283013] [INFO ] [MAIN ] BAP: Loaded 24995 existing records. [2025-10-30T17:25:48.282828] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T17:25:48.474908] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:25:48.475140] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-30T17:25:48.475215] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-30T17:25:48.475423] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-30T17:25:48.475465] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-30T17:25:48.505350] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-30T17:25:48.853936] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:48.856527] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T17:25:48.862777] [INFO ] [REMOTE ] BALY: Full fetch complete (15768 records). [2025-10-30T17:25:48.862914] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-30T17:25:49.052873] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T17:25:49.053179] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:25:49.053250] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:25:49.053326] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-30T17:25:49.053413] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-30T17:25:49.053470] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-30T17:25:49.053513] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-30T17:25:49.053615] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALY took 27.5s. Estimated remaining: 4h 23m 16s. Rate: 8.2 symbols/min [2025-10-30T17:25:49.219285] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:49.252000] [DEBUG] [LOCAL ] BARK: Loaded 38119 existing records from primary storage. [2025-10-30T17:25:49.252267] [INFO ] [MAIN ] BARK: Loaded 38119 existing records. [2025-10-30T17:25:49.306237] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-30T17:25:49.431598] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:25:49.431823] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-30T17:25:49.431871] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-30T17:25:49.432102] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-30T17:25:49.432140] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-30T17:25:49.792432] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:49.825154] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:25:50.097494] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-30T17:25:50.610381] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T17:25:50.897518] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-30T17:25:51.253815] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T17:25:51.697500] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-30T17:25:52.428762] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-30T17:25:52.497489] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-30T17:25:52.713504] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T17:25:53.297490] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-30T17:25:53.961120] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T17:25:54.097483] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-30T17:25:54.773114] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T17:25:54.786170] [INFO ] [REMOTE ] BAM: Full fetch complete (75352 records). [2025-10-30T17:25:54.786411] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-30T17:25:54.902669] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-30T17:25:55.207832] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-30T17:25:55.208053] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-30T17:25:55.209007] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-30T17:25:55.209192] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-30T17:25:55.210806] [DEBUG] [LOCAL ] BAM: Trimmed 75352 records to 52453 (keeping 200 days of data) [2025-10-30T17:25:55.456455] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T17:25:55.571796] [DEBUG] [LOCAL ] BAM: Primary data saved (52453 records). [2025-10-30T17:25:55.571931] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-30T17:25:55.572725] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BAM took 33.0s. Estimated remaining: 4h 23m 0s. Rate: 8.2 symbols/min [2025-10-30T17:25:55.702239] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-30T17:25:55.748395] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:25:55.778813] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T17:25:55.819411] [DEBUG] [LOCAL ] BAX: Loaded 53536 existing records from primary storage. [2025-10-30T17:25:55.819741] [INFO ] [MAIN ] BAX: Loaded 53536 existing records. [2025-10-30T17:25:55.996371] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:25:55.996605] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-30T17:25:55.996689] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-30T17:25:55.997096] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-30T17:25:55.997152] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-30T17:25:56.352709] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:25:56.497544] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-30T17:25:56.861231] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T17:25:57.297487] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-30T17:25:57.953949] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T17:25:58.097495] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-30T17:25:58.572025] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T17:25:58.897467] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-30T17:25:58.943847] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-30T17:25:59.697508] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-30T17:25:59.948306] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-30T17:26:00.497544] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-30T17:26:01.135476] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T17:26:01.297539] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-30T17:26:01.817356] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T17:26:02.097462] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-30T17:26:02.220953] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T17:26:02.897543] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-30T17:26:03.583106] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T17:26:03.697558] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-30T17:26:04.262924] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T17:26:04.497498] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-30T17:26:04.908431] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T17:26:05.297510] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-30T17:26:06.103966] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-30T17:26:06.132267] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T17:26:06.144543] [INFO ] [REMOTE ] BANC: Full fetch complete (74675 records). [2025-10-30T17:26:06.144810] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-30T17:26:06.327729] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T17:26:06.585298] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-30T17:26:06.585383] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-30T17:26:06.586131] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-30T17:26:06.586196] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-30T17:26:06.587715] [DEBUG] [LOCAL ] BANC: Trimmed 74675 records to 51761 (keeping 200 days of data) [2025-10-30T17:26:06.893734] [DEBUG] [LOCAL ] BANC: Primary data saved (51761 records). [2025-10-30T17:26:06.893872] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-30T17:26:06.894760] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BANC took 28.1s. Estimated remaining: 4h 23m 33s. Rate: 8.2 symbols/min [2025-10-30T17:26:06.900089] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-30T17:26:07.069791] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:07.069975] [DEBUG] [LOCAL ] BB: No existing data file found in primary storage. [2025-10-30T17:26:07.070012] [WARN ] [MAIN ] BB: No existing data found, performing full refresh instead. [2025-10-30T17:26:07.070123] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-30T17:26:07.070164] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-30T17:26:07.070204] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-10-30T17:26:07.070236] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-30T17:26:07.425540] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:07.697486] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-30T17:26:07.740054] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-30T17:26:07.779135] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T17:26:08.497510] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-30T17:26:08.625934] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T17:26:09.297508] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-30T17:26:10.097466] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-30T17:26:10.290468] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-30T17:26:10.880083] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-30T17:26:10.897451] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-30T17:26:11.456222] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-30T17:26:11.697538] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-30T17:26:12.497494] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-30T17:26:12.609223] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-30T17:26:12.719313] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T17:26:13.297632] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-30T17:26:13.864069] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T17:26:14.034255] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-30T17:26:14.097478] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-30T17:26:14.897542] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-30T17:26:15.560570] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-30T17:26:15.697459] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-30T17:26:15.776013] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T17:26:16.497519] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-30T17:26:17.278308] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T17:26:17.303097] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-30T17:26:17.307742] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T17:26:17.313943] [INFO ] [REMOTE ] BAP: Full fetch complete (37063 records). [2025-10-30T17:26:17.314094] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-30T17:26:17.719970] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-30T17:26:17.720049] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-30T17:26:17.720483] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-30T17:26:17.720525] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-30T17:26:17.721399] [DEBUG] [LOCAL ] BAP: Trimmed 37063 records to 25204 (keeping 200 days of data) [2025-10-30T17:26:17.884146] [DEBUG] [LOCAL ] BAP: Primary data saved (25204 records). [2025-10-30T17:26:17.884275] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-30T17:26:17.884355] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BAP took 29.8s. Estimated remaining: 4h 24m 2s. Rate: 8.2 symbols/min [2025-10-30T17:26:18.061769] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:18.061939] [DEBUG] [LOCAL ] BBAI: No existing data file found in primary storage. [2025-10-30T17:26:18.061977] [WARN ] [MAIN ] BBAI: No existing data found, performing full refresh instead. [2025-10-30T17:26:18.062091] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-30T17:26:18.062134] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-30T17:26:18.062175] [DEBUG] [LOCAL ] BBAI: No primary data file found to delete. [2025-10-30T17:26:18.062207] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-30T17:26:18.104050] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-30T17:26:18.419774] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:18.562897] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T17:26:18.897513] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-30T17:26:19.697553] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-30T17:26:19.779893] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-30T17:26:20.221203] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:26:20.497481] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-30T17:26:21.297535] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-30T17:26:21.394176] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T17:26:21.672815] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-30T17:26:22.097480] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-30T17:26:22.739713] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T17:26:22.897485] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-30T17:26:23.061363] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T17:26:23.697601] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-30T17:26:24.497506] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-30T17:26:25.132253] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-30T17:26:25.172779] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T17:26:25.184475] [INFO ] [REMOTE ] BAX: Full fetch complete (77622 records). [2025-10-30T17:26:25.184615] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-30T17:26:25.302545] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-30T17:26:25.622894] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-30T17:26:25.622989] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-30T17:26:25.623855] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-30T17:26:25.623921] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-30T17:26:25.625435] [DEBUG] [LOCAL ] BAX: Trimmed 77622 records to 53926 (keeping 200 days of data) [2025-10-30T17:26:25.897792] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T17:26:25.908528] [INFO ] [REMOTE ] BARK: Full fetch complete (55855 records). [2025-10-30T17:26:25.909807] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-30T17:26:26.098689] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-30T17:26:26.369225] [DEBUG] [LOCAL ] BAX: Primary data saved (53926 records). [2025-10-30T17:26:26.389137] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-30T17:26:26.400865] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BAX took 30.8s. Estimated remaining: 4h 24m 7s. Rate: 8.1 symbols/min [2025-10-30T17:26:26.404094] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-30T17:26:26.416704] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-30T17:26:26.437478] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-30T17:26:26.448593] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-30T17:26:26.509799] [DEBUG] [LOCAL ] BARK: Trimmed 55855 records to 38484 (keeping 200 days of data) [2025-10-30T17:26:26.665252] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:26.852956] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-30T17:26:26.880445] [DEBUG] [LOCAL ] BARK: Primary data saved (38484 records). [2025-10-30T17:26:26.893452] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-30T17:26:26.893612] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BARK took 37.8s. Estimated remaining: 4h 22m 51s. Rate: 8.2 symbols/min [2025-10-30T17:26:26.894398] [DEBUG] [LOCAL ] BBAR: Loaded 42713 existing records from primary storage. [2025-10-30T17:26:26.915522] [INFO ] [MAIN ] BBAR: Loaded 42713 existing records. [2025-10-30T17:26:26.915408] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-30T17:26:27.235722] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:27.301620] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:26:27.301953] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-30T17:26:27.302011] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-30T17:26:27.302353] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-30T17:26:27.302426] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-30T17:26:27.614966] [DEBUG] [LOCAL ] BBD: Loaded 53282 existing records from primary storage. [2025-10-30T17:26:27.648294] [INFO ] [MAIN ] BBD: Loaded 53282 existing records. [2025-10-30T17:26:27.990290] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:27.996470] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:26:27.997192] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-30T17:26:27.997282] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-30T17:26:27.998237] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-30T17:26:27.998559] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-30T17:26:27.998601] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-30T17:26:28.374423] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:28.409095] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-30T17:26:28.509867] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-30T17:26:28.542191] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-30T17:26:29.297472] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-30T17:26:29.347250] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T17:26:30.097555] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-30T17:26:30.691484] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-30T17:26:30.759319] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T17:26:30.897565] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-30T17:26:31.240436] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T17:26:31.697520] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-30T17:26:32.291407] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T17:26:32.497512] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-30T17:26:33.297548] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-30T17:26:33.923389] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T17:26:34.102594] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-30T17:26:34.119379] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-30T17:26:34.897472] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-30T17:26:35.085423] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-30T17:26:35.671842] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T17:26:35.697464] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-30T17:26:36.497502] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-30T17:26:36.783475] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-30T17:26:37.282606] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-30T17:26:37.297463] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-30T17:26:37.492530] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:26:38.097497] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-30T17:26:38.897511] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-30T17:26:39.479418] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T17:26:39.579156] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-30T17:26:39.697578] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-30T17:26:40.040362] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T17:26:40.497507] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-30T17:26:41.297470] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-30T17:26:41.360958] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-30T17:26:41.841795] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:26:42.097523] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-30T17:26:42.856849] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-30T17:26:42.897521] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-30T17:26:43.697497] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-30T17:26:44.116430] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-30T17:26:44.497477] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-30T17:26:44.675539] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T17:26:44.687229] [INFO ] [REMOTE ] BB: Full fetch complete (76951 records). [2025-10-30T17:26:44.687363] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-30T17:26:45.096852] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-30T17:26:45.096988] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-30T17:26:45.097774] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-30T17:26:45.097860] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-30T17:26:45.099727] [DEBUG] [LOCAL ] BB: Trimmed 76951 records to 53238 (keeping 200 days of data) [2025-10-30T17:26:45.215063] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T17:26:45.301556] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-30T17:26:45.441258] [DEBUG] [LOCAL ] BB: Primary data saved (53238 records). [2025-10-30T17:26:45.441395] [INFO ] [MAIN ] BB: Full history saved. [2025-10-30T17:26:45.441479] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BB took 38.5s. Estimated remaining: 4h 24m 34s. Rate: 8.1 symbols/min [2025-10-30T17:26:45.611927] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:45.640083] [DEBUG] [LOCAL ] BBDC: Loaded 32235 existing records from primary storage. [2025-10-30T17:26:45.640337] [INFO ] [MAIN ] BBDC: Loaded 32235 existing records. [2025-10-30T17:26:45.831920] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:26:45.832098] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-30T17:26:45.832145] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-30T17:26:45.832531] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-30T17:26:45.832588] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-30T17:26:46.105174] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-30T17:26:46.197714] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:46.352506] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-30T17:26:46.539287] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-30T17:26:46.897483] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-30T17:26:47.389103] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T17:26:47.697638] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-30T17:26:48.019556] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T17:26:48.497493] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-30T17:26:48.991458] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T17:26:49.297468] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-30T17:26:49.428791] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-30T17:26:50.097503] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-30T17:26:50.710744] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T17:26:50.897502] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-30T17:26:51.205272] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T17:26:51.697493] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-30T17:26:52.497470] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-30T17:26:52.590071] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T17:26:52.602089] [INFO ] [REMOTE ] BBD: Full fetch complete (77272 records). [2025-10-30T17:26:52.602230] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-30T17:26:52.936087] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T17:26:53.054438] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-30T17:26:53.054532] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-30T17:26:53.055448] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-30T17:26:53.055520] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-30T17:26:53.057089] [DEBUG] [LOCAL ] BBD: Trimmed 77272 records to 53672 (keeping 200 days of data) [2025-10-30T17:26:53.298095] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-30T17:26:53.390083] [DEBUG] [LOCAL ] BBD: Primary data saved (53672 records). [2025-10-30T17:26:53.390213] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-30T17:26:53.390288] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBD took 26.5s. Estimated remaining: 4h 24m 33s. Rate: 8.1 symbols/min [2025-10-30T17:26:53.563565] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:53.569947] [DEBUG] [LOCAL ] BBDO: Loaded 4860 existing records from primary storage. [2025-10-30T17:26:53.570163] [INFO ] [MAIN ] BBDO: Loaded 4860 existing records. [2025-10-30T17:26:53.750007] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:26:53.750219] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-30T17:26:53.750270] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-30T17:26:53.750412] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-30T17:26:53.750451] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-30T17:26:54.111260] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:54.106847] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-30T17:26:54.525981] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:26:54.897523] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-30T17:26:55.028116] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T17:26:55.084039] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-30T17:26:55.096129] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-30T17:26:55.096290] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-30T17:26:55.503185] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-30T17:26:55.503273] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-30T17:26:55.504108] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-30T17:26:55.504175] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-30T17:26:55.505615] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-30T17:26:55.709851] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-30T17:26:55.809132] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-30T17:26:55.809259] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-30T17:26:55.809328] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBAI took 37.9s. Estimated remaining: 4h 23m 37s. Rate: 8.1 symbols/min [2025-10-30T17:26:55.976742] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:55.993234] [DEBUG] [LOCAL ] BBN: Loaded 17274 existing records from primary storage. [2025-10-30T17:26:55.993462] [INFO ] [MAIN ] BBN: Loaded 17274 existing records. [2025-10-30T17:26:56.175559] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:26:56.175836] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-30T17:26:56.175889] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-30T17:26:56.176122] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-30T17:26:56.176177] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-30T17:26:56.286585] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-30T17:26:56.504948] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-30T17:26:56.536265] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:56.602729] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-30T17:26:56.613348] [INFO ] [REMOTE ] BBAR: Full fetch complete (61366 records). [2025-10-30T17:26:56.613455] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-30T17:26:56.986040] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-30T17:26:56.986115] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-30T17:26:56.986822] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-30T17:26:56.986883] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-30T17:26:56.988028] [DEBUG] [LOCAL ] BBAR: Trimmed 61366 records to 43087 (keeping 200 days of data) [2025-10-30T17:26:57.092767] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-30T17:26:57.246751] [DEBUG] [LOCAL ] BBAR: Primary data saved (43087 records). [2025-10-30T17:26:57.246869] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-30T17:26:57.247796] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBAR took 30.8s. Estimated remaining: 4h 22m 31s. Rate: 8.2 symbols/min [2025-10-30T17:26:57.302721] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-30T17:26:57.419886] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:26:57.420059] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-30T17:26:57.420096] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-30T17:26:57.420201] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-30T17:26:57.420240] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-30T17:26:57.420280] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-30T17:26:57.420311] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-30T17:26:57.774381] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:26:58.097530] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-30T17:26:58.181509] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T17:26:58.897491] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-30T17:26:58.950774] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T17:26:59.697537] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-30T17:26:59.849687] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:26:59.849919] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-30T17:26:59.850020] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:26:59.850088] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-30T17:26:59.850153] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:26:59.850231] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-30T17:26:59.850316] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-30T17:26:59.850358] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-30T17:26:59.850403] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-30T17:26:59.850447] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 2.6s. Estimated remaining: 4h 21m 38s. Rate: 8.2 symbols/min [2025-10-30T17:27:00.033990] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:27:00.041883] [DEBUG] [LOCAL ] BBU: Loaded 5905 existing records from primary storage. [2025-10-30T17:27:00.042087] [INFO ] [MAIN ] BBU: Loaded 5905 existing records. [2025-10-30T17:27:00.224863] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:27:00.225170] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-30T17:27:00.225379] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-30T17:27:00.225637] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-30T17:27:00.225773] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-30T17:27:00.409631] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-30T17:27:00.502565] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-30T17:27:00.617150] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:27:01.297496] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-30T17:27:01.778508] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T17:27:02.108275] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-30T17:27:02.110634] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T17:27:02.708216] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T17:27:02.897492] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-30T17:27:03.697477] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-30T17:27:03.832245] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-30T17:27:04.303552] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T17:27:04.497522] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-30T17:27:05.297506] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-30T17:27:05.419303] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T17:27:05.675253] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T17:27:06.097494] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-30T17:27:06.898152] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T17:27:06.897575] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-30T17:27:07.290742] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-30T17:27:07.697510] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-30T17:27:08.349148] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-30T17:27:08.497465] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-30T17:27:09.255302] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T17:27:09.297521] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-30T17:27:10.097512] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-30T17:27:10.159732] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T17:27:10.775558] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T17:27:10.897480] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-30T17:27:11.323330] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-30T17:27:11.697500] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-30T17:27:12.284468] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-30T17:27:12.497545] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-30T17:27:13.297533] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-30T17:27:13.864537] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T17:27:13.874588] [INFO ] [REMOTE ] BBDC: Full fetch complete (48937 records). [2025-10-30T17:27:13.874785] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-30T17:27:14.104322] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-30T17:27:14.162486] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-30T17:27:14.194172] [INFO ] [REMOTE ] BBN: Full fetch complete (24984 records). [2025-10-30T17:27:14.204790] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-30T17:27:14.420951] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-30T17:27:14.426156] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-30T17:27:14.439105] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-30T17:27:14.439196] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-30T17:27:14.475685] [DEBUG] [LOCAL ] BBDC: Trimmed 48937 records to 32495 (keeping 200 days of data) [2025-10-30T17:27:14.784786] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-30T17:27:14.787698] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-30T17:27:14.788126] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-30T17:27:14.788178] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-30T17:27:14.823348] [DEBUG] [LOCAL ] BBN: Trimmed 24984 records to 17450 (keeping 200 days of data) [2025-10-30T17:27:14.898523] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-30T17:27:14.915209] [DEBUG] [LOCAL ] BBDC: Primary data saved (32495 records). [2025-10-30T17:27:14.915546] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-30T17:27:14.917156] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBDC took 29.5s. Estimated remaining: 4h 22m 46s. Rate: 8.2 symbols/min [2025-10-30T17:27:14.956160] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-30T17:27:15.146284] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:27:15.168441] [DEBUG] [LOCAL ] BBN: Primary data saved (17450 records). [2025-10-30T17:27:15.171805] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-30T17:27:15.171926] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBN took 19.4s. Estimated remaining: 4h 21m 30s. Rate: 8.2 symbols/min [2025-10-30T17:27:15.282013] [DEBUG] [LOCAL ] BBUC: Loaded 13767 existing records from primary storage. [2025-10-30T17:27:15.282253] [INFO ] [MAIN ] BBUC: Loaded 13767 existing records. [2025-10-30T17:27:15.441257] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-30T17:27:15.435464] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:27:15.559301] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:27:15.559555] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-30T17:27:15.559603] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-30T17:27:15.559831] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-30T17:27:15.559886] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-30T17:27:15.700251] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-30T17:27:15.740522] [DEBUG] [LOCAL ] BBVA: Loaded 48973 existing records from primary storage. [2025-10-30T17:27:15.812635] [INFO ] [MAIN ] BBVA: Loaded 48973 existing records. [2025-10-30T17:27:16.107749] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:27:16.128522] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:27:16.128740] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-30T17:27:16.128798] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-30T17:27:16.129125] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-30T17:27:16.129181] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-30T17:27:16.499171] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-30T17:27:16.528139] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:27:16.522354] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T17:27:16.989228] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-30T17:27:17.297548] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-30T17:27:18.041296] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T17:27:18.097513] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-30T17:27:18.507304] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T17:27:18.897484] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-30T17:27:19.449540] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T17:27:19.697536] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-30T17:27:20.343472] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-30T17:27:20.497502] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-30T17:27:21.118356] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T17:27:21.297481] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-30T17:27:21.599938] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-30T17:27:22.097543] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-30T17:27:22.897508] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-30T17:27:23.252925] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-30T17:27:23.637111] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-30T17:27:23.697461] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-30T17:27:24.497494] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-30T17:27:24.767757] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T17:27:24.782100] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-30T17:27:25.297494] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-30T17:27:25.860802] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T17:27:26.097470] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-30T17:27:26.493212] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T17:27:26.897499] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-30T17:27:27.288924] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T17:27:27.697551] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-30T17:27:28.089480] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T17:27:28.497506] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-30T17:27:29.205368] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-30T17:27:29.297499] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-30T17:27:29.832510] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T17:27:30.097525] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-30T17:27:30.814285] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-30T17:27:30.818536] [INFO ] [REMOTE ] BBU: Full fetch complete (7652 records). [2025-10-30T17:27:30.818675] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-30T17:27:30.902786] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-30T17:27:31.195055] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-30T17:27:31.195132] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-30T17:27:31.195338] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-30T17:27:31.195376] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-30T17:27:31.195815] [DEBUG] [LOCAL ] BBU: Trimmed 7652 records to 5965 (keeping 200 days of data) [2025-10-30T17:27:31.233685] [DEBUG] [LOCAL ] BBU: Primary data saved (5965 records). [2025-10-30T17:27:31.233820] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-30T17:27:31.233901] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBU took 31.4s. Estimated remaining: 4h 22m 46s. Rate: 8.2 symbols/min [2025-10-30T17:27:31.399958] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:27:31.427151] [DEBUG] [LOCAL ] BBW: Loaded 26817 existing records from primary storage. [2025-10-30T17:27:31.427439] [INFO ] [MAIN ] BBW: Loaded 26817 existing records. [2025-10-30T17:27:31.603027] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:27:31.603264] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-30T17:27:31.603312] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-30T17:27:31.603577] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-30T17:27:31.603631] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-30T17:27:31.698621] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-30T17:27:31.709902] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T17:27:31.735810] [INFO ] [REMOTE ] BBDO: Full fetch complete (7470 records). [2025-10-30T17:27:31.735901] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-30T17:27:32.257835] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:27:32.364361] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-30T17:27:32.370005] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-30T17:27:32.370424] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-30T17:27:32.374776] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-30T17:27:32.376320] [DEBUG] [LOCAL ] BBDO: Trimmed 7470 records to 4925 (keeping 200 days of data) [2025-10-30T17:27:32.376810] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-30T17:27:32.409922] [DEBUG] [LOCAL ] BBDO: Primary data saved (4925 records). [2025-10-30T17:27:32.410045] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-30T17:27:32.410137] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBDO took 39.0s. Estimated remaining: 4h 21m 40s. Rate: 8.2 symbols/min [2025-10-30T17:27:32.502822] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-30T17:27:32.584337] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:27:32.630612] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-30T17:27:32.630941] [INFO ] [MAIN ] BBWI: Loaded 53591 existing records. [2025-10-30T17:27:32.804836] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:27:32.805052] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-30T17:27:32.805099] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-30T17:27:32.805384] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-30T17:27:32.805421] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-30T17:27:33.154476] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T17:27:33.175812] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:27:33.297465] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-30T17:27:34.097552] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-30T17:27:34.712422] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T17:27:34.897513] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-30T17:27:35.019569] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:27:35.357964] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-30T17:27:35.697545] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-30T17:27:36.497497] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-30T17:27:37.297468] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-30T17:27:37.404797] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-30T17:27:37.520211] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T17:27:38.097493] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-30T17:27:38.352097] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T17:27:38.356403] [INFO ] [REMOTE ] BBUC: Full fetch complete (19417 records). [2025-10-30T17:27:38.356479] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-30T17:27:38.762476] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-30T17:27:38.762589] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-30T17:27:38.762987] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-30T17:27:38.763064] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-30T17:27:38.763896] [DEBUG] [LOCAL ] BBUC: Trimmed 19417 records to 13858 (keeping 200 days of data) [2025-10-30T17:27:38.860564] [DEBUG] [LOCAL ] BBUC: Primary data saved (13858 records). [2025-10-30T17:27:38.860944] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-30T17:27:38.861045] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 23.9s. Estimated remaining: 4h 21m 24s. Rate: 8.2 symbols/min [2025-10-30T17:27:38.902709] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-30T17:27:39.046058] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:27:39.097825] [DEBUG] [LOCAL ] BBY: Loaded 53423 existing records from primary storage. [2025-10-30T17:27:39.098259] [INFO ] [MAIN ] BBY: Loaded 53423 existing records. [2025-10-30T17:27:39.225896] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T17:27:39.308880] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:27:39.309086] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-30T17:27:39.309135] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-30T17:27:39.309461] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-30T17:27:39.309498] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-30T17:27:39.655596] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:27:39.697479] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-30T17:27:40.056749] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T17:27:40.497528] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-30T17:27:41.135020] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T17:27:41.297528] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-30T17:27:41.427578] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T17:27:42.097490] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-30T17:27:42.815452] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-30T17:27:42.858483] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-30T17:27:42.897458] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-30T17:27:43.695522] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-30T17:27:43.697681] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-30T17:27:44.497520] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-30T17:27:44.920700] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T17:27:45.297490] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-30T17:27:45.955162] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T17:27:46.097495] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-30T17:27:46.328289] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:27:46.895939] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-30T17:27:46.901153] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-30T17:27:47.697494] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-30T17:27:48.093458] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T17:27:48.497468] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-30T17:27:48.694991] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:27:49.297494] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-30T17:27:49.886010] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:27:50.097501] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-30T17:27:50.583770] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T17:27:50.897501] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-30T17:27:51.129206] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T17:27:51.697500] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-30T17:27:52.437331] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T17:27:52.497472] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-30T17:27:53.173021] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-30T17:27:53.297493] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-30T17:27:53.778554] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:27:54.097539] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-30T17:27:54.646839] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T17:27:54.897516] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-30T17:27:55.112728] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T17:27:55.697503] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-30T17:27:56.282540] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-30T17:27:56.497533] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-30T17:27:57.013837] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:27:57.297554] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-30T17:27:58.106133] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-30T17:27:58.132612] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-30T17:27:58.886018] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-30T17:27:58.897633] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-30T17:27:59.456522] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T17:27:59.463478] [INFO ] [REMOTE ] BBW: Full fetch complete (39158 records). [2025-10-30T17:27:59.463597] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-30T17:27:59.702753] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-30T17:27:59.851094] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-30T17:27:59.851179] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-30T17:27:59.851692] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-30T17:27:59.851755] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-30T17:27:59.852700] [DEBUG] [LOCAL ] BBW: Trimmed 39158 records to 26994 (keeping 200 days of data) [2025-10-30T17:28:00.009983] [DEBUG] [LOCAL ] BBW: Primary data saved (26994 records). [2025-10-30T17:28:00.010115] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-30T17:28:00.010194] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBW took 28.8s. Estimated remaining: 4h 23m 27s. Rate: 8.1 symbols/min [2025-10-30T17:28:00.177517] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:00.215774] [DEBUG] [LOCAL ] BC: Loaded 43736 existing records from primary storage. [2025-10-30T17:28:00.216069] [INFO ] [MAIN ] BC: Loaded 43736 existing records. [2025-10-30T17:28:00.396044] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:00.396397] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-30T17:28:00.396577] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-30T17:28:00.397168] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-30T17:28:00.397236] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-30T17:28:00.511729] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-30T17:28:00.544303] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-30T17:28:00.811166] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:01.004834] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T17:28:01.297528] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-30T17:28:02.029380] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T17:28:02.041699] [INFO ] [REMOTE ] BBWI: Full fetch complete (77636 records). [2025-10-30T17:28:02.041864] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-30T17:28:02.101671] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-30T17:28:02.457172] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-30T17:28:02.457262] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-30T17:28:02.458036] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-30T17:28:02.458101] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-30T17:28:02.459561] [DEBUG] [LOCAL ] BBWI: Trimmed 77636 records to 53981 (keeping 200 days of data) [2025-10-30T17:28:02.785835] [DEBUG] [LOCAL ] BBWI: Primary data saved (53981 records). [2025-10-30T17:28:02.785977] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-30T17:28:02.786157] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBWI took 30.4s. Estimated remaining: 4h 22m 37s. Rate: 8.1 symbols/min [2025-10-30T17:28:02.906577] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-30T17:28:02.920928] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-30T17:28:03.002953] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:03.033710] [DEBUG] [LOCAL ] BCAT: Loaded 33920 existing records from primary storage. [2025-10-30T17:28:03.033972] [INFO ] [MAIN ] BCAT: Loaded 33920 existing records. [2025-10-30T17:28:03.212891] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:03.213259] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-30T17:28:03.213386] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-30T17:28:03.213717] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-30T17:28:03.213830] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-30T17:28:03.606977] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:03.609603] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T17:28:03.697472] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-30T17:28:04.294927] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T17:28:04.497504] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-30T17:28:05.297554] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-30T17:28:05.502493] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-30T17:28:05.513978] [INFO ] [REMOTE ] BBY: Full fetch complete (77419 records). [2025-10-30T17:28:05.514099] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-30T17:28:05.918830] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-30T17:28:05.928245] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-30T17:28:05.946970] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-30T17:28:05.947181] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-30T17:28:05.949958] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-30T17:28:05.961571] [DEBUG] [LOCAL ] BBY: Trimmed 77419 records to 53811 (keeping 200 days of data) [2025-10-30T17:28:06.099002] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-30T17:28:06.319835] [DEBUG] [LOCAL ] BBY: Primary data saved (53811 records). [2025-10-30T17:28:06.320175] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-30T17:28:06.321120] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBY took 27.5s. Estimated remaining: 4h 21m 53s. Rate: 8.2 symbols/min [2025-10-30T17:28:06.432200] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T17:28:06.531738] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:06.559043] [DEBUG] [LOCAL ] BCC: Loaded 28458 existing records from primary storage. [2025-10-30T17:28:06.559308] [INFO ] [MAIN ] BCC: Loaded 28458 existing records. [2025-10-30T17:28:06.732153] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:06.732357] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-30T17:28:06.732405] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-30T17:28:06.732633] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-30T17:28:06.732717] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-30T17:28:06.902590] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-30T17:28:07.103632] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:07.702615] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-30T17:28:07.727584] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T17:28:07.739400] [INFO ] [REMOTE ] BBVA: Full fetch complete (71927 records). [2025-10-30T17:28:07.739539] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-30T17:28:08.145579] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-30T17:28:08.145808] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-30T17:28:08.146609] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-30T17:28:08.146710] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-30T17:28:08.148195] [DEBUG] [LOCAL ] BBVA: Trimmed 71927 records to 49335 (keeping 200 days of data) [2025-10-30T17:28:08.261293] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:28:08.482185] [DEBUG] [LOCAL ] BBVA: Primary data saved (49335 records). [2025-10-30T17:28:08.482347] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-30T17:28:08.482438] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBVA took 53.3s. Estimated remaining: 4h 20m 58s. Rate: 8.2 symbols/min [2025-10-30T17:28:08.502632] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-30T17:28:08.706520] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:08.728933] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T17:28:08.785677] [DEBUG] [LOCAL ] BCE: Loaded 52224 existing records from primary storage. [2025-10-30T17:28:08.786020] [INFO ] [MAIN ] BCE: Loaded 52224 existing records. [2025-10-30T17:28:08.964929] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:08.965203] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-30T17:28:08.965264] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-30T17:28:08.965552] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-30T17:28:08.965682] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-30T17:28:09.305264] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-30T17:28:09.330192] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:09.521882] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T17:28:10.097474] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-30T17:28:10.135916] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T17:28:10.897517] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-30T17:28:11.415155] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T17:28:11.697464] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-30T17:28:11.898841] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:28:12.497504] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-30T17:28:12.584415] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-30T17:28:13.297521] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-30T17:28:13.738424] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T17:28:14.097475] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-30T17:28:14.327803] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T17:28:14.897505] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-30T17:28:15.105071] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-30T17:28:15.697501] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-30T17:28:16.010698] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T17:28:16.497533] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-30T17:28:16.942639] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T17:28:17.297491] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-30T17:28:17.709819] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T17:28:18.097548] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-30T17:28:18.781862] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T17:28:18.897461] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-30T17:28:19.056251] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T17:28:19.697552] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-30T17:28:20.227322] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:28:20.497452] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-30T17:28:20.688188] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-30T17:28:21.297465] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-30T17:28:21.879375] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T17:28:22.097523] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-30T17:28:22.127017] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-30T17:28:22.897519] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-30T17:28:23.176621] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T17:28:23.697517] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-30T17:28:23.758292] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T17:28:24.497510] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-30T17:28:24.885016] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T17:28:25.297514] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-30T17:28:25.614843] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:28:26.097511] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-30T17:28:26.798856] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T17:28:26.897483] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-30T17:28:27.131707] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T17:28:27.697572] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-30T17:28:28.216137] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:28:28.497554] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-30T17:28:29.088443] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T17:28:29.099077] [INFO ] [REMOTE ] BC: Full fetch complete (63978 records). [2025-10-30T17:28:29.099337] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-30T17:28:29.308506] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-30T17:28:29.528565] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-30T17:28:29.528675] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-30T17:28:29.529456] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-30T17:28:29.529523] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-30T17:28:29.530876] [DEBUG] [LOCAL ] BC: Trimmed 63978 records to 44049 (keeping 200 days of data) [2025-10-30T17:28:29.820948] [DEBUG] [LOCAL ] BC: Primary data saved (44049 records). [2025-10-30T17:28:29.821278] [INFO ] [MAIN ] BC: Full history saved. [2025-10-30T17:28:29.822660] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BC took 29.8s. Estimated remaining: 4h 22m 60s. Rate: 8.1 symbols/min [2025-10-30T17:28:30.043835] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-30T17:28:30.051438] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:30.090884] [DEBUG] [LOCAL ] BCH: Loaded 29451 existing records from primary storage. [2025-10-30T17:28:30.091145] [INFO ] [MAIN ] BCH: Loaded 29451 existing records. [2025-10-30T17:28:30.103257] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-30T17:28:30.300562] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:30.300952] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-30T17:28:30.301103] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-30T17:28:30.301727] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-30T17:28:30.301786] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-30T17:28:30.631979] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:28:30.713945] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:30.897487] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-30T17:28:30.926224] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T17:28:31.697517] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-30T17:28:32.462719] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-30T17:28:32.475986] [INFO ] [REMOTE ] BCE: Full fetch complete (76086 records). [2025-10-30T17:28:32.476219] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-30T17:28:32.502779] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-30T17:28:32.895947] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T17:28:32.993719] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-30T17:28:32.993904] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-30T17:28:32.995114] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-30T17:28:32.995186] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-30T17:28:32.997730] [DEBUG] [LOCAL ] BCE: Trimmed 76086 records to 52608 (keeping 200 days of data) [2025-10-30T17:28:33.323599] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-30T17:28:33.383887] [DEBUG] [LOCAL ] BCE: Primary data saved (52608 records). [2025-10-30T17:28:33.384054] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-30T17:28:33.385517] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCE took 24.9s. Estimated remaining: 4h 22m 17s. Rate: 8.1 symbols/min [2025-10-30T17:28:33.590339] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:33.593033] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T17:28:33.621558] [DEBUG] [LOCAL ] BCO: Loaded 24124 existing records from primary storage. [2025-10-30T17:28:33.621856] [INFO ] [MAIN ] BCO: Loaded 24124 existing records. [2025-10-30T17:28:33.795615] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:33.795862] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-30T17:28:33.795909] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-30T17:28:33.796184] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-30T17:28:33.796239] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-30T17:28:34.097772] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-30T17:28:34.149896] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:34.205000] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T17:28:34.897543] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-30T17:28:34.956322] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T17:28:35.697500] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-30T17:28:35.930132] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T17:28:36.503417] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-30T17:28:36.508546] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T17:28:37.297502] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-30T17:28:37.371455] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-30T17:28:38.097487] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-30T17:28:38.154811] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T17:28:38.897492] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-30T17:28:39.130545] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T17:28:39.697544] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-30T17:28:39.874188] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-30T17:28:39.881540] [INFO ] [REMOTE ] BCC: Full fetch complete (41765 records). [2025-10-30T17:28:39.881633] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-30T17:28:40.249331] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-30T17:28:40.249430] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-30T17:28:40.249945] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-30T17:28:40.250009] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-30T17:28:40.250942] [DEBUG] [LOCAL ] BCC: Trimmed 41765 records to 28656 (keeping 200 days of data) [2025-10-30T17:28:40.434346] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T17:28:40.444421] [DEBUG] [LOCAL ] BCC: Primary data saved (28656 records). [2025-10-30T17:28:40.444516] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-30T17:28:40.444587] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BCC took 34.1s. Estimated remaining: 4h 22m 7s. Rate: 8.1 symbols/min [2025-10-30T17:28:40.506133] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-30T17:28:40.614017] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:40.662588] [DEBUG] [LOCAL ] BCS: Loaded 53435 existing records from primary storage. [2025-10-30T17:28:40.662905] [INFO ] [MAIN ] BCS: Loaded 53435 existing records. [2025-10-30T17:28:40.841621] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:40.841860] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-30T17:28:40.841913] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-30T17:28:40.842517] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-30T17:28:40.842585] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-30T17:28:41.191968] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:41.297457] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-30T17:28:41.480244] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T17:28:42.097491] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-30T17:28:42.186895] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T17:28:42.897504] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-30T17:28:43.697469] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-30T17:28:43.750501] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-30T17:28:44.018596] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T17:28:44.497471] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-30T17:28:44.638287] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T17:28:45.297499] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-30T17:28:45.536935] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T17:28:46.097524] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-30T17:28:46.202508] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T17:28:46.866132] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-30T17:28:46.897462] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-30T17:28:47.697471] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-30T17:28:48.448271] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-30T17:28:48.497502] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-30T17:28:48.622092] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T17:28:49.297514] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-30T17:28:49.817301] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:28:50.097503] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-30T17:28:50.426484] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T17:28:50.434530] [INFO ] [REMOTE ] BCAT: Full fetch complete (49979 records). [2025-10-30T17:28:50.434680] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-30T17:28:50.822860] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-30T17:28:50.822938] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-30T17:28:50.823517] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-30T17:28:50.823560] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-30T17:28:50.824593] [DEBUG] [LOCAL ] BCAT: Trimmed 49979 records to 34186 (keeping 200 days of data) [2025-10-30T17:28:50.915167] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-30T17:28:51.037244] [DEBUG] [LOCAL ] BCAT: Primary data saved (34186 records). [2025-10-30T17:28:51.037432] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-30T17:28:51.037556] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCAT took 48.3s. Estimated remaining: 4h 22m 29s. Rate: 8.1 symbols/min [2025-10-30T17:28:51.206187] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:28:51.233193] [DEBUG] [LOCAL ] BCSF: Loaded 27662 existing records from primary storage. [2025-10-30T17:28:51.233684] [INFO ] [MAIN ] BCSF: Loaded 27662 existing records. [2025-10-30T17:28:51.413169] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:28:51.413484] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-30T17:28:51.413545] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-30T17:28:51.413882] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-30T17:28:51.413936] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-30T17:28:51.708572] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-30T17:28:51.808752] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:28:51.864823] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T17:28:51.866421] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-30T17:28:52.497463] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-30T17:28:52.608005] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T17:28:53.297528] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-30T17:28:53.975314] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-30T17:28:54.071529] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-30T17:28:54.097479] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-30T17:28:54.763093] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T17:28:54.897497] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-30T17:28:55.554561] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-30T17:28:55.697528] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-30T17:28:56.497522] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-30T17:28:56.630310] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T17:28:57.297531] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-30T17:28:57.867020] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T17:28:58.024312] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T17:28:58.097498] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-30T17:28:58.897539] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-30T17:28:59.469268] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T17:28:59.697524] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-30T17:28:59.874533] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T17:29:00.497529] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-30T17:29:01.101270] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T17:29:01.108764] [INFO ] [REMOTE ] BCH: Full fetch complete (41723 records). [2025-10-30T17:29:01.108874] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-30T17:29:01.316288] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-30T17:29:01.526996] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-30T17:29:01.536167] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-30T17:29:01.536837] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T17:29:01.537484] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-30T17:29:01.543352] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-30T17:29:01.544766] [DEBUG] [LOCAL ] BCH: Trimmed 41723 records to 29646 (keeping 200 days of data) [2025-10-30T17:29:01.752400] [DEBUG] [LOCAL ] BCH: Primary data saved (29646 records). [2025-10-30T17:29:01.752543] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-30T17:29:01.752633] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCH took 31.9s. Estimated remaining: 4h 22m 52s. Rate: 8.1 symbols/min [2025-10-30T17:29:01.968333] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:01.988486] [DEBUG] [LOCAL ] BCX: Loaded 21477 existing records from primary storage. [2025-10-30T17:29:01.988788] [INFO ] [MAIN ] BCX: Loaded 21477 existing records. [2025-10-30T17:29:02.098806] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-30T17:29:02.186168] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:29:02.186505] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-30T17:29:02.186595] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-30T17:29:02.187075] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-30T17:29:02.187145] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-30T17:29:02.297126] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-30T17:29:02.586116] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:29:02.897515] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-30T17:29:03.613911] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T17:29:03.661616] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T17:29:03.697499] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-30T17:29:04.497540] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-30T17:29:05.297477] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-30T17:29:05.382439] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T17:29:05.394372] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T17:29:06.097503] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-30T17:29:06.301065] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-30T17:29:06.897525] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-30T17:29:06.944445] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T17:29:07.697567] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-30T17:29:08.497487] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-30T17:29:08.606145] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T17:29:08.610773] [INFO ] [REMOTE ] BCO: Full fetch complete (35830 records). [2025-10-30T17:29:08.610976] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-30T17:29:08.953766] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-30T17:29:08.993227] [INFO ] [REMOTE ] BCS: Full fetch complete (77532 records). [2025-10-30T17:29:09.003689] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-30T17:29:09.168596] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-30T17:29:09.196173] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-30T17:29:09.236323] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-30T17:29:09.241677] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-30T17:29:09.300518] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-30T17:29:09.344262] [DEBUG] [LOCAL ] BCO: Trimmed 35830 records to 24261 (keeping 200 days of data) [2025-10-30T17:29:09.602018] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-30T17:29:09.610954] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-30T17:29:09.613093] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-30T17:29:09.613595] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-30T17:29:09.616823] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T17:29:09.627244] [DEBUG] [LOCAL ] BCS: Trimmed 77532 records to 53824 (keeping 200 days of data) [2025-10-30T17:29:09.783971] [DEBUG] [LOCAL ] BCO: Primary data saved (24261 records). [2025-10-30T17:29:09.785934] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-30T17:29:09.786267] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCO took 36.4s. Estimated remaining: 4h 22m 50s. Rate: 8.1 symbols/min [2025-10-30T17:29:09.969153] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:10.100311] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-30T17:29:10.176989] [DEBUG] [LOCAL ] BDC: Loaded 23469 existing records from primary storage. [2025-10-30T17:29:10.202899] [INFO ] [MAIN ] BDC: Loaded 23469 existing records. [2025-10-30T17:29:10.221228] [DEBUG] [LOCAL ] BCS: Primary data saved (53824 records). [2025-10-30T17:29:10.253372] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-30T17:29:10.298772] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCS took 29.9s. Estimated remaining: 4h 21m 41s. Rate: 8.1 symbols/min [2025-10-30T17:29:10.407238] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:29:10.407638] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-30T17:29:10.407740] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-30T17:29:10.413183] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-30T17:29:10.423193] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:29:10.422686] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-30T17:29:10.818346] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:29:10.887582] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T17:29:10.897455] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-30T17:29:11.697472] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-30T17:29:11.763418] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T17:29:12.304054] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T17:29:12.497509] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-30T17:29:13.193049] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T17:29:13.297512] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-30T17:29:14.097539] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-30T17:29:14.188056] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T17:29:14.897486] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-30T17:29:15.314030] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-30T17:29:15.324843] [INFO ] [REMOTE ] BCSF: Full fetch complete (40255 records). [2025-10-30T17:29:15.325059] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-30T17:29:15.697704] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-30T17:29:15.881223] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-30T17:29:15.881335] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-30T17:29:15.881934] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-30T17:29:15.882016] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-30T17:29:15.883382] [DEBUG] [LOCAL ] BCSF: Trimmed 40255 records to 27908 (keeping 200 days of data) [2025-10-30T17:29:15.962859] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-30T17:29:16.076930] [DEBUG] [LOCAL ] BCSF: Primary data saved (27908 records). [2025-10-30T17:29:16.077055] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-30T17:29:16.077131] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCSF took 25.0s. Estimated remaining: 4h 21m 19s. Rate: 8.1 symbols/min [2025-10-30T17:29:16.497562] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-30T17:29:16.856698] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T17:29:17.297511] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-30T17:29:17.584176] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T17:29:18.007069] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:29:18.097626] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-30T17:29:18.897613] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-30T17:29:19.029560] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T17:29:19.035624] [INFO ] [REMOTE ] BCX: Full fetch complete (33325 records). [2025-10-30T17:29:19.035803] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-30T17:29:19.408297] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-30T17:29:19.408387] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-30T17:29:19.408851] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-30T17:29:19.408911] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-30T17:29:19.409935] [DEBUG] [LOCAL ] BCX: Trimmed 33325 records to 21626 (keeping 200 days of data) [2025-10-30T17:29:19.531964] [DEBUG] [LOCAL ] BCX: Primary data saved (21626 records). [2025-10-30T17:29:19.532081] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-30T17:29:19.532154] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCX took 17.8s. Estimated remaining: 4h 20m 37s. Rate: 8.2 symbols/min [2025-10-30T17:29:19.616134] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T17:29:19.697593] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-30T17:29:20.611611] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T17:29:20.618165] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-30T17:29:21.252485] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-30T17:29:21.297574] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-30T17:29:21.996148] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T17:29:22.097538] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-30T17:29:23.083251] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T17:29:23.089318] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-30T17:29:24.009025] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-30T17:29:24.014593] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-30T17:29:24.999387] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T17:29:25.008698] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-30T17:29:26.058860] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T17:29:26.064226] [INFO ] [REMOTE ] BDC: Full fetch complete (35695 records). [2025-10-30T17:29:26.064319] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-30T17:29:26.463989] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-30T17:29:26.464151] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-30T17:29:26.464979] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-30T17:29:26.465052] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-30T17:29:26.466421] [DEBUG] [LOCAL ] BDC: Trimmed 35695 records to 23690 (keeping 200 days of data) [2025-10-30T17:29:26.623065] [DEBUG] [LOCAL ] BDC: Primary data saved (23690 records). [2025-10-30T17:29:26.623258] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-30T17:29:26.623365] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 16.8s. Estimated remaining: 4h 20m 27s. Rate: 8.2 symbols/min [2025-10-30T17:29:27.162628] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:27.295743] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:27.331503] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:27.361490] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:27.389305] [DEBUG] [LOCAL ] BDJ: Loaded 28733 existing records from primary storage. [2025-10-30T17:29:27.391813] [INFO ] [MAIN ] BDJ: Loaded 28733 existing records. [2025-10-30T17:29:27.625500] [DEBUG] [LOCAL ] BDX: Loaded 52016 existing records from primary storage. [2025-10-30T17:29:27.647081] [INFO ] [MAIN ] BDX: Loaded 52016 existing records. [2025-10-30T17:29:27.679690] [DEBUG] [LOCAL ] BDN: Loaded 47517 existing records from primary storage. [2025-10-30T17:29:27.673709] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:29:27.680324] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-30T17:29:27.670325] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-30T17:29:27.695549] [INFO ] [MAIN ] BDN: Loaded 47517 existing records. [2025-10-30T17:29:27.704327] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-30T17:29:27.758828] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-30T17:29:27.783854] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-30T17:29:27.777210] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-30T17:29:28.301745] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:29:28.337006] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:29:28.337773] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-30T17:29:28.351576] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-30T17:29:28.351760] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-30T17:29:28.351451] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-30T17:29:28.376372] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-30T17:29:28.377779] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:29:28.383245] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-30T17:29:28.393769] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-30T17:29:28.399802] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-30T17:29:28.430190] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-30T17:29:28.430337] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-30T17:29:28.514356] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-30T17:29:28.546505] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-30T17:29:29.260440] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:29:29.321963] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-30T17:29:29.567944] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:29:29.574401] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-30T17:29:29.695769] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:29:29.704125] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-30T17:29:29.724823] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:29:29.725088] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-30T17:29:30.683183] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T17:29:30.689601] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-30T17:29:30.804055] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:29:30.814384] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-30T17:29:30.995475] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T17:29:31.005943] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-30T17:29:31.161738] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T17:29:31.172301] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-30T17:29:31.662358] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T17:29:31.697490] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-30T17:29:31.855431] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T17:29:32.091001] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T17:29:32.433251] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T17:29:32.505025] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-30T17:29:32.509185] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T17:29:33.297473] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-30T17:29:33.734416] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T17:29:34.097492] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-30T17:29:34.786846] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T17:29:34.897489] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-30T17:29:35.387001] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T17:29:35.697464] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-30T17:29:36.378564] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T17:29:36.497512] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-30T17:29:37.034783] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T17:29:37.284426] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T17:29:37.297443] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-30T17:29:38.097540] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-30T17:29:38.153278] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-30T17:29:38.897528] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-30T17:29:39.411099] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T17:29:39.697498] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-30T17:29:40.015384] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-30T17:29:40.497489] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-30T17:29:41.277252] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T17:29:41.297463] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-30T17:29:41.693454] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T17:29:42.097506] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-30T17:29:42.626409] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T17:29:42.897471] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-30T17:29:43.093922] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-30T17:29:43.697505] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-30T17:29:44.497971] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-30T17:29:44.500797] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-30T17:29:44.846159] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T17:29:45.297490] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-30T17:29:46.068359] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-30T17:29:46.097487] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-30T17:29:46.897510] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-30T17:29:47.270098] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-30T17:29:47.436116] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T17:29:47.697511] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-30T17:29:48.253209] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T17:29:48.497505] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-30T17:29:48.589146] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T17:29:49.297533] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-30T17:29:49.609916] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T17:29:50.097532] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-30T17:29:50.897470] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-30T17:29:51.128036] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-30T17:29:51.401232] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T17:29:51.689500] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T17:29:51.697444] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-30T17:29:52.497474] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-30T17:29:52.520196] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-30T17:29:53.297483] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-30T17:29:53.676405] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T17:29:54.097500] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-30T17:29:54.410453] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-30T17:29:54.417429] [INFO ] [REMOTE ] BDJ: Full fetch complete (42584 records). [2025-10-30T17:29:54.417569] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-30T17:29:54.790334] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-30T17:29:54.790444] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-30T17:29:54.790972] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-30T17:29:54.791035] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-30T17:29:54.791924] [DEBUG] [LOCAL ] BDJ: Trimmed 42584 records to 29022 (keeping 200 days of data) [2025-10-30T17:29:54.897593] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-30T17:29:54.969565] [DEBUG] [LOCAL ] BDJ: Primary data saved (29022 records). [2025-10-30T17:29:54.969720] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-30T17:29:54.969807] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDJ took 28.3s. Estimated remaining: 4h 23m 25s. Rate: 8.1 symbols/min [2025-10-30T17:29:55.133773] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:55.133921] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-30T17:29:55.133958] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-30T17:29:55.134093] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-30T17:29:55.134158] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-30T17:29:55.134242] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-30T17:29:55.134294] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-30T17:29:55.488668] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:29:55.588083] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T17:29:55.697477] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-30T17:29:56.497532] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-30T17:29:57.096089] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-30T17:29:57.107919] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-30T17:29:57.108059] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-30T17:29:57.307476] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-30T17:29:57.518732] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-30T17:29:57.518849] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-30T17:29:57.519740] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-30T17:29:57.519847] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-30T17:29:57.521681] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 54051 (keeping 200 days of data) [2025-10-30T17:29:57.554379] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-30T17:29:57.647231] [INFO ] [REMOTE ] BDX: Full fetch complete (75372 records). [2025-10-30T17:29:57.656707] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-30T17:29:57.795984] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T17:29:58.134674] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-30T17:29:58.123715] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T17:29:58.222030] [INFO ] [REMOTE ] BDN: Full fetch complete (69417 records). [2025-10-30T17:29:58.244165] [DEBUG] [LOCAL ] BE: Primary data saved (54051 records). [2025-10-30T17:29:58.244274] [INFO ] [MAIN ] BE: Full history saved. [2025-10-30T17:29:58.244399] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BE took 31.6s. Estimated remaining: 4h 22m 41s. Rate: 8.1 symbols/min [2025-10-30T17:29:58.240012] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-30T17:29:58.502697] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-30T17:29:58.598368] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-30T17:29:58.637750] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-30T17:29:58.679094] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:29:58.683168] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-30T17:29:58.741690] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-30T17:29:58.829782] [DEBUG] [LOCAL ] BDX: Trimmed 75372 records to 52404 (keeping 200 days of data) [2025-10-30T17:29:58.905349] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-30T17:29:59.039112] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-30T17:29:59.039241] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-30T17:29:59.044120] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-30T17:29:59.062671] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-30T17:29:59.070442] [DEBUG] [LOCAL ] BEKE: Loaded 53161 existing records from primary storage. [2025-10-30T17:29:59.073631] [INFO ] [MAIN ] BEKE: Loaded 53161 existing records. [2025-10-30T17:29:59.085533] [DEBUG] [LOCAL ] BDN: Trimmed 69417 records to 47889 (keeping 200 days of data) [2025-10-30T17:29:59.340419] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-30T17:29:59.361763] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:29:59.367173] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-30T17:29:59.367483] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-30T17:29:59.372850] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-30T17:29:59.373691] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-30T17:29:59.700035] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-30T17:29:59.971536] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:00.099237] [DEBUG] [LOCAL ] BDN: Primary data saved (47889 records). [2025-10-30T17:30:00.099887] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-30T17:30:00.100463] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BDN took 33.5s. Estimated remaining: 4h 21m 45s. Rate: 8.1 symbols/min [2025-10-30T17:30:00.150329] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T17:30:00.236639] [DEBUG] [LOCAL ] BDX: Primary data saved (52404 records). [2025-10-30T17:30:00.252316] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-30T17:30:00.253304] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BDX took 33.6s. Estimated remaining: 4h 20m 35s. Rate: 8.1 symbols/min [2025-10-30T17:30:00.416927] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:00.481486] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:00.507418] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-30T17:30:00.539078] [DEBUG] [LOCAL ] BEN: Loaded 53088 existing records from primary storage. [2025-10-30T17:30:00.550172] [DEBUG] [LOCAL ] BEP: Loaded 38826 existing records from primary storage. [2025-10-30T17:30:00.549726] [INFO ] [MAIN ] BEN: Loaded 53088 existing records. [2025-10-30T17:30:00.582374] [INFO ] [MAIN ] BEP: Loaded 38826 existing records. [2025-10-30T17:30:00.901992] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:00.919539] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-30T17:30:00.921280] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-30T17:30:00.926251] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-30T17:30:00.926172] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:00.926500] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-30T17:30:00.926579] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-30T17:30:00.927127] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-30T17:30:00.927274] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-30T17:30:00.927173] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-30T17:30:00.944352] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-30T17:30:01.297540] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-30T17:30:01.651903] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:01.671693] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:02.097555] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-30T17:30:02.191685] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T17:30:02.897497] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-30T17:30:03.697490] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-30T17:30:03.944454] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-30T17:30:04.193040] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-30T17:30:04.498251] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-30T17:30:04.498392] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-30T17:30:05.297541] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-30T17:30:06.101410] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-30T17:30:06.112566] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-30T17:30:06.650831] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T17:30:06.897504] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-30T17:30:07.551780] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T17:30:07.697602] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-30T17:30:07.979528] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-30T17:30:08.083393] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T17:30:08.497572] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-30T17:30:09.297483] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-30T17:30:10.097504] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-30T17:30:10.190678] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-30T17:30:10.355878] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-30T17:30:10.718578] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T17:30:10.897485] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-30T17:30:11.697504] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-30T17:30:12.138616] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T17:30:12.497514] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-30T17:30:12.870180] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-30T17:30:12.871146] [INFO ] [REMOTE ] BEDU: Full fetch complete (1314 records). [2025-10-30T17:30:12.871213] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-30T17:30:13.067188] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-10-30T17:30:13.067372] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:30:13.067439] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:30:13.067510] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-30T17:30:13.067598] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-30T17:30:13.067676] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-30T17:30:13.067740] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-30T17:30:13.067810] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 18.1s. Estimated remaining: 4h 21m 15s. Rate: 8.1 symbols/min [2025-10-30T17:30:13.256789] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:13.288888] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-30T17:30:13.299452] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-30T17:30:13.341234] [DEBUG] [LOCAL ] BEPC: Loaded 46214 existing records from primary storage. [2025-10-30T17:30:13.341535] [INFO ] [MAIN ] BEPC: Loaded 46214 existing records. [2025-10-30T17:30:13.541046] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:13.541254] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-30T17:30:13.541301] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-30T17:30:13.542013] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-30T17:30:13.542070] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-30T17:30:13.890165] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:14.097478] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-30T17:30:14.732461] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T17:30:14.897524] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-30T17:30:15.697516] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-30T17:30:16.500786] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-30T17:30:16.506396] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-30T17:30:17.192858] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T17:30:17.293558] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (3.20 seconds). [2025-10-30T17:30:17.302830] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-30T17:30:18.097531] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-30T17:30:18.897551] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-30T17:30:19.194041] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-30T17:30:19.257239] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-30T17:30:19.308838] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T17:30:19.697510] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-30T17:30:20.027461] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T17:30:20.497510] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-30T17:30:21.074695] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T17:30:21.297501] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-30T17:30:21.849940] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T17:30:22.097515] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-30T17:30:22.494602] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T17:30:22.897513] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-30T17:30:23.396005] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T17:30:23.697520] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-30T17:30:24.347144] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T17:30:24.497542] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-30T17:30:24.831718] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T17:30:25.297502] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-30T17:30:26.005104] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T17:30:26.097483] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-30T17:30:26.381795] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T17:30:26.897493] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-30T17:30:27.161523] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T17:30:27.697506] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-30T17:30:28.176462] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:30:28.497506] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-30T17:30:29.298564] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-30T17:30:29.302934] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T17:30:29.317904] [INFO ] [REMOTE ] BEN: Full fetch complete (77040 records). [2025-10-30T17:30:29.318147] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-30T17:30:29.777584] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-30T17:30:29.777758] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-30T17:30:29.778621] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-30T17:30:29.778740] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-30T17:30:29.805463] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T17:30:29.814911] [DEBUG] [LOCAL ] BEN: Trimmed 77040 records to 53473 (keeping 200 days of data) [2025-10-30T17:30:30.110428] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-30T17:30:30.135066] [DEBUG] [LOCAL ] BEN: Primary data saved (53473 records). [2025-10-30T17:30:30.135195] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-30T17:30:30.135270] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEN took 30.0s. Estimated remaining: 4h 22m 31s. Rate: 8.1 symbols/min [2025-10-30T17:30:30.313994] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:30.320692] [DEBUG] [LOCAL ] BEPH: Loaded 4754 existing records from primary storage. [2025-10-30T17:30:30.320911] [INFO ] [MAIN ] BEPH: Loaded 4754 existing records. [2025-10-30T17:30:30.501449] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:30.501697] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-30T17:30:30.501754] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-30T17:30:30.501910] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-30T17:30:30.501946] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-30T17:30:30.851461] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:30.897454] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-30T17:30:30.957160] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-30T17:30:30.969048] [INFO ] [REMOTE ] BEKE: Full fetch complete (77308 records). [2025-10-30T17:30:30.969213] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-30T17:30:31.392249] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-30T17:30:31.392122] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T17:30:31.392450] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-30T17:30:31.395449] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-30T17:30:31.396359] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-30T17:30:31.408072] [DEBUG] [LOCAL ] BEKE: Trimmed 77308 records to 53544 (keeping 200 days of data) [2025-10-30T17:30:31.426293] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:30:31.712145] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-30T17:30:31.761048] [DEBUG] [LOCAL ] BEKE: Primary data saved (53544 records). [2025-10-30T17:30:31.761186] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-30T17:30:31.761265] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEKE took 33.5s. Estimated remaining: 4h 21m 33s. Rate: 8.1 symbols/min [2025-10-30T17:30:31.935957] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:31.941447] [DEBUG] [LOCAL ] BEPI: Loaded 3436 existing records from primary storage. [2025-10-30T17:30:31.941679] [INFO ] [MAIN ] BEPI: Loaded 3436 existing records. [2025-10-30T17:30:32.117144] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:32.117364] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-30T17:30:32.117411] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-30T17:30:32.117554] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-30T17:30:32.117624] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-30T17:30:32.466060] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:32.497477] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-30T17:30:32.819561] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T17:30:32.989110] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T17:30:33.297510] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-30T17:30:34.097542] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-30T17:30:34.382415] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-30T17:30:34.652941] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-30T17:30:34.897566] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-30T17:30:35.202423] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T17:30:35.697535] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-30T17:30:35.937995] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-30T17:30:36.497493] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-30T17:30:36.840270] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-30T17:30:37.297544] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-30T17:30:37.681134] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-30T17:30:38.097511] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-30T17:30:38.897519] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-30T17:30:39.248698] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-30T17:30:39.697530] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-30T17:30:39.826947] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-30T17:30:39.837810] [INFO ] [REMOTE ] BEPC: Full fetch complete (68854 records). [2025-10-30T17:30:39.837968] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-30T17:30:40.231176] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-30T17:30:40.231564] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T17:30:40.231727] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-30T17:30:40.235839] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-30T17:30:40.235929] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-30T17:30:40.237989] [DEBUG] [LOCAL ] BEPC: Trimmed 68854 records to 46566 (keeping 200 days of data) [2025-10-30T17:30:40.497521] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-30T17:30:40.538789] [DEBUG] [LOCAL ] BEPC: Primary data saved (46566 records). [2025-10-30T17:30:40.538980] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-30T17:30:40.539899] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEPC took 27.5s. Estimated remaining: 4h 21m 38s. Rate: 8.1 symbols/min [2025-10-30T17:30:40.716713] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:40.721760] [DEBUG] [LOCAL ] BEPJ: Loaded 3047 existing records from primary storage. [2025-10-30T17:30:40.721961] [INFO ] [MAIN ] BEPJ: Loaded 3047 existing records. [2025-10-30T17:30:40.904397] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:40.904948] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-30T17:30:40.905006] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-30T17:30:40.905179] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-30T17:30:40.905219] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-30T17:30:41.293945] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:41.297512] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-30T17:30:41.575788] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-30T17:30:41.604348] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T17:30:42.097497] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-30T17:30:42.400087] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T17:30:42.897508] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-30T17:30:43.697514] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-30T17:30:44.081544] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-30T17:30:44.163139] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-30T17:30:44.497494] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-30T17:30:44.922625] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-30T17:30:45.297492] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-30T17:30:45.636877] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-30T17:30:46.097496] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-30T17:30:46.490813] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T17:30:46.897489] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-30T17:30:47.697490] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-30T17:30:47.859214] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T17:30:48.192562] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T17:30:48.497511] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-30T17:30:48.728958] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-30T17:30:49.297469] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-30T17:30:49.704548] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-30T17:30:49.705784] [INFO ] [REMOTE ] BEPI: Full fetch complete (4711 records). [2025-10-30T17:30:49.705853] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-30T17:30:50.060584] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-30T17:30:50.060680] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-30T17:30:50.060819] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-30T17:30:50.060858] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-30T17:30:50.061199] [DEBUG] [LOCAL ] BEPI: Trimmed 4711 records to 3450 (keeping 200 days of data) [2025-10-30T17:30:50.084311] [DEBUG] [LOCAL ] BEPI: Primary data saved (3450 records). [2025-10-30T17:30:50.084423] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-30T17:30:50.084535] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEPI took 18.3s. Estimated remaining: 4h 21m 48s. Rate: 8.1 symbols/min [2025-10-30T17:30:50.102609] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-30T17:30:50.252515] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:50.283861] [DEBUG] [LOCAL ] BFAM: Loaded 33826 existing records from primary storage. [2025-10-30T17:30:50.284131] [INFO ] [MAIN ] BFAM: Loaded 33826 existing records. [2025-10-30T17:30:50.480099] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:50.480299] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-30T17:30:50.480342] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-30T17:30:50.480929] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-30T17:30:50.480988] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-30T17:30:50.824804] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:50.897454] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-30T17:30:51.209621] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T17:30:51.697535] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-30T17:30:51.812563] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:30:52.109969] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-30T17:30:52.497524] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-30T17:30:52.798638] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-30T17:30:53.297492] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-30T17:30:53.686134] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-30T17:30:54.097495] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-30T17:30:54.539307] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-30T17:30:54.897560] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-30T17:30:55.268843] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-30T17:30:55.697563] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-30T17:30:55.990251] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-30T17:30:56.497503] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-30T17:30:56.873303] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T17:30:57.297475] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-30T17:30:57.784154] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-30T17:30:57.785767] [INFO ] [REMOTE ] BEPH: Full fetch complete (7456 records). [2025-10-30T17:30:57.785839] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-30T17:30:58.102697] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-30T17:30:58.170609] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-30T17:30:58.170716] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-30T17:30:58.170936] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-30T17:30:58.170978] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-30T17:30:58.171920] [DEBUG] [LOCAL ] BEPH: Trimmed 7456 records to 4772 (keeping 200 days of data) [2025-10-30T17:30:58.200532] [DEBUG] [LOCAL ] BEPH: Primary data saved (4772 records). [2025-10-30T17:30:58.200693] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-30T17:30:58.200793] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPH took 28.1s. Estimated remaining: 4h 21m 47s. Rate: 8.1 symbols/min [2025-10-30T17:30:58.373529] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:30:58.410152] [DEBUG] [LOCAL ] BFH: Loaded 41042 existing records from primary storage. [2025-10-30T17:30:58.410474] [INFO ] [MAIN ] BFH: Loaded 41042 existing records. [2025-10-30T17:30:58.588006] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:30:58.588244] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-30T17:30:58.588292] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-30T17:30:58.588708] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-30T17:30:58.588764] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-30T17:30:58.910898] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-30T17:30:58.952274] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:30:59.564674] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T17:30:59.574918] [INFO ] [REMOTE ] BEP: Full fetch complete (59241 records). [2025-10-30T17:30:59.575069] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-30T17:30:59.702576] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-30T17:30:59.978558] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-30T17:30:59.978687] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-30T17:30:59.979410] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-30T17:30:59.979493] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-30T17:30:59.997032] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T17:31:00.003438] [DEBUG] [LOCAL ] BEP: Trimmed 59241 records to 39132 (keeping 200 days of data) [2025-10-30T17:31:00.231869] [DEBUG] [LOCAL ] BEP: Primary data saved (39132 records). [2025-10-30T17:31:00.232017] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-30T17:31:00.232110] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEP took 60.0s. Estimated remaining: 4h 20m 54s. Rate: 8.1 symbols/min [2025-10-30T17:31:00.396032] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:00.408944] [DEBUG] [LOCAL ] BFK: Loaded 13795 existing records from primary storage. [2025-10-30T17:31:00.409145] [INFO ] [MAIN ] BFK: Loaded 13795 existing records. [2025-10-30T17:31:00.504809] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-30T17:31:00.583234] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:31:00.583440] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-30T17:31:00.583486] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-30T17:31:00.583708] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-30T17:31:00.583763] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-30T17:31:00.934044] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:01.252118] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:31:01.297502] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-30T17:31:01.638237] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T17:31:01.978569] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T17:31:02.097511] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-30T17:31:02.897552] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-30T17:31:03.140315] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T17:31:03.262228] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-30T17:31:03.697476] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-30T17:31:03.999389] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T17:31:04.497532] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-30T17:31:05.297526] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-30T17:31:05.629148] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T17:31:05.766469] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T17:31:06.097516] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-30T17:31:06.826554] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-30T17:31:06.897509] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-30T17:31:07.222496] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-30T17:31:07.697552] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-30T17:31:08.497510] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-30T17:31:08.570945] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T17:31:08.888683] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-30T17:31:08.889895] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4367 records). [2025-10-30T17:31:08.889971] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-30T17:31:09.283553] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-30T17:31:09.283681] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-30T17:31:09.283862] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-30T17:31:09.283924] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-30T17:31:09.284456] [DEBUG] [LOCAL ] BEPJ: Trimmed 4367 records to 3054 (keeping 200 days of data) [2025-10-30T17:31:09.298394] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-30T17:31:09.303732] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3054 records). [2025-10-30T17:31:09.305118] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-30T17:31:09.305215] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPJ took 28.8s. Estimated remaining: 4h 21m 1s. Rate: 8.1 symbols/min [2025-10-30T17:31:09.476469] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:09.526764] [DEBUG] [LOCAL ] BFLY: Loaded 51840 existing records from primary storage. [2025-10-30T17:31:09.527119] [INFO ] [MAIN ] BFLY: Loaded 51840 existing records. [2025-10-30T17:31:09.703026] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:31:09.703238] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-30T17:31:09.703286] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-30T17:31:09.703718] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-30T17:31:09.703774] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-30T17:31:10.069997] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:10.097460] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-30T17:31:10.266564] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:31:10.897515] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-30T17:31:11.444484] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T17:31:11.709614] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-30T17:31:11.715219] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T17:31:12.363324] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T17:31:12.497549] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-30T17:31:13.141784] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T17:31:13.297514] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-30T17:31:14.097523] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-30T17:31:14.408269] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T17:31:14.897531] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-30T17:31:15.325072] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:31:15.697492] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-30T17:31:16.002472] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T17:31:16.497496] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-30T17:31:17.142574] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-30T17:31:17.297505] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-30T17:31:18.097521] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-30T17:31:18.247624] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-30T17:31:18.893603] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-30T17:31:18.903402] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-30T17:31:19.087137] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T17:31:19.697493] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-30T17:31:20.161882] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:31:20.259302] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T17:31:20.497524] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-30T17:31:21.297520] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-30T17:31:21.835497] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:31:21.906160] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T17:31:22.097493] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-30T17:31:22.897472] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-30T17:31:23.107935] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T17:31:23.697594] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-30T17:31:24.150033] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T17:31:24.158526] [INFO ] [REMOTE ] BFAM: Full fetch complete (47885 records). [2025-10-30T17:31:24.158695] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-30T17:31:24.500412] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-30T17:31:24.597443] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-30T17:31:24.597566] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-30T17:31:24.598216] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-30T17:31:24.598284] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-30T17:31:24.599816] [DEBUG] [LOCAL ] BFAM: Trimmed 47885 records to 34193 (keeping 200 days of data) [2025-10-30T17:31:24.811334] [DEBUG] [LOCAL ] BFAM: Primary data saved (34193 records). [2025-10-30T17:31:24.811471] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-30T17:31:24.811548] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 34.7s. Estimated remaining: 4h 22m 1s. Rate: 8.1 symbols/min [2025-10-30T17:31:25.005292] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:25.005836] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-30T17:31:25.005948] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-30T17:31:25.006511] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-30T17:31:25.006600] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-30T17:31:25.006776] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-30T17:31:25.006821] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-30T17:31:25.139777] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-30T17:31:25.305275] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-30T17:31:25.413829] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:25.728531] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T17:31:26.043060] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T17:31:26.097550] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-30T17:31:26.897519] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-30T17:31:26.930019] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T17:31:27.697518] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-30T17:31:28.041277] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T17:31:28.437342] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-30T17:31:28.443210] [INFO ] [REMOTE ] BFK: Full fetch complete (19496 records). [2025-10-30T17:31:28.443312] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-30T17:31:28.443899] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:31:28.444002] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:31:28.444058] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:31:28.444139] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-30T17:31:28.444219] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-30T17:31:28.444268] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-10-30T17:31:28.444470] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-10-30T17:31:28.444574] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFK took 28.2s. Estimated remaining: 4h 21m 22s. Rate: 8.1 symbols/min [2025-10-30T17:31:28.497498] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-30T17:31:28.625457] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:28.637380] [DEBUG] [LOCAL ] BFZ: Loaded 11890 existing records from primary storage. [2025-10-30T17:31:28.637691] [INFO ] [MAIN ] BFZ: Loaded 11890 existing records. [2025-10-30T17:31:28.828985] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:31:28.829196] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-30T17:31:28.829245] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-30T17:31:28.829417] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-30T17:31:28.829457] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-30T17:31:28.963438] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T17:31:29.234630] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:29.297464] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-30T17:31:29.930701] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T17:31:30.097502] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-30T17:31:30.714816] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T17:31:30.897471] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-30T17:31:31.697509] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-30T17:31:31.897030] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:31:32.120179] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-30T17:31:32.497501] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-30T17:31:33.297512] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-30T17:31:33.723325] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:31:33.869036] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-30T17:31:34.097507] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-30T17:31:34.897507] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-30T17:31:35.326234] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T17:31:35.354989] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T17:31:35.364386] [INFO ] [REMOTE ] BFH: Full fetch complete (60304 records). [2025-10-30T17:31:35.364527] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-30T17:31:35.711616] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-30T17:31:35.770481] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-30T17:31:35.770567] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-30T17:31:35.771243] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-30T17:31:35.771307] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-30T17:31:35.772520] [DEBUG] [LOCAL ] BFH: Trimmed 60304 records to 41335 (keeping 200 days of data) [2025-10-30T17:31:36.029707] [DEBUG] [LOCAL ] BFH: Primary data saved (41335 records). [2025-10-30T17:31:36.029835] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-30T17:31:36.029916] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFH took 37.8s. Estimated remaining: 4h 21m 16s. Rate: 8.1 symbols/min [2025-10-30T17:31:36.200081] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:36.242046] [DEBUG] [LOCAL ] BG: Loaded 50335 existing records from primary storage. [2025-10-30T17:31:36.242355] [INFO ] [MAIN ] BG: Loaded 50335 existing records. [2025-10-30T17:31:36.348159] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T17:31:36.425508] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:31:36.425736] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-30T17:31:36.425789] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-30T17:31:36.426257] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-30T17:31:36.426311] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-30T17:31:36.502618] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-30T17:31:36.814755] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:37.057229] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-30T17:31:37.297501] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-30T17:31:37.848204] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-30T17:31:38.097495] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-30T17:31:38.780627] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T17:31:38.897507] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-30T17:31:39.455194] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T17:31:39.697587] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-30T17:31:40.497504] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-30T17:31:41.204610] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T17:31:41.228302] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T17:31:41.297500] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-30T17:31:42.097499] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-30T17:31:42.759692] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-30T17:31:42.897470] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-30T17:31:43.020620] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-30T17:31:43.697506] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-30T17:31:44.155794] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T17:31:44.236769] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:31:44.497501] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-30T17:31:45.297621] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-30T17:31:45.953874] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T17:31:46.097550] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-30T17:31:46.544265] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T17:31:46.570524] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-30T17:31:46.897509] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-30T17:31:47.552620] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T17:31:47.697548] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-30T17:31:48.497509] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-30T17:31:49.297473] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-30T17:31:49.360326] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-30T17:31:49.363090] [INFO ] [REMOTE ] BFS: Full fetch complete (13036 records). [2025-10-30T17:31:49.363170] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-30T17:31:49.363563] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:31:49.363665] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:31:49.363723] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:31:49.363787] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-30T17:31:49.363850] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-30T17:31:49.363885] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-30T17:31:49.363922] [DEBUG] [LOCAL ] BFS: No derivative data file found to delete. [2025-10-30T17:31:49.363974] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFS took 24.6s. Estimated remaining: 4h 21m 57s. Rate: 8.1 symbols/min [2025-10-30T17:31:49.535934] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:49.536854] [DEBUG] [LOCAL ] BGB: No existing data file found in primary storage. [2025-10-30T17:31:49.536918] [WARN ] [MAIN ] BGB: No existing data found, performing full refresh instead. [2025-10-30T17:31:49.537191] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-30T17:31:49.537692] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-30T17:31:49.537778] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-30T17:31:49.554567] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-30T17:31:49.652413] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-30T17:31:49.702287] [INFO ] [REMOTE ] BFLY: Full fetch complete (75100 records). [2025-10-30T17:31:49.708034] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-30T17:31:49.724271] [FATAL] [VALIDATOR ] BFLY: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:31:49.741459] [FATAL] [MAIN ] BFLY: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:31:49.761169] [WARN ] [MAIN ] BFLY: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:31:49.762476] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-30T17:31:49.778794] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-30T17:31:49.789220] [INFO ] [LOCAL ] BFLY: Starting deletion of derivative data. [2025-10-30T17:31:49.850907] [DEBUG] [LOCAL ] BFLY: Deleted derivative data file. [2025-10-30T17:31:49.863000] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFLY took 40.6s. Estimated remaining: 4h 20m 52s. Rate: 8.1 symbols/min [2025-10-30T17:31:50.132312] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:50.114243] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-30T17:31:50.137538] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:50.138626] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-10-30T17:31:50.138721] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-10-30T17:31:50.138848] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-30T17:31:50.138912] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-30T17:31:50.138973] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-30T17:31:50.139043] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-30T17:31:50.508838] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:50.575545] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T17:31:50.849619] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T17:31:50.897450] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-30T17:31:51.697476] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-30T17:31:51.732914] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T17:31:51.736002] [INFO ] [REMOTE ] BFZ: Full fetch complete (17643 records). [2025-10-30T17:31:51.736077] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-30T17:31:52.099142] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-30T17:31:52.099220] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-30T17:31:52.099551] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-30T17:31:52.099609] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-30T17:31:52.100142] [DEBUG] [LOCAL ] BFZ: Trimmed 17643 records to 11954 (keeping 200 days of data) [2025-10-30T17:31:52.174671] [DEBUG] [LOCAL ] BFZ: Primary data saved (11954 records). [2025-10-30T17:31:52.174829] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-30T17:31:52.174926] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFZ took 23.7s. Estimated remaining: 4h 20m 3s. Rate: 8.1 symbols/min [2025-10-30T17:31:52.345365] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:31:52.357993] [DEBUG] [LOCAL ] BGR: Loaded 12968 existing records from primary storage. [2025-10-30T17:31:52.358180] [INFO ] [MAIN ] BGR: Loaded 12968 existing records. [2025-10-30T17:31:52.499271] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-30T17:31:52.539168] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:31:52.539491] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-30T17:31:52.539543] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-30T17:31:52.539775] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-30T17:31:52.539830] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-30T17:31:52.907814] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:31:53.297540] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-30T17:31:53.415461] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T17:31:53.492515] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-30T17:31:54.071734] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-30T17:31:54.097506] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-30T17:31:54.724151] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T17:31:54.897518] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-30T17:31:55.697470] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-30T17:31:55.720023] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T17:31:56.486495] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T17:31:56.497483] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-30T17:31:57.297496] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-30T17:31:57.869933] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T17:31:57.957705] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-30T17:31:58.097488] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-30T17:31:58.897500] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-30T17:31:59.332785] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-30T17:31:59.702759] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-30T17:31:59.710605] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T17:32:00.265040] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T17:32:00.497536] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-30T17:32:01.088932] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-30T17:32:01.297478] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-30T17:32:02.097526] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-30T17:32:02.707315] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T17:32:02.897472] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-30T17:32:02.940758] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-30T17:32:03.574338] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T17:32:03.697528] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-30T17:32:04.497580] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-30T17:32:04.513568] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T17:32:05.241114] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-30T17:32:05.297535] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-30T17:32:05.884919] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T17:32:06.097542] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-30T17:32:06.897545] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-30T17:32:07.027316] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T17:32:07.614491] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-30T17:32:07.697559] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-30T17:32:08.214088] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T17:32:08.497503] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-30T17:32:09.106529] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-30T17:32:09.297528] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-30T17:32:09.965520] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T17:32:10.097514] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-30T17:32:10.906456] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-30T17:32:10.908916] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-30T17:32:11.671766] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T17:32:11.697528] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-30T17:32:12.497534] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-30T17:32:13.027561] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-30T17:32:13.139849] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T17:32:13.297528] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-30T17:32:14.101090] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-30T17:32:14.103267] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T17:32:14.897512] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-30T17:32:15.369081] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T17:32:15.649141] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T17:32:15.697516] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-30T17:32:16.497524] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-30T17:32:16.691862] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T17:32:16.696899] [INFO ] [REMOTE ] BGB: Full fetch complete (26217 records). [2025-10-30T17:32:16.697033] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-30T17:32:17.112869] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-30T17:32:17.113114] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-30T17:32:17.113777] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-30T17:32:17.113888] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-30T17:32:17.114562] [DEBUG] [LOCAL ] BGB: Trimmed 26217 records to 16991 (keeping 200 days of data) [2025-10-30T17:32:17.202845] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:32:17.236287] [DEBUG] [LOCAL ] BGB: Primary data saved (16991 records). [2025-10-30T17:32:17.236470] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-30T17:32:17.236551] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BGB took 27.9s. Estimated remaining: 4h 22m 20s. Rate: 8.0 symbols/min [2025-10-30T17:32:17.302610] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-30T17:32:17.447876] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:32:17.493508] [DEBUG] [LOCAL ] BGS: Loaded 50465 existing records from primary storage. [2025-10-30T17:32:17.493859] [INFO ] [MAIN ] BGS: Loaded 50465 existing records. [2025-10-30T17:32:17.675495] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:32:17.675718] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-30T17:32:17.675771] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-30T17:32:17.676389] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-30T17:32:17.676446] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-30T17:32:18.041584] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:32:18.049975] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T17:32:18.097450] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-30T17:32:18.622383] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T17:32:18.897531] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-30T17:32:19.617099] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-30T17:32:19.620695] [INFO ] [REMOTE ] BGR: Full fetch complete (19864 records). [2025-10-30T17:32:19.620775] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-30T17:32:19.702712] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-30T17:32:20.024697] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-30T17:32:20.024790] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-30T17:32:20.025159] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-30T17:32:20.025202] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-30T17:32:20.025881] [DEBUG] [LOCAL ] BGR: Trimmed 19864 records to 13046 (keeping 200 days of data) [2025-10-30T17:32:20.103156] [DEBUG] [LOCAL ] BGR: Primary data saved (13046 records). [2025-10-30T17:32:20.103283] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-30T17:32:20.103358] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BGR took 27.9s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-10-30T17:32:20.274128] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:32:20.284178] [DEBUG] [LOCAL ] BGSF: Loaded 8354 existing records from primary storage. [2025-10-30T17:32:20.284416] [INFO ] [MAIN ] BGSF: Loaded 8354 existing records. [2025-10-30T17:32:20.464251] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:32:20.464530] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-30T17:32:20.464601] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-30T17:32:20.464933] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-30T17:32:20.465034] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-30T17:32:20.502676] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-30T17:32:20.840834] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:32:21.120627] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T17:32:21.297465] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-30T17:32:21.611696] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-30T17:32:21.616083] [INFO ] [REMOTE ] BGH: Full fetch complete (23076 records). [2025-10-30T17:32:21.616159] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-30T17:32:22.048527] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-30T17:32:22.048639] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-30T17:32:22.049204] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-30T17:32:22.049273] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-30T17:32:22.050010] [DEBUG] [LOCAL ] BGH: Trimmed 23076 records to 16760 (keeping 200 days of data) [2025-10-30T17:32:22.101166] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-30T17:32:22.171201] [DEBUG] [LOCAL ] BGH: Primary data saved (16760 records). [2025-10-30T17:32:22.171315] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-30T17:32:22.171398] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGH took 32.3s. Estimated remaining: 4h 20m 44s. Rate: 8.1 symbols/min [2025-10-30T17:32:22.378581] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:32:22.378951] [DEBUG] [LOCAL ] BGT: No existing data file found in primary storage. [2025-10-30T17:32:22.379108] [WARN ] [MAIN ] BGT: No existing data found, performing full refresh instead. [2025-10-30T17:32:22.379296] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-30T17:32:22.379458] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-30T17:32:22.379516] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-10-30T17:32:22.379552] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-30T17:32:22.745030] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T17:32:22.831417] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:32:22.897490] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-30T17:32:23.306290] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T17:32:23.697495] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-30T17:32:23.803234] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T17:32:23.813818] [INFO ] [REMOTE ] BG: Full fetch complete (72669 records). [2025-10-30T17:32:23.813947] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-30T17:32:23.814573] [FATAL] [VALIDATOR ] BG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:32:23.814699] [FATAL] [MAIN ] BG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:32:23.814774] [WARN ] [MAIN ] BG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:32:23.814871] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-30T17:32:23.814951] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-30T17:32:23.814988] [INFO ] [LOCAL ] BG: Starting deletion of derivative data. [2025-10-30T17:32:23.815256] [DEBUG] [LOCAL ] BG: Deleted derivative data file. [2025-10-30T17:32:23.815349] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BG took 47.8s. Estimated remaining: 4h 19m 50s. Rate: 8.1 symbols/min [2025-10-30T17:32:23.988409] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:32:23.999880] [DEBUG] [LOCAL ] BGX: Loaded 10899 existing records from primary storage. [2025-10-30T17:32:24.000108] [INFO ] [MAIN ] BGX: Loaded 10899 existing records. [2025-10-30T17:32:24.105150] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T17:32:24.182196] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:32:24.182423] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-30T17:32:24.182472] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-30T17:32:24.182721] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-30T17:32:24.182777] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-30T17:32:24.505612] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-30T17:32:24.553826] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:32:25.297530] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-30T17:32:25.778761] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T17:32:25.798351] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-30T17:32:26.097543] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-30T17:32:26.591981] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T17:32:26.897495] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-30T17:32:27.435904] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T17:32:27.697695] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-30T17:32:28.227739] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T17:32:28.497487] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-30T17:32:28.971913] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T17:32:29.297516] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-30T17:32:30.097539] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-30T17:32:30.465789] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-30T17:32:30.544669] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T17:32:30.897498] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-30T17:32:31.180605] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-30T17:32:31.697502] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-30T17:32:32.041287] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-30T17:32:32.497493] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-30T17:32:33.297496] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-30T17:32:34.005340] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-30T17:32:34.076416] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T17:32:34.097451] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-30T17:32:34.897482] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-30T17:32:35.087702] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:32:35.436143] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T17:32:35.697497] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-30T17:32:36.288012] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T17:32:36.497497] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-30T17:32:37.192400] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T17:32:37.297512] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-30T17:32:37.844588] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-30T17:32:38.097505] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-30T17:32:38.897498] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-30T17:32:39.291538] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T17:32:39.654495] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-30T17:32:39.697494] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-30T17:32:40.225466] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-30T17:32:40.497492] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-30T17:32:41.297511] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-30T17:32:41.848318] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T17:32:41.986584] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-30T17:32:42.097480] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-30T17:32:42.435805] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T17:32:42.897513] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-30T17:32:43.641738] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-30T17:32:43.645327] [INFO ] [REMOTE ] BGX: Full fetch complete (16529 records). [2025-10-30T17:32:43.645405] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-30T17:32:43.705856] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-30T17:32:44.001460] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-30T17:32:44.001539] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-30T17:32:44.001918] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-30T17:32:44.001980] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-30T17:32:44.002469] [DEBUG] [LOCAL ] BGX: Trimmed 16529 records to 11016 (keeping 200 days of data) [2025-10-30T17:32:44.071850] [DEBUG] [LOCAL ] BGX: Primary data saved (11016 records). [2025-10-30T17:32:44.072003] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-30T17:32:44.072114] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BGX took 20.3s. Estimated remaining: 4h 21m 25s. Rate: 8.0 symbols/min [2025-10-30T17:32:44.237126] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:32:44.237318] [DEBUG] [LOCAL ] BGY: No existing data file found in primary storage. [2025-10-30T17:32:44.237354] [WARN ] [MAIN ] BGY: No existing data found, performing full refresh instead. [2025-10-30T17:32:44.237461] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-30T17:32:44.237514] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-30T17:32:44.237580] [DEBUG] [LOCAL ] BGY: No primary data file found to delete. [2025-10-30T17:32:44.237623] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-30T17:32:44.507034] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-30T17:32:44.587638] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:32:45.046231] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:32:45.067498] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-30T17:32:45.297493] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-30T17:32:46.098307] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-30T17:32:46.102992] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-30T17:32:46.897480] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-30T17:32:47.003091] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T17:32:47.564287] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T17:32:47.697483] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-30T17:32:48.468561] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T17:32:48.497464] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-30T17:32:49.285678] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T17:32:49.297448] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-30T17:32:50.000715] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T17:32:50.097459] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-30T17:32:50.897475] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-30T17:32:51.019768] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-30T17:32:51.023129] [INFO ] [REMOTE ] BGT: Full fetch complete (23617 records). [2025-10-30T17:32:51.023202] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-30T17:32:51.405599] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-30T17:32:51.405725] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-30T17:32:51.406173] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-30T17:32:51.406220] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-30T17:32:51.407102] [DEBUG] [LOCAL ] BGT: Trimmed 23617 records to 15852 (keeping 200 days of data) [2025-10-30T17:32:51.511743] [DEBUG] [LOCAL ] BGT: Primary data saved (15852 records). [2025-10-30T17:32:51.511891] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-30T17:32:51.511964] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGT took 29.3s. Estimated remaining: 4h 21m 18s. Rate: 8.0 symbols/min [2025-10-30T17:32:51.712974] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-30T17:32:51.767255] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:32:51.792594] [DEBUG] [LOCAL ] BH: Loaded 16708 existing records from primary storage. [2025-10-30T17:32:51.792983] [INFO ] [MAIN ] BH: Loaded 16708 existing records. [2025-10-30T17:32:52.043114] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:32:52.043381] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-30T17:32:52.043445] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-30T17:32:52.043733] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-30T17:32:52.043793] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-30T17:32:52.500846] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-30T17:32:52.534221] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:32:52.568986] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-30T17:32:52.593056] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T17:32:53.286294] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T17:32:53.297448] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-30T17:32:54.093325] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-30T17:32:54.099179] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-30T17:32:54.690076] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-30T17:32:54.897507] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-30T17:32:55.697477] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-30T17:32:55.841495] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T17:32:56.102286] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-30T17:32:56.497503] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-30T17:32:57.066621] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-30T17:32:57.297525] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-30T17:32:57.954677] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-30T17:32:58.097504] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-30T17:32:58.884710] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-30T17:32:58.887857] [INFO ] [REMOTE ] BGSF: Full fetch complete (9855 records). [2025-10-30T17:32:58.887928] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-30T17:32:58.902567] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-30T17:32:59.256272] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-30T17:32:59.256365] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-30T17:32:59.256617] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-30T17:32:59.256693] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-30T17:32:59.257126] [DEBUG] [LOCAL ] BGSF: Trimmed 9855 records to 8411 (keeping 200 days of data) [2025-10-30T17:32:59.303801] [DEBUG] [LOCAL ] BGSF: Primary data saved (8411 records). [2025-10-30T17:32:59.303895] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-30T17:32:59.303967] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGSF took 39.2s. Estimated remaining: 4h 21m 13s. Rate: 8.0 symbols/min [2025-10-30T17:32:59.495554] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:32:59.495760] [DEBUG] [LOCAL ] BHC: No existing data file found in primary storage. [2025-10-30T17:32:59.495809] [WARN ] [MAIN ] BHC: No existing data found, performing full refresh instead. [2025-10-30T17:32:59.495946] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-30T17:32:59.496023] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-30T17:32:59.496087] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-10-30T17:32:59.496122] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-30T17:32:59.702575] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-30T17:32:59.846196] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:00.497529] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-30T17:33:00.971206] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T17:33:01.150189] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-30T17:33:01.162480] [INFO ] [REMOTE ] BGS: Full fetch complete (72692 records). [2025-10-30T17:33:01.162700] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-30T17:33:01.298958] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-30T17:33:01.463190] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:33:01.629660] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-30T17:33:01.629759] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-30T17:33:01.630728] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-30T17:33:01.630792] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-30T17:33:01.632494] [DEBUG] [LOCAL ] BGS: Trimmed 72692 records to 50834 (keeping 200 days of data) [2025-10-30T17:33:01.930858] [DEBUG] [LOCAL ] BGS: Primary data saved (50834 records). [2025-10-30T17:33:01.930995] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-30T17:33:01.932227] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGS took 44.7s. Estimated remaining: 4h 20m 27s. Rate: 8.1 symbols/min [2025-10-30T17:33:02.107077] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-30T17:33:02.112011] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:02.133460] [DEBUG] [LOCAL ] BHE: Loaded 23159 existing records from primary storage. [2025-10-30T17:33:02.133725] [INFO ] [MAIN ] BHE: Loaded 23159 existing records. [2025-10-30T17:33:02.327743] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:33:02.334913] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-30T17:33:02.346278] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-30T17:33:02.347596] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T17:33:02.347668] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-30T17:33:02.354682] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-30T17:33:02.712800] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:02.889417] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T17:33:02.897464] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-30T17:33:03.687188] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-30T17:33:03.697471] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-30T17:33:04.497390] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T17:33:04.497516] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-30T17:33:05.297533] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-30T17:33:05.837033] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:33:06.097514] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-30T17:33:06.316358] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T17:33:06.897565] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-30T17:33:07.191306] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T17:33:07.661629] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T17:33:07.697464] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-30T17:33:08.410723] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T17:33:08.497483] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-30T17:33:09.138771] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-30T17:33:09.297551] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-30T17:33:10.061301] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T17:33:10.064905] [INFO ] [REMOTE ] BH: Full fetch complete (19659 records). [2025-10-30T17:33:10.064984] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-30T17:33:10.102817] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-30T17:33:10.433155] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-30T17:33:10.433235] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-30T17:33:10.433574] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-30T17:33:10.433635] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-30T17:33:10.434248] [DEBUG] [LOCAL ] BH: Trimmed 19659 records to 16799 (keeping 200 days of data) [2025-10-30T17:33:10.528244] [DEBUG] [LOCAL ] BH: Primary data saved (16799 records). [2025-10-30T17:33:10.528369] [INFO ] [MAIN ] BH: Full history saved. [2025-10-30T17:33:10.528444] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BH took 19.0s. Estimated remaining: 4h 20m 29s. Rate: 8.1 symbols/min [2025-10-30T17:33:10.694227] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:10.694379] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-30T17:33:10.694415] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-30T17:33:10.694524] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-30T17:33:10.694583] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-30T17:33:10.694681] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-30T17:33:10.694743] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-30T17:33:10.902615] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-30T17:33:11.076760] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:11.091933] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:33:11.697601] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-30T17:33:12.140688] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T17:33:12.145576] [INFO ] [REMOTE ] BGY: Full fetch complete (32937 records). [2025-10-30T17:33:12.145685] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-30T17:33:12.476731] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T17:33:12.498511] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-30T17:33:12.540494] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-30T17:33:12.540562] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-30T17:33:12.541009] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-30T17:33:12.541069] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-30T17:33:12.541849] [DEBUG] [LOCAL ] BGY: Trimmed 32937 records to 21243 (keeping 200 days of data) [2025-10-30T17:33:12.660465] [DEBUG] [LOCAL ] BGY: Primary data saved (21243 records). [2025-10-30T17:33:12.660591] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-30T17:33:12.660679] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BGY took 28.6s. Estimated remaining: 4h 19m 40s. Rate: 8.1 symbols/min [2025-10-30T17:33:12.831007] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:12.831198] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-10-30T17:33:12.831251] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-10-30T17:33:12.831361] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-30T17:33:12.831404] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-30T17:33:12.831447] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-30T17:33:12.831481] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-30T17:33:13.191706] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:13.297499] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-30T17:33:13.551950] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-30T17:33:14.097487] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-30T17:33:14.848505] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:33:14.897469] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-30T17:33:15.034737] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T17:33:15.697497] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-30T17:33:16.363451] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-30T17:33:16.497471] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-30T17:33:16.533735] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T17:33:17.297485] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-30T17:33:17.722141] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T17:33:18.008990] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-30T17:33:18.097507] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-30T17:33:18.897489] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-30T17:33:19.682205] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T17:33:19.697463] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-30T17:33:20.194047] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T17:33:20.497508] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-30T17:33:21.099207] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-30T17:33:21.297519] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-30T17:33:21.734573] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T17:33:22.097523] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-30T17:33:22.168385] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:33:22.897512] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-30T17:33:23.347191] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T17:33:23.697578] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-30T17:33:23.795162] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-30T17:33:24.497505] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-30T17:33:25.240451] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T17:33:25.267627] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T17:33:25.297449] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-30T17:33:26.097499] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-30T17:33:26.710197] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-30T17:33:26.897483] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-30T17:33:27.026447] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-30T17:33:27.490228] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-30T17:33:27.697491] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-30T17:33:28.497491] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-30T17:33:28.807900] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T17:33:29.297515] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-30T17:33:29.391088] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T17:33:30.097497] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-30T17:33:30.841233] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T17:33:30.897497] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-30T17:33:30.935283] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T17:33:31.697500] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-30T17:33:32.415449] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T17:33:32.443138] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-30T17:33:32.497491] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-30T17:33:33.302618] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-30T17:33:33.312268] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-30T17:33:34.082830] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T17:33:34.097445] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-30T17:33:34.897466] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-30T17:33:35.149621] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T17:33:35.154455] [INFO ] [REMOTE ] BHE: Full fetch complete (36195 records). [2025-10-30T17:33:35.154591] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-30T17:33:35.155182] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:33:35.155265] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:33:35.155308] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:33:35.155346] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-30T17:33:35.155428] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-30T17:33:35.155482] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-10-30T17:33:35.155626] [DEBUG] [LOCAL ] BHE: Deleted derivative data file. [2025-10-30T17:33:35.155732] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BHE took 33.2s. Estimated remaining: 4h 21m 30s. Rate: 8.0 symbols/min [2025-10-30T17:33:35.333223] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:35.333503] [DEBUG] [LOCAL ] BHR: No existing data file found in primary storage. [2025-10-30T17:33:35.333558] [WARN ] [MAIN ] BHR: No existing data found, performing full refresh instead. [2025-10-30T17:33:35.333701] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-30T17:33:35.333754] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-30T17:33:35.333798] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-30T17:33:35.333831] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-30T17:33:35.688263] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:35.697459] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-30T17:33:35.882859] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T17:33:36.497507] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-30T17:33:36.676852] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T17:33:37.297499] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-30T17:33:37.481696] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-30T17:33:37.488380] [INFO ] [REMOTE ] BHK: Full fetch complete (31068 records). [2025-10-30T17:33:37.488483] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-30T17:33:37.854744] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-30T17:33:37.854874] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-30T17:33:37.855485] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-30T17:33:37.855563] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-30T17:33:37.856837] [DEBUG] [LOCAL ] BHK: Trimmed 31068 records to 24373 (keeping 200 days of data) [2025-10-30T17:33:38.010171] [DEBUG] [LOCAL ] BHK: Primary data saved (24373 records). [2025-10-30T17:33:38.010300] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-30T17:33:38.010369] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHK took 27.5s. Estimated remaining: 4h 20m 46s. Rate: 8.0 symbols/min [2025-10-30T17:33:38.105795] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-30T17:33:38.187467] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:38.187637] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-30T17:33:38.187712] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-30T17:33:38.187824] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-30T17:33:38.187867] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-30T17:33:38.187907] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-30T17:33:38.187939] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-30T17:33:38.541066] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:38.614145] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:33:38.780317] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T17:33:38.897460] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-30T17:33:39.697494] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-30T17:33:40.360772] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T17:33:40.497515] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-30T17:33:41.212246] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T17:33:41.223925] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-30T17:33:41.297463] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-30T17:33:42.097515] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-30T17:33:42.873318] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T17:33:42.897472] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-30T17:33:43.180888] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-30T17:33:43.192837] [INFO ] [REMOTE ] BHP: Full fetch complete (77451 records). [2025-10-30T17:33:43.193013] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-30T17:33:43.579084] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-30T17:33:43.579257] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-30T17:33:43.580118] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-30T17:33:43.580223] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-30T17:33:43.581776] [DEBUG] [LOCAL ] BHP: Trimmed 77451 records to 53748 (keeping 200 days of data) [2025-10-30T17:33:43.702684] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-30T17:33:43.706607] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-30T17:33:43.972038] [DEBUG] [LOCAL ] BHP: Primary data saved (53748 records). [2025-10-30T17:33:43.972227] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-30T17:33:43.972340] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHP took 31.3s. Estimated remaining: 4h 20m 27s. Rate: 8.0 symbols/min [2025-10-30T17:33:44.251451] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T17:33:44.258890] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:44.329495] [DEBUG] [LOCAL ] BHVN: Loaded 50607 existing records from primary storage. [2025-10-30T17:33:44.329980] [INFO ] [MAIN ] BHVN: Loaded 50607 existing records. [2025-10-30T17:33:44.501154] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-30T17:33:44.616348] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:33:44.616612] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-30T17:33:44.616712] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-30T17:33:44.617415] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-30T17:33:44.617491] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-30T17:33:44.839544] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T17:33:45.070705] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:45.297516] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-30T17:33:45.666225] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-30T17:33:46.097496] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-30T17:33:46.897516] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-30T17:33:47.201732] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-30T17:33:47.298262] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T17:33:47.697494] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-30T17:33:48.497516] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-30T17:33:48.832304] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-30T17:33:48.926565] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:33:49.297515] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-30T17:33:50.097465] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-30T17:33:50.171019] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T17:33:50.897532] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-30T17:33:51.262727] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T17:33:51.697560] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-30T17:33:51.919200] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-30T17:33:52.497551] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-30T17:33:52.568450] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T17:33:52.579609] [INFO ] [REMOTE ] BHC: Full fetch complete (67670 records). [2025-10-30T17:33:52.579883] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-30T17:33:52.994197] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-30T17:33:52.994335] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-30T17:33:52.995316] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-30T17:33:52.995398] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-30T17:33:52.997796] [DEBUG] [LOCAL ] BHC: Trimmed 67670 records to 46776 (keeping 200 days of data) [2025-10-30T17:33:53.214478] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T17:33:53.295404] [DEBUG] [LOCAL ] BHC: Primary data saved (46776 records). [2025-10-30T17:33:53.295608] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-30T17:33:53.295745] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHC took 54.0s. Estimated remaining: 4h 20m 34s. Rate: 8.0 symbols/min [2025-10-30T17:33:53.301320] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-30T17:33:53.484559] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:53.538575] [DEBUG] [LOCAL ] BILL: Loaded 52491 existing records from primary storage. [2025-10-30T17:33:53.539108] [INFO ] [MAIN ] BILL: Loaded 52491 existing records. [2025-10-30T17:33:53.735884] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:33:53.736207] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-30T17:33:53.736275] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-30T17:33:53.736765] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-30T17:33:53.736827] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-30T17:33:54.102940] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-30T17:33:54.146774] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:54.428547] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-30T17:33:54.689532] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:33:54.897475] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-30T17:33:55.210535] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-30T17:33:55.697499] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-30T17:33:56.497494] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-30T17:33:56.780912] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-30T17:33:57.191688] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-30T17:33:57.297509] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-30T17:33:58.097490] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-30T17:33:58.604542] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-30T17:33:58.605387] [INFO ] [REMOTE ] BHV: Full fetch complete (1419 records). [2025-10-30T17:33:58.605454] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-30T17:33:58.785615] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-30T17:33:58.785839] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:33:58.785978] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:33:58.786081] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-30T17:33:58.786142] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-30T17:33:58.786177] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-30T17:33:58.786216] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-30T17:33:58.786269] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHV took 20.8s. Estimated remaining: 4h 20m 12s. Rate: 8.0 symbols/min [2025-10-30T17:33:58.902567] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-30T17:33:58.954853] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:33:58.977230] [DEBUG] [LOCAL ] BIO: Loaded 23392 existing records from primary storage. [2025-10-30T17:33:58.977465] [INFO ] [MAIN ] BIO: Loaded 23392 existing records. [2025-10-30T17:33:59.185561] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:33:59.213561] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-30T17:33:59.214223] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-30T17:33:59.215445] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-30T17:33:59.226973] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-30T17:33:59.227080] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-30T17:33:59.597508] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:33:59.642727] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-30T17:33:59.697536] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-30T17:34:00.497497] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-30T17:34:01.158364] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T17:34:01.297497] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-30T17:34:02.097496] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-30T17:34:02.290497] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-30T17:34:02.373731] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-30T17:34:02.379692] [INFO ] [REMOTE ] BHR: Full fetch complete (30960 records). [2025-10-30T17:34:02.379802] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-30T17:34:02.774713] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-30T17:34:02.774802] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-30T17:34:02.775249] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-30T17:34:02.775292] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-30T17:34:02.776140] [DEBUG] [LOCAL ] BHR: Trimmed 30960 records to 21889 (keeping 200 days of data) [2025-10-30T17:34:02.905774] [DEBUG] [LOCAL ] BHR: Primary data saved (21889 records). [2025-10-30T17:34:02.900167] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-30T17:34:02.906076] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-30T17:34:02.906201] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHR took 27.8s. Estimated remaining: 4h 19m 39s. Rate: 8.1 symbols/min [2025-10-30T17:34:03.081173] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:34:03.116743] [DEBUG] [LOCAL ] BIP: Loaded 38444 existing records from primary storage. [2025-10-30T17:34:03.117025] [INFO ] [MAIN ] BIP: Loaded 38444 existing records. [2025-10-30T17:34:03.314800] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:34:03.315415] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-30T17:34:03.315519] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-30T17:34:03.316081] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-30T17:34:03.316141] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-30T17:34:03.698955] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-30T17:34:03.702699] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:34:03.767292] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-30T17:34:03.795351] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T17:34:04.497537] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-30T17:34:05.102696] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T17:34:05.297483] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-30T17:34:05.699444] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:34:06.097488] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-30T17:34:06.614497] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:34:06.897543] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-30T17:34:07.678307] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T17:34:07.697453] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-30T17:34:07.777666] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T17:34:08.497507] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-30T17:34:09.297510] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-30T17:34:09.395164] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-30T17:34:09.747298] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T17:34:10.097496] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-30T17:34:10.782800] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T17:34:10.897465] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-30T17:34:11.399917] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T17:34:11.697482] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-30T17:34:12.347121] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-30T17:34:12.497533] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-30T17:34:13.049782] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T17:34:13.297471] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-30T17:34:13.369866] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T17:34:14.097496] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-30T17:34:14.334621] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-30T17:34:14.897520] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-30T17:34:15.612078] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T17:34:15.697461] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-30T17:34:15.833349] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T17:34:16.497497] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-30T17:34:17.297466] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-30T17:34:17.355166] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-30T17:34:17.654263] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T17:34:18.097499] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-30T17:34:18.300888] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T17:34:18.897491] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-30T17:34:19.697473] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-30T17:34:19.773694] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T17:34:19.785189] [INFO ] [REMOTE ] BHVN: Full fetch complete (70904 records). [2025-10-30T17:34:19.785318] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-30T17:34:20.198276] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T17:34:20.229146] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-30T17:34:20.229383] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-30T17:34:20.230739] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-30T17:34:20.231182] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-30T17:34:20.232773] [DEBUG] [LOCAL ] BHVN: Trimmed 70904 records to 50983 (keeping 200 days of data) [2025-10-30T17:34:20.460108] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T17:34:20.498066] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-30T17:34:20.569189] [DEBUG] [LOCAL ] BHVN: Primary data saved (50983 records). [2025-10-30T17:34:20.569346] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-30T17:34:20.569451] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BHVN took 36.6s. Estimated remaining: 4h 20m 49s. Rate: 8.0 symbols/min [2025-10-30T17:34:20.734014] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:34:20.769543] [DEBUG] [LOCAL ] BIPC: Loaded 40652 existing records from primary storage. [2025-10-30T17:34:20.769855] [INFO ] [MAIN ] BIPC: Loaded 40652 existing records. [2025-10-30T17:34:20.944990] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:34:20.945248] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-30T17:34:20.945299] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-30T17:34:20.945879] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-30T17:34:20.945950] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-30T17:34:21.297481] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-30T17:34:21.297326] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:34:21.404895] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-30T17:34:22.097522] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-30T17:34:22.350239] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-30T17:34:22.897515] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-30T17:34:23.306094] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T17:34:23.697492] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-30T17:34:24.146178] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T17:34:24.497508] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-30T17:34:24.885902] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T17:34:25.297477] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-30T17:34:25.496378] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:34:26.097475] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-30T17:34:26.357260] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T17:34:26.897494] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-30T17:34:27.657712] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T17:34:27.669521] [INFO ] [REMOTE ] BILL: Full fetch complete (76124 records). [2025-10-30T17:34:27.669756] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-30T17:34:27.705351] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-30T17:34:28.096452] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-30T17:34:28.096589] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-30T17:34:28.097818] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-30T17:34:28.097952] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-30T17:34:28.100079] [DEBUG] [LOCAL ] BILL: Trimmed 76124 records to 52878 (keeping 200 days of data) [2025-10-30T17:34:28.220998] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:34:28.454739] [DEBUG] [LOCAL ] BILL: Primary data saved (52878 records). [2025-10-30T17:34:28.454868] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-30T17:34:28.455586] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BILL took 35.2s. Estimated remaining: 4h 20m 45s. Rate: 8.0 symbols/min [2025-10-30T17:34:28.502731] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-30T17:34:28.644622] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:34:28.650531] [DEBUG] [LOCAL ] BIPH: Loaded 2080 existing records from primary storage. [2025-10-30T17:34:28.650785] [INFO ] [MAIN ] BIPH: Loaded 2080 existing records. [2025-10-30T17:34:28.840630] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:34:28.840860] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-30T17:34:28.840907] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-30T17:34:28.841070] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-30T17:34:28.841126] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-30T17:34:29.219685] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:34:29.249013] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-30T17:34:29.297460] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-30T17:34:29.414886] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T17:34:29.824844] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T17:34:30.097535] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-30T17:34:30.897510] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-30T17:34:31.516950] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T17:34:31.532309] [INFO ] [REMOTE ] BIP: Full fetch complete (57863 records). [2025-10-30T17:34:31.532551] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-30T17:34:31.702797] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-30T17:34:32.061586] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-30T17:34:32.066408] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-30T17:34:32.066787] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-30T17:34:32.069701] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-30T17:34:32.069833] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-30T17:34:32.071687] [DEBUG] [LOCAL ] BIP: Trimmed 57863 records to 38708 (keeping 200 days of data) [2025-10-30T17:34:32.116997] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T17:34:32.359122] [DEBUG] [LOCAL ] BIP: Primary data saved (38708 records). [2025-10-30T17:34:32.359269] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-30T17:34:32.359350] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BIP took 29.5s. Estimated remaining: 4h 20m 10s. Rate: 8.0 symbols/min [2025-10-30T17:34:32.497525] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-30T17:34:32.830476] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T17:34:33.297530] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-30T17:34:34.097548] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-30T17:34:34.423397] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T17:34:34.829964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T17:34:34.897472] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-30T17:34:35.697501] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-30T17:34:36.168713] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T17:34:36.497464] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-30T17:34:36.666256] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-30T17:34:36.671264] [INFO ] [REMOTE ] BIO: Full fetch complete (34903 records). [2025-10-30T17:34:36.671393] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-30T17:34:37.044756] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-30T17:34:37.044835] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-30T17:34:37.045296] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-30T17:34:37.045358] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-30T17:34:37.046106] [DEBUG] [LOCAL ] BIO: Trimmed 34903 records to 23581 (keeping 200 days of data) [2025-10-30T17:34:37.180916] [DEBUG] [LOCAL ] BIO: Primary data saved (23581 records). [2025-10-30T17:34:37.181037] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-30T17:34:37.181111] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BIO took 38.4s. Estimated remaining: 4h 19m 43s. Rate: 8.0 symbols/min [2025-10-30T17:34:37.297526] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-30T17:34:37.560188] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T17:34:37.804773] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-30T17:34:38.097495] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-30T17:34:38.393872] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-30T17:34:38.897502] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-30T17:34:39.697502] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-30T17:34:40.025550] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T17:34:40.058390] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-30T17:34:40.497569] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-30T17:34:40.799433] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-30T17:34:41.297528] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-30T17:34:41.503674] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-10-30T17:34:42.097509] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-30T17:34:42.391248] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-30T17:34:42.897500] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-30T17:34:43.697501] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-30T17:34:44.110095] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-30T17:34:44.111068] [INFO ] [REMOTE ] BIPH: Full fetch complete (3571 records). [2025-10-30T17:34:44.111136] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-30T17:34:44.382681] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T17:34:44.502961] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-30T17:34:44.510505] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-30T17:34:44.511285] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-30T17:34:44.511437] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-30T17:34:44.511479] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-30T17:34:44.511880] [DEBUG] [LOCAL ] BIPH: Trimmed 3571 records to 2103 (keeping 200 days of data) [2025-10-30T17:34:44.524784] [DEBUG] [LOCAL ] BIPH: Primary data saved (2103 records). [2025-10-30T17:34:44.524844] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-30T17:34:44.524911] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIPH took 16.1s. Estimated remaining: 4h 19m 34s. Rate: 8.0 symbols/min [2025-10-30T17:34:45.974469] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T17:34:45.983453] [INFO ] [REMOTE ] BIPC: Full fetch complete (59916 records). [2025-10-30T17:34:45.983590] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-30T17:34:45.984336] [FATAL] [VALIDATOR ] BIPC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:34:45.984426] [FATAL] [MAIN ] BIPC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:34:45.984470] [WARN ] [MAIN ] BIPC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:34:45.984535] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-30T17:34:45.984600] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-30T17:34:45.984638] [INFO ] [LOCAL ] BIPC: Starting deletion of derivative data. [2025-10-30T17:34:45.984877] [DEBUG] [LOCAL ] BIPC: Deleted derivative data file. [2025-10-30T17:34:45.984970] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIPC took 25.4s. Estimated remaining: 4h 18m 42s. Rate: 8.1 symbols/min [2025-10-30T17:34:46.629424] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:34:46.663282] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:34:46.687984] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:34:46.711049] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:34:46.716449] [DEBUG] [LOCAL ] BIPI: Loaded 2673 existing records from primary storage. [2025-10-30T17:34:46.716144] [DEBUG] [LOCAL ] BIPJ: Loaded 2933 existing records from primary storage. [2025-10-30T17:34:46.717795] [INFO ] [MAIN ] BIPI: Loaded 2673 existing records. [2025-10-30T17:34:46.717454] [INFO ] [MAIN ] BIPJ: Loaded 2933 existing records. [2025-10-30T17:34:47.018987] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:34:47.031984] [DEBUG] [LOCAL ] BIT: Loaded 23617 existing records from primary storage. [2025-10-30T17:34:47.037617] [INFO ] [MAIN ] BIT: Loaded 23617 existing records. [2025-10-30T17:34:47.032091] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-30T17:34:47.083706] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-30T17:34:47.196732] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:34:47.197034] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-30T17:34:47.202227] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-30T17:34:47.202918] [DEBUG] [LOCAL ] BIRK: Loaded 51054 existing records from primary storage. [2025-10-30T17:34:47.213599] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-30T17:34:47.213731] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-30T17:34:47.213869] [INFO ] [MAIN ] BIRK: Loaded 51054 existing records. [2025-10-30T17:34:47.242275] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-30T17:34:47.363575] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-30T17:34:47.525441] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:34:47.562269] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-30T17:34:47.595763] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-30T17:34:47.657628] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-30T17:34:47.718007] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-30T17:34:47.900590] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:34:47.980965] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-30T17:34:48.057896] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-30T17:34:48.163152] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-30T17:34:48.237840] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-30T17:34:48.623453] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:34:48.661930] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:34:48.662806] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-30T17:34:48.662299] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-30T17:34:48.865785] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:34:48.897870] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-30T17:34:48.998588] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:34:48.998905] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-30T17:34:49.203982] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-30T17:34:49.205568] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-30T17:34:49.208973] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T17:34:49.297450] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-30T17:34:49.491783] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T17:34:49.596232] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T17:34:49.834877] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T17:34:50.097475] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-30T17:34:50.141306] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T17:34:50.527626] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T17:34:50.897522] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-30T17:34:51.619222] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-30T17:34:51.697483] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-30T17:34:52.459392] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T17:34:52.497533] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-30T17:34:53.297500] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-30T17:34:53.303391] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T17:34:53.680160] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-30T17:34:54.097517] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-30T17:34:54.779764] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-30T17:34:54.897513] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-30T17:34:55.697520] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-30T17:34:56.335077] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T17:34:56.338360] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T17:34:56.497478] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-30T17:34:57.297501] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-30T17:34:57.658829] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-30T17:34:57.662311] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T17:34:58.097498] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-30T17:34:58.503106] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-30T17:34:58.897560] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-30T17:34:59.697556] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-30T17:35:00.196548] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T17:35:00.473456] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-30T17:35:00.497501] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-30T17:35:01.244085] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T17:35:01.297502] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-30T17:35:01.665957] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-30T17:35:02.097568] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-30T17:35:02.420125] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T17:35:02.897549] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-30T17:35:03.697546] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-30T17:35:03.874305] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T17:35:03.990755] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-30T17:35:04.497491] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-30T17:35:05.297499] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-30T17:35:05.366176] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T17:35:05.543111] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-30T17:35:06.097512] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-30T17:35:06.897519] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-30T17:35:07.239197] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T17:35:07.240517] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T17:35:07.697491] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-30T17:35:08.050928] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-30T17:35:08.497502] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-30T17:35:08.781847] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-30T17:35:09.297524] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-30T17:35:09.875374] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-30T17:35:09.876482] [INFO ] [REMOTE ] BIPI: Full fetch complete (4482 records). [2025-10-30T17:35:09.876549] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-30T17:35:10.102772] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-30T17:35:10.252607] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-30T17:35:10.252711] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-30T17:35:10.252867] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-30T17:35:10.252908] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-30T17:35:10.253289] [DEBUG] [LOCAL ] BIPI: Trimmed 4482 records to 2690 (keeping 200 days of data) [2025-10-30T17:35:10.269419] [DEBUG] [LOCAL ] BIPI: Primary data saved (2690 records). [2025-10-30T17:35:10.269515] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-30T17:35:10.269587] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPI took 24.3s. Estimated remaining: 4h 20m 40s. Rate: 8.0 symbols/min [2025-10-30T17:35:10.452012] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:35:10.499922] [DEBUG] [LOCAL ] BJ: Loaded 51365 existing records from primary storage. [2025-10-30T17:35:10.500234] [INFO ] [MAIN ] BJ: Loaded 51365 existing records. [2025-10-30T17:35:10.682045] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:35:10.682295] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-30T17:35:10.682346] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-30T17:35:10.682837] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-30T17:35:10.682894] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-30T17:35:10.902781] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-30T17:35:11.061508] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:35:11.180526] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-30T17:35:11.186794] [INFO ] [REMOTE ] BIT: Full fetch complete (32482 records). [2025-10-30T17:35:11.186883] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-30T17:35:11.549706] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-30T17:35:11.549789] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-30T17:35:11.550208] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-30T17:35:11.550248] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-30T17:35:11.551033] [DEBUG] [LOCAL ] BIT: Trimmed 32482 records to 23804 (keeping 200 days of data) [2025-10-30T17:35:11.691332] [DEBUG] [LOCAL ] BIT: Primary data saved (23804 records). [2025-10-30T17:35:11.691454] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-30T17:35:11.691530] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIT took 25.7s. Estimated remaining: 4h 19m 47s. Rate: 8.0 symbols/min [2025-10-30T17:35:11.702745] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-30T17:35:11.863799] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:35:11.914721] [DEBUG] [LOCAL ] BK: Loaded 53532 existing records from primary storage. [2025-10-30T17:35:11.915035] [INFO ] [MAIN ] BK: Loaded 53532 existing records. [2025-10-30T17:35:12.096828] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:35:12.097105] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-30T17:35:12.097161] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-30T17:35:12.097866] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-30T17:35:12.097927] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-30T17:35:12.481423] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:35:12.507598] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-30T17:35:12.513840] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-30T17:35:12.868027] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T17:35:13.121482] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T17:35:13.297492] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-30T17:35:14.097495] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-30T17:35:14.517240] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T17:35:14.897528] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-30T17:35:15.246846] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T17:35:15.403371] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-30T17:35:15.404375] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4076 records). [2025-10-30T17:35:15.404444] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-30T17:35:15.404827] [FATAL] [VALIDATOR ] BIPJ: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:35:15.404908] [FATAL] [MAIN ] BIPJ: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:35:15.404951] [WARN ] [MAIN ] BIPJ: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:35:15.404995] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-30T17:35:15.405050] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-30T17:35:15.405085] [INFO ] [LOCAL ] BIPJ: Starting deletion of derivative data. [2025-10-30T17:35:15.405255] [DEBUG] [LOCAL ] BIPJ: Deleted derivative data file. [2025-10-30T17:35:15.405339] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIPJ took 29.4s. Estimated remaining: 4h 19m 12s. Rate: 8.0 symbols/min [2025-10-30T17:35:15.581057] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:35:15.630741] [DEBUG] [LOCAL ] BKD: Loaded 50286 existing records from primary storage. [2025-10-30T17:35:15.631093] [INFO ] [MAIN ] BKD: Loaded 50286 existing records. [2025-10-30T17:35:15.702616] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-30T17:35:15.822304] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:35:15.822582] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-30T17:35:15.822677] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-30T17:35:15.823160] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-30T17:35:15.823217] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-30T17:35:16.186533] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:35:16.497542] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-30T17:35:17.002412] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T17:35:17.297494] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-30T17:35:18.097468] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-30T17:35:18.199085] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T17:35:18.702539] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T17:35:18.897520] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-30T17:35:19.276225] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T17:35:19.697623] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-30T17:35:20.294864] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T17:35:20.497499] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-30T17:35:20.803374] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T17:35:21.297483] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-30T17:35:21.958299] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T17:35:22.097501] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-30T17:35:22.661509] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T17:35:22.897493] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-30T17:35:23.213184] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T17:35:23.697478] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-30T17:35:24.121882] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T17:35:24.497518] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-30T17:35:24.948871] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T17:35:25.297511] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-30T17:35:25.875859] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:35:26.097562] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-30T17:35:26.707596] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T17:35:26.897492] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-30T17:35:27.599817] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T17:35:27.612385] [INFO ] [REMOTE ] BIRK: Full fetch complete (73519 records). [2025-10-30T17:35:27.612622] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-30T17:35:27.702707] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-30T17:35:28.035669] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-30T17:35:28.035773] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-30T17:35:28.036559] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-30T17:35:28.036781] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-30T17:35:28.038226] [DEBUG] [LOCAL ] BIRK: Trimmed 73519 records to 51431 (keeping 200 days of data) [2025-10-30T17:35:28.162839] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T17:35:28.370878] [DEBUG] [LOCAL ] BIRK: Primary data saved (51431 records). [2025-10-30T17:35:28.371091] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-30T17:35:28.371999] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIRK took 42.4s. Estimated remaining: 4h 19m 45s. Rate: 8.0 symbols/min [2025-10-30T17:35:28.507763] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-30T17:35:28.540807] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:35:28.572287] [DEBUG] [LOCAL ] BKE: Loaded 32985 existing records from primary storage. [2025-10-30T17:35:28.572636] [INFO ] [MAIN ] BKE: Loaded 32985 existing records. [2025-10-30T17:35:28.746081] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:35:28.746359] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-30T17:35:28.746417] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-30T17:35:28.746819] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-30T17:35:28.746874] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-30T17:35:29.107085] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:35:29.134358] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T17:35:29.297475] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-30T17:35:29.975003] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T17:35:30.097495] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-30T17:35:30.515808] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T17:35:30.897520] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-30T17:35:31.312234] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T17:35:31.697499] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-30T17:35:32.031435] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T17:35:32.497502] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-30T17:35:32.778920] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T17:35:33.297485] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-30T17:35:33.779545] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:35:34.097504] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-30T17:35:34.471622] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T17:35:34.897500] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-30T17:35:35.325862] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T17:35:35.697497] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-30T17:35:36.167553] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T17:35:36.497501] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-30T17:35:37.146985] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T17:35:37.297497] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-30T17:35:38.097517] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-30T17:35:38.162810] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-30T17:35:38.497408] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T17:35:38.897498] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-30T17:35:39.313130] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T17:35:39.697488] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-30T17:35:40.366547] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T17:35:40.380522] [INFO ] [REMOTE ] BJ: Full fetch complete (74358 records). [2025-10-30T17:35:40.380794] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-30T17:35:40.500099] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-30T17:35:40.691014] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:35:41.055502] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-30T17:35:41.055636] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-30T17:35:41.056574] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-30T17:35:41.056640] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-30T17:35:41.058586] [DEBUG] [LOCAL ] BJ: Trimmed 74358 records to 51748 (keeping 200 days of data) [2025-10-30T17:35:41.297507] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-30T17:35:41.429067] [DEBUG] [LOCAL ] BJ: Primary data saved (51748 records). [2025-10-30T17:35:41.429201] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-30T17:35:41.430090] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BJ took 31.2s. Estimated remaining: 4h 20m 18s. Rate: 8.0 symbols/min [2025-10-30T17:35:41.594701] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:35:41.594858] [DEBUG] [LOCAL ] BKH: No existing data file found in primary storage. [2025-10-30T17:35:41.594895] [WARN ] [MAIN ] BKH: No existing data found, performing full refresh instead. [2025-10-30T17:35:41.594998] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-30T17:35:41.595039] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-30T17:35:41.595078] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-30T17:35:41.595110] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-30T17:35:41.945308] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:35:41.980097] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T17:35:42.097510] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-30T17:35:42.362615] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T17:35:42.897521] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-30T17:35:43.659870] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T17:35:43.671019] [INFO ] [REMOTE ] BKD: Full fetch complete (72182 records). [2025-10-30T17:35:43.671150] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-30T17:35:43.703558] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-30T17:35:44.070233] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-30T17:35:44.070367] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-30T17:35:44.071171] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-30T17:35:44.071313] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-30T17:35:44.084553] [DEBUG] [LOCAL ] BKD: Trimmed 72182 records to 50670 (keeping 200 days of data) [2025-10-30T17:35:44.092834] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:35:44.372948] [DEBUG] [LOCAL ] BKD: Primary data saved (50670 records). [2025-10-30T17:35:44.373074] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-30T17:35:44.373916] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BKD took 29.0s. Estimated remaining: 4h 19m 37s. Rate: 8.0 symbols/min [2025-10-30T17:35:44.502568] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-30T17:35:44.547461] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:35:44.584611] [DEBUG] [LOCAL ] BKKT: Loaded 38131 existing records from primary storage. [2025-10-30T17:35:44.584995] [INFO ] [MAIN ] BKKT: Loaded 38131 existing records. [2025-10-30T17:35:44.766497] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:35:44.766723] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-30T17:35:44.766796] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-30T17:35:44.767119] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-30T17:35:44.767158] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-30T17:35:45.116418] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:35:45.297482] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-30T17:35:45.595365] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-30T17:35:45.607168] [INFO ] [REMOTE ] BK: Full fetch complete (77660 records). [2025-10-30T17:35:45.607314] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-30T17:35:46.016937] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-30T17:35:46.017047] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-30T17:35:46.017934] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-30T17:35:46.018015] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-30T17:35:46.032745] [DEBUG] [LOCAL ] BK: Trimmed 77660 records to 53916 (keeping 200 days of data) [2025-10-30T17:35:46.043498] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T17:35:46.112724] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-30T17:35:46.386529] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T17:35:46.414588] [DEBUG] [LOCAL ] BK: Primary data saved (53916 records). [2025-10-30T17:35:46.414720] [INFO ] [MAIN ] BK: Full history saved. [2025-10-30T17:35:46.414802] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BK took 34.7s. Estimated remaining: 4h 18m 50s. Rate: 8.0 symbols/min [2025-10-30T17:35:46.595504] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:35:46.603843] [DEBUG] [LOCAL ] BKN: Loaded 7176 existing records from primary storage. [2025-10-30T17:35:46.604042] [INFO ] [MAIN ] BKN: Loaded 7176 existing records. [2025-10-30T17:35:46.796497] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:35:46.796748] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-30T17:35:46.796801] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-30T17:35:46.796951] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-30T17:35:46.796987] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-30T17:35:46.902700] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-30T17:35:47.151358] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:35:47.454971] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:35:47.697501] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-30T17:35:47.898687] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T17:35:48.497493] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-30T17:35:48.784452] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T17:35:49.297500] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-30T17:35:49.633210] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T17:35:50.097490] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-30T17:35:50.417953] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T17:35:50.897498] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-30T17:35:51.139605] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T17:35:51.697535] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-30T17:35:51.988759] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T17:35:52.439135] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-30T17:35:52.497488] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-30T17:35:53.297516] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-30T17:35:53.633819] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T17:35:54.097546] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-30T17:35:54.616188] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:35:54.631412] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T17:35:54.897483] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-30T17:35:55.400301] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T17:35:55.697504] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-30T17:35:56.497495] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-30T17:35:57.213883] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-30T17:35:57.297487] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-30T17:35:57.472720] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T17:35:57.929703] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T17:35:58.097519] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-30T17:35:58.897502] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-30T17:35:59.113513] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T17:35:59.697527] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-30T17:35:59.997158] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T17:36:00.004805] [INFO ] [REMOTE ] BKE: Full fetch complete (49692 records). [2025-10-30T17:36:00.004982] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-30T17:36:00.397612] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-30T17:36:00.397715] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-30T17:36:00.398308] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-30T17:36:00.398349] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-30T17:36:00.399322] [DEBUG] [LOCAL ] BKE: Trimmed 49692 records to 33194 (keeping 200 days of data) [2025-10-30T17:36:00.503670] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-30T17:36:00.595292] [DEBUG] [LOCAL ] BKE: Primary data saved (33194 records). [2025-10-30T17:36:00.595402] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-30T17:36:00.595870] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKE took 32.2s. Estimated remaining: 4h 19m 31s. Rate: 8.0 symbols/min [2025-10-30T17:36:00.760992] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:00.804443] [DEBUG] [LOCAL ] BKSY: Loaded 49004 existing records from primary storage. [2025-10-30T17:36:00.804794] [INFO ] [MAIN ] BKSY: Loaded 49004 existing records. [2025-10-30T17:36:00.987753] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:36:00.987983] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-30T17:36:00.988032] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-30T17:36:00.988467] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-30T17:36:00.988538] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-30T17:36:01.300192] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-30T17:36:01.359416] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:01.383417] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-30T17:36:01.803002] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T17:36:02.020015] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-30T17:36:02.097538] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-30T17:36:02.548423] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T17:36:02.897498] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-30T17:36:03.697494] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-30T17:36:03.995573] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T17:36:04.497533] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-30T17:36:04.994664] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-30T17:36:05.144242] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T17:36:05.297459] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-30T17:36:05.781257] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-30T17:36:06.097499] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-30T17:36:06.897499] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-30T17:36:07.344899] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T17:36:07.697505] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-30T17:36:08.497549] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-30T17:36:08.600086] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-30T17:36:08.780752] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T17:36:08.923362] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-30T17:36:09.297502] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-30T17:36:10.097499] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-30T17:36:10.897487] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-30T17:36:11.028472] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-30T17:36:11.037476] [INFO ] [REMOTE ] BKH: Full fetch complete (53434 records). [2025-10-30T17:36:11.037589] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-30T17:36:11.442916] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-30T17:36:11.443122] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-30T17:36:11.444138] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-30T17:36:11.443430] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T17:36:11.446557] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-30T17:36:11.448141] [DEBUG] [LOCAL ] BKH: Trimmed 53434 records to 37655 (keeping 200 days of data) [2025-10-30T17:36:11.679254] [DEBUG] [LOCAL ] BKH: Primary data saved (37655 records). [2025-10-30T17:36:11.679532] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-30T17:36:11.679639] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BKH took 30.2s. Estimated remaining: 4h 19m 50s. Rate: 8.0 symbols/min [2025-10-30T17:36:11.702701] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-30T17:36:11.858048] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:11.893273] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-30T17:36:11.908714] [DEBUG] [LOCAL ] BKT: Loaded 12863 existing records from primary storage. [2025-10-30T17:36:11.908953] [INFO ] [MAIN ] BKT: Loaded 12863 existing records. [2025-10-30T17:36:12.083423] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:36:12.083613] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-30T17:36:12.083688] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-30T17:36:12.083943] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-30T17:36:12.083998] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-30T17:36:12.440313] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:12.457858] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T17:36:12.460199] [INFO ] [REMOTE ] BKN: Full fetch complete (11097 records). [2025-10-30T17:36:12.460270] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-30T17:36:12.502814] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-30T17:36:12.858364] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-30T17:36:12.858455] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-30T17:36:12.858808] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-30T17:36:12.858870] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-30T17:36:12.859327] [DEBUG] [LOCAL ] BKN: Trimmed 11097 records to 7256 (keeping 200 days of data) [2025-10-30T17:36:12.903485] [DEBUG] [LOCAL ] BKN: Primary data saved (7256 records). [2025-10-30T17:36:12.903613] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-30T17:36:12.903725] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKN took 26.5s. Estimated remaining: 4h 18m 57s. Rate: 8.0 symbols/min [2025-10-30T17:36:13.073137] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:13.073286] [DEBUG] [LOCAL ] BKU: No existing data file found in primary storage. [2025-10-30T17:36:13.073322] [WARN ] [MAIN ] BKU: No existing data found, performing full refresh instead. [2025-10-30T17:36:13.073429] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-30T17:36:13.073474] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-30T17:36:13.073514] [DEBUG] [LOCAL ] BKU: No primary data file found to delete. [2025-10-30T17:36:13.073547] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-30T17:36:13.306623] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-30T17:36:13.434254] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:13.917759] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T17:36:14.097502] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-30T17:36:14.152181] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-30T17:36:14.897554] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-30T17:36:15.697552] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-30T17:36:15.739931] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-30T17:36:16.179570] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-30T17:36:16.497512] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-30T17:36:16.574032] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T17:36:17.297500] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-30T17:36:17.726699] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:36:18.097486] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-30T17:36:18.572070] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-30T17:36:18.897466] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-30T17:36:18.986184] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T17:36:18.996842] [INFO ] [REMOTE ] BKKT: Full fetch complete (52451 records). [2025-10-30T17:36:18.996956] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-30T17:36:18.997571] [FATAL] [VALIDATOR ] BKKT: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:36:18.997680] [FATAL] [MAIN ] BKKT: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:36:18.997734] [WARN ] [MAIN ] BKKT: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:36:18.997801] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-30T17:36:18.997863] [DEBUG] [LOCAL ] BKKT: No primary data file found to delete. [2025-10-30T17:36:18.997898] [INFO ] [LOCAL ] BKKT: Starting deletion of derivative data. [2025-10-30T17:36:18.998070] [DEBUG] [LOCAL ] BKKT: Deleted derivative data file. [2025-10-30T17:36:18.999164] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKKT took 34.6s. Estimated remaining: 4h 18m 40s. Rate: 8.0 symbols/min [2025-10-30T17:36:19.167683] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:19.194379] [DEBUG] [LOCAL ] BKV: Loaded 28994 existing records from primary storage. [2025-10-30T17:36:19.194624] [INFO ] [MAIN ] BKV: Loaded 28994 existing records. [2025-10-30T17:36:19.366802] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:36:19.366985] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-30T17:36:19.367030] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-30T17:36:19.367344] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-30T17:36:19.367402] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-30T17:36:19.710030] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-30T17:36:19.715230] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:19.862062] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T17:36:20.497495] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-30T17:36:21.140530] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T17:36:21.297499] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-30T17:36:21.396413] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T17:36:21.906545] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-30T17:36:22.097540] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-30T17:36:22.897502] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-30T17:36:22.986935] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-30T17:36:23.697489] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-30T17:36:24.098390] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T17:36:24.497497] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-30T17:36:24.893983] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T17:36:25.297519] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-30T17:36:25.994619] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T17:36:26.097501] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-30T17:36:26.145378] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-30T17:36:26.897520] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-30T17:36:27.577138] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-30T17:36:27.697595] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-30T17:36:28.012269] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T17:36:28.356936] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T17:36:28.497564] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-30T17:36:29.297496] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-30T17:36:29.351402] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T17:36:29.933529] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T17:36:30.097507] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-30T17:36:30.897504] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-30T17:36:31.366169] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-30T17:36:31.427036] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:36:31.697488] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-30T17:36:32.462938] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-30T17:36:32.497488] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-30T17:36:33.297502] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-30T17:36:33.533783] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T17:36:33.801443] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-30T17:36:34.097499] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-30T17:36:34.897502] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-30T17:36:35.007889] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-30T17:36:35.697494] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-30T17:36:36.489855] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T17:36:36.510846] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-30T17:36:36.524360] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-30T17:36:37.297500] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-30T17:36:37.705189] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T17:36:38.082369] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T17:36:38.097452] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-30T17:36:38.897515] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-30T17:36:39.133600] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T17:36:39.142351] [INFO ] [REMOTE ] BKV: Full fetch complete (44871 records). [2025-10-30T17:36:39.142547] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-30T17:36:39.524817] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-30T17:36:39.524916] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-30T17:36:39.525509] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-30T17:36:39.525573] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-30T17:36:39.526612] [DEBUG] [LOCAL ] BKV: Trimmed 44871 records to 29319 (keeping 200 days of data) [2025-10-30T17:36:39.694770] [DEBUG] [LOCAL ] BKV: Primary data saved (29319 records). [2025-10-30T17:36:39.694913] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-30T17:36:39.694994] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKV took 20.7s. Estimated remaining: 4h 20m 6s. Rate: 8.0 symbols/min [2025-10-30T17:36:39.706173] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-30T17:36:39.876441] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:39.907790] [DEBUG] [LOCAL ] BLCO: Loaded 34380 existing records from primary storage. [2025-10-30T17:36:39.908060] [INFO ] [MAIN ] BLCO: Loaded 34380 existing records. [2025-10-30T17:36:40.092006] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:36:40.092237] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-30T17:36:40.092286] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-30T17:36:40.092721] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-30T17:36:40.092780] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-30T17:36:40.473130] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:40.499327] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-30T17:36:40.504690] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-30T17:36:41.073338] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T17:36:41.297529] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-30T17:36:41.571215] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-30T17:36:42.097473] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-30T17:36:42.249061] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-30T17:36:42.254465] [INFO ] [REMOTE ] BKT: Full fetch complete (17010 records). [2025-10-30T17:36:42.254556] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-30T17:36:42.654971] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-30T17:36:42.655075] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-30T17:36:42.655667] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-30T17:36:42.655733] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-30T17:36:42.656430] [DEBUG] [LOCAL ] BKT: Trimmed 17010 records to 12933 (keeping 200 days of data) [2025-10-30T17:36:42.735166] [DEBUG] [LOCAL ] BKT: Primary data saved (12933 records). [2025-10-30T17:36:42.735350] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-30T17:36:42.735448] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKT took 31.1s. Estimated remaining: 4h 19m 27s. Rate: 8.0 symbols/min [2025-10-30T17:36:42.900739] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-30T17:36:42.909146] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:42.934833] [DEBUG] [LOCAL ] BLD: Loaded 26495 existing records from primary storage. [2025-10-30T17:36:42.935137] [INFO ] [MAIN ] BLD: Loaded 26495 existing records. [2025-10-30T17:36:43.134539] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:36:43.134984] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-30T17:36:43.135052] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-30T17:36:43.135568] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-30T17:36:43.135625] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-30T17:36:43.342114] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T17:36:43.570067] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:43.697516] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-30T17:36:44.497473] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-30T17:36:44.550280] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-30T17:36:44.742134] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T17:36:45.297498] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-30T17:36:45.334917] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T17:36:46.097494] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-30T17:36:46.126423] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T17:36:46.897501] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-30T17:36:47.275411] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T17:36:47.697473] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-30T17:36:48.043501] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T17:36:48.497467] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-30T17:36:48.752767] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T17:36:49.297500] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-30T17:36:50.097473] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-30T17:36:50.167096] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T17:36:50.478505] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-30T17:36:50.490073] [INFO ] [REMOTE ] BKSY: Full fetch complete (70952 records). [2025-10-30T17:36:50.490229] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-30T17:36:50.882429] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-30T17:36:50.882507] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-30T17:36:50.883245] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-30T17:36:50.883307] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-30T17:36:50.884571] [DEBUG] [LOCAL ] BKSY: Trimmed 70952 records to 49369 (keeping 200 days of data) [2025-10-30T17:36:50.932510] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-30T17:36:51.203673] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T17:36:51.220385] [DEBUG] [LOCAL ] BKSY: Primary data saved (49369 records). [2025-10-30T17:36:51.220520] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-30T17:36:51.221085] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKSY took 50.6s. Estimated remaining: 4h 19m 26s. Rate: 8.0 symbols/min [2025-10-30T17:36:51.395404] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:51.445763] [DEBUG] [LOCAL ] BLDR: Loaded 51806 existing records from primary storage. [2025-10-30T17:36:51.446058] [INFO ] [MAIN ] BLDR: Loaded 51806 existing records. [2025-10-30T17:36:51.633113] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:36:51.633325] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-30T17:36:51.633376] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-30T17:36:51.633877] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-30T17:36:51.633935] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-30T17:36:51.712349] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-30T17:36:52.057836] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T17:36:52.067445] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:52.497489] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-30T17:36:52.937356] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:36:53.297475] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-30T17:36:53.376488] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T17:36:54.097513] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-30T17:36:54.897480] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-30T17:36:55.019878] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-30T17:36:55.030801] [INFO ] [REMOTE ] BKU: Full fetch complete (61271 records). [2025-10-30T17:36:55.030913] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-30T17:36:55.315633] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T17:36:55.440971] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-30T17:36:55.441061] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-30T17:36:55.441826] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-30T17:36:55.441890] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-30T17:36:55.443116] [DEBUG] [LOCAL ] BKU: Trimmed 61271 records to 42466 (keeping 200 days of data) [2025-10-30T17:36:55.688783] [DEBUG] [LOCAL ] BKU: Primary data saved (42466 records). [2025-10-30T17:36:55.688904] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-30T17:36:55.688982] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKU took 42.8s. Estimated remaining: 4h 18m 57s. Rate: 8.0 symbols/min [2025-10-30T17:36:55.702760] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-30T17:36:55.858379] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:36:55.858554] [DEBUG] [LOCAL ] BLE: No existing data file found in primary storage. [2025-10-30T17:36:55.858592] [WARN ] [MAIN ] BLE: No existing data found, performing full refresh instead. [2025-10-30T17:36:55.858721] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-30T17:36:55.858766] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-30T17:36:55.858807] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-10-30T17:36:55.858839] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-30T17:36:56.212131] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:36:56.469615] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-30T17:36:56.497448] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-30T17:36:57.305505] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-30T17:36:57.311987] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-30T17:36:58.097525] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-30T17:36:58.897502] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-30T17:36:59.140967] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-30T17:36:59.350977] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T17:36:59.598536] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T17:36:59.697501] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-30T17:36:59.946731] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-30T17:37:00.223959] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-30T17:37:00.497521] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-30T17:37:01.297503] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-30T17:37:01.977944] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-30T17:37:02.097490] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-30T17:37:02.598806] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-30T17:37:02.604223] [INFO ] [REMOTE ] BLD: Full fetch complete (39693 records). [2025-10-30T17:37:02.604313] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-30T17:37:02.901498] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-30T17:37:02.977709] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-30T17:37:03.030323] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-30T17:37:03.030400] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-30T17:37:03.030918] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-30T17:37:03.030979] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-30T17:37:03.031895] [DEBUG] [LOCAL ] BLD: Trimmed 39693 records to 26687 (keeping 200 days of data) [2025-10-30T17:37:03.197520] [DEBUG] [LOCAL ] BLD: Primary data saved (26687 records). [2025-10-30T17:37:03.197695] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-30T17:37:03.197803] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLD took 20.5s. Estimated remaining: 4h 18m 50s. Rate: 8.0 symbols/min [2025-10-30T17:37:03.379429] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:03.412767] [DEBUG] [LOCAL ] BLK: Loaded 33445 existing records from primary storage. [2025-10-30T17:37:03.413059] [INFO ] [MAIN ] BLK: Loaded 33445 existing records. [2025-10-30T17:37:03.594558] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:37:03.594825] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-30T17:37:03.594877] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-30T17:37:03.595251] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-30T17:37:03.595308] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-30T17:37:03.700501] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-30T17:37:03.963544] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:04.143292] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T17:37:04.220701] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T17:37:04.497528] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-30T17:37:05.297485] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-30T17:37:05.351429] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T17:37:06.097549] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-30T17:37:06.528250] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:37:06.897534] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-30T17:37:07.697543] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-30T17:37:07.833216] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-30T17:37:08.391240] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T17:37:08.398104] [INFO ] [REMOTE ] BLCO: Full fetch complete (52069 records). [2025-10-30T17:37:08.398204] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-30T17:37:08.497528] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-30T17:37:08.794383] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-30T17:37:08.794542] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-30T17:37:08.796483] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-30T17:37:08.796545] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-30T17:37:08.797789] [DEBUG] [LOCAL ] BLCO: Trimmed 52069 records to 34636 (keeping 200 days of data) [2025-10-30T17:37:08.993387] [DEBUG] [LOCAL ] BLCO: Primary data saved (34636 records). [2025-10-30T17:37:08.993760] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-30T17:37:08.993889] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BLCO took 29.3s. Estimated remaining: 4h 18m 31s. Rate: 8.0 symbols/min [2025-10-30T17:37:09.168130] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:09.204922] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-30T17:37:09.251985] [DEBUG] [LOCAL ] BLND: Loaded 49168 existing records from primary storage. [2025-10-30T17:37:09.252322] [INFO ] [MAIN ] BLND: Loaded 49168 existing records. [2025-10-30T17:37:09.305413] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-30T17:37:09.431136] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:37:09.431354] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-30T17:37:09.431412] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-30T17:37:09.431818] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-30T17:37:09.431873] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-30T17:37:09.774236] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:10.048438] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-30T17:37:10.097472] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-30T17:37:10.275153] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T17:37:10.897513] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-30T17:37:11.697472] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-30T17:37:11.779722] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-30T17:37:12.339398] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T17:37:12.497510] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-30T17:37:13.076788] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:37:13.297493] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-30T17:37:13.655431] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T17:37:14.097491] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-30T17:37:14.702072] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:37:14.897499] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-30T17:37:15.252441] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T17:37:15.697493] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-30T17:37:16.397625] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T17:37:16.497515] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-30T17:37:17.058531] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T17:37:17.297533] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-30T17:37:18.040277] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T17:37:18.097526] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-30T17:37:18.630360] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T17:37:18.649942] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T17:37:18.897506] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-30T17:37:19.431760] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-30T17:37:19.697485] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-30T17:37:20.456735] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-30T17:37:20.497462] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-30T17:37:21.158355] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-30T17:37:21.162337] [INFO ] [REMOTE ] BLE: Full fetch complete (19683 records). [2025-10-30T17:37:21.162535] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-30T17:37:21.305079] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-30T17:37:21.684980] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-30T17:37:21.685077] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-30T17:37:21.685609] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-30T17:37:21.685700] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-30T17:37:21.686501] [DEBUG] [LOCAL ] BLE: Trimmed 19683 records to 13517 (keeping 200 days of data) [2025-10-30T17:37:21.786351] [DEBUG] [LOCAL ] BLE: Primary data saved (13517 records). [2025-10-30T17:37:21.786499] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-30T17:37:21.786576] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLE took 26.1s. Estimated remaining: 4h 18m 60s. Rate: 8.0 symbols/min [2025-10-30T17:37:21.967192] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:21.967360] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-30T17:37:21.967398] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-30T17:37:21.967506] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-30T17:37:21.967548] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-30T17:37:21.967590] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-30T17:37:21.967622] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-30T17:37:22.113073] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-30T17:37:22.337825] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:22.546086] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T17:37:22.897502] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-30T17:37:23.466336] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T17:37:23.697494] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-30T17:37:23.849846] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T17:37:24.497525] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-30T17:37:24.642571] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:37:24.642905] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-30T17:37:24.642988] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:37:24.643036] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-30T17:37:24.643072] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:37:24.643108] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-30T17:37:24.643160] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-30T17:37:24.643193] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-30T17:37:24.643231] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-30T17:37:24.643275] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLSH took 2.9s. Estimated remaining: 4h 18m 20s. Rate: 8.0 symbols/min [2025-10-30T17:37:24.810346] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:24.823208] [DEBUG] [LOCAL ] BLW: Loaded 12633 existing records from primary storage. [2025-10-30T17:37:24.823691] [INFO ] [MAIN ] BLW: Loaded 12633 existing records. [2025-10-30T17:37:25.002466] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:37:25.002798] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-30T17:37:25.002863] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-30T17:37:25.003063] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-30T17:37:25.003112] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-30T17:37:25.135069] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T17:37:25.302624] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-30T17:37:25.400610] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:26.097504] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-30T17:37:26.479020] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T17:37:26.897497] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-30T17:37:27.150561] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T17:37:27.697507] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-30T17:37:28.005768] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T17:37:28.497506] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-30T17:37:29.297475] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-30T17:37:29.377865] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T17:37:29.387759] [INFO ] [REMOTE ] BLK: Full fetch complete (52484 records). [2025-10-30T17:37:29.387952] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-30T17:37:29.769029] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-30T17:37:29.769116] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-30T17:37:29.769779] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-30T17:37:29.769843] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-30T17:37:29.771032] [DEBUG] [LOCAL ] BLK: Trimmed 52484 records to 33688 (keeping 200 days of data) [2025-10-30T17:37:29.886827] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-30T17:37:30.002725] [DEBUG] [LOCAL ] BLK: Primary data saved (33688 records). [2025-10-30T17:37:30.002863] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-30T17:37:30.002962] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLK took 26.8s. Estimated remaining: 4h 17m 58s. Rate: 8.0 symbols/min [2025-10-30T17:37:30.099185] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-30T17:37:30.191098] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:30.206594] [DEBUG] [LOCAL ] BLX: Loaded 14943 existing records from primary storage. [2025-10-30T17:37:30.207004] [INFO ] [MAIN ] BLX: Loaded 14943 existing records. [2025-10-30T17:37:30.358883] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-30T17:37:30.449617] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:37:30.449854] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-30T17:37:30.449907] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-30T17:37:30.450104] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-30T17:37:30.450143] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-30T17:37:30.830739] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:30.897483] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-30T17:37:31.315479] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T17:37:31.636975] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T17:37:31.697503] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-30T17:37:32.186345] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T17:37:32.497524] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-30T17:37:33.054782] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T17:37:33.297494] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-30T17:37:34.097498] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-30T17:37:34.680929] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T17:37:34.834419] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-30T17:37:34.897459] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-30T17:37:35.697490] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-30T17:37:35.740754] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-30T17:37:36.497499] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-30T17:37:37.033569] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-30T17:37:37.297469] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-30T17:37:37.487686] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-30T17:37:37.500731] [INFO ] [REMOTE ] BLDR: Full fetch complete (74760 records). [2025-10-30T17:37:37.500918] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-30T17:37:37.900738] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-30T17:37:37.900963] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-30T17:37:37.901868] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-30T17:37:37.901951] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-30T17:37:37.911824] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-30T17:37:37.915497] [DEBUG] [LOCAL ] BLDR: Trimmed 74760 records to 52195 (keeping 200 days of data) [2025-10-30T17:37:38.098399] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-30T17:37:38.241828] [DEBUG] [LOCAL ] BLDR: Primary data saved (52195 records). [2025-10-30T17:37:38.241952] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-30T17:37:38.242467] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLDR took 47.0s. Estimated remaining: 4h 17m 56s. Rate: 8.0 symbols/min [2025-10-30T17:37:38.413344] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:38.447306] [DEBUG] [LOCAL ] BMA: Loaded 36780 existing records from primary storage. [2025-10-30T17:37:38.447605] [INFO ] [MAIN ] BMA: Loaded 36780 existing records. [2025-10-30T17:37:38.634218] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:37:38.634428] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-30T17:37:38.634475] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-30T17:37:38.634880] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-30T17:37:38.634937] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-30T17:37:38.900738] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-30T17:37:39.018144] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T17:37:39.044831] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:39.697569] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-30T17:37:40.403613] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T17:37:40.416243] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T17:37:40.497528] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-30T17:37:41.297500] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-30T17:37:41.741795] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:37:42.097506] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-30T17:37:42.165869] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T17:37:42.897489] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-30T17:37:43.072106] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T17:37:43.697520] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-30T17:37:44.187157] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T17:37:44.217923] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T17:37:44.497604] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-30T17:37:45.017778] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-30T17:37:45.297550] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-30T17:37:45.878532] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-30T17:37:46.097528] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-30T17:37:46.896212] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T17:37:46.899936] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-30T17:37:47.625164] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T17:37:47.697538] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-30T17:37:48.497506] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-30T17:37:49.118577] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T17:37:49.129848] [INFO ] [REMOTE ] BLND: Full fetch complete (72154 records). [2025-10-30T17:37:49.130010] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-30T17:37:49.303078] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-30T17:37:49.522898] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-30T17:37:49.522995] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-30T17:37:49.523829] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-30T17:37:49.523896] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-30T17:37:49.525411] [DEBUG] [LOCAL ] BLND: Trimmed 72154 records to 49534 (keeping 200 days of data) [2025-10-30T17:37:49.817498] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:37:49.823177] [DEBUG] [LOCAL ] BLND: Primary data saved (49534 records). [2025-10-30T17:37:49.823412] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-30T17:37:49.824521] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLND took 40.8s. Estimated remaining: 4h 18m 16s. Rate: 8.0 symbols/min [2025-10-30T17:37:50.015107] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:50.015335] [DEBUG] [LOCAL ] BME: No existing data file found in primary storage. [2025-10-30T17:37:50.015381] [WARN ] [MAIN ] BME: No existing data found, performing full refresh instead. [2025-10-30T17:37:50.015492] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-30T17:37:50.015534] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-30T17:37:50.015577] [DEBUG] [LOCAL ] BME: No primary data file found to delete. [2025-10-30T17:37:50.015610] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-30T17:37:50.098129] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-30T17:37:50.172730] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T17:37:50.400997] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:50.897510] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-30T17:37:50.926243] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T17:37:51.697510] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-30T17:37:52.077690] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T17:37:52.468268] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-30T17:37:52.471919] [INFO ] [REMOTE ] BLW: Full fetch complete (19180 records). [2025-10-30T17:37:52.471998] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-30T17:37:52.502606] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-30T17:37:52.832156] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-30T17:37:52.832232] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-30T17:37:52.832583] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-30T17:37:52.832622] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-30T17:37:52.833170] [DEBUG] [LOCAL ] BLW: Trimmed 19180 records to 12730 (keeping 200 days of data) [2025-10-30T17:37:52.908356] [DEBUG] [LOCAL ] BLW: Primary data saved (12730 records). [2025-10-30T17:37:52.908484] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-30T17:37:52.908559] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLW took 28.3s. Estimated remaining: 4h 17m 38s. Rate: 8.0 symbols/min [2025-10-30T17:37:53.074735] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:53.097348] [DEBUG] [LOCAL ] BMEZ: Loaded 24526 existing records from primary storage. [2025-10-30T17:37:53.097584] [INFO ] [MAIN ] BMEZ: Loaded 24526 existing records. [2025-10-30T17:37:53.270384] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:37:53.270630] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-30T17:37:53.270711] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-30T17:37:53.271012] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-30T17:37:53.271067] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-30T17:37:53.302572] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-30T17:37:53.545069] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T17:37:53.579907] [INFO ] [REMOTE ] BLX: Full fetch complete (22541 records). [2025-10-30T17:37:53.590934] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-30T17:37:53.753579] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:54.073941] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-30T17:37:54.074521] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-30T17:37:54.075018] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-30T17:37:54.075538] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-30T17:37:54.075453] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-30T17:37:54.079995] [DEBUG] [LOCAL ] BLX: Trimmed 22541 records to 15111 (keeping 200 days of data) [2025-10-30T17:37:54.117055] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-30T17:37:54.174510] [DEBUG] [LOCAL ] BLX: Primary data saved (15111 records). [2025-10-30T17:37:54.174675] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-30T17:37:54.174773] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BLX took 24.2s. Estimated remaining: 4h 16m 49s. Rate: 8.0 symbols/min [2025-10-30T17:37:54.344455] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:37:54.366756] [DEBUG] [LOCAL ] BMI: Loaded 24435 existing records from primary storage. [2025-10-30T17:37:54.367011] [INFO ] [MAIN ] BMI: Loaded 24435 existing records. [2025-10-30T17:37:54.540370] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:37:54.540564] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-30T17:37:54.540610] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-30T17:37:54.540886] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-30T17:37:54.540938] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-30T17:37:54.686574] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-30T17:37:54.898134] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:37:54.898253] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-30T17:37:55.697479] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-30T17:37:55.842410] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T17:37:56.497521] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-30T17:37:56.892475] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T17:37:57.016978] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T17:37:57.297486] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-30T17:37:58.100613] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-30T17:37:58.103575] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T17:37:58.805855] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-30T17:37:58.897512] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-30T17:37:59.697520] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-30T17:37:59.812193] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-30T17:38:00.497491] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-30T17:38:00.884983] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T17:38:01.242511] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T17:38:01.297457] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-30T17:38:02.079925] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T17:38:02.097465] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-30T17:38:02.708097] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-30T17:38:02.897579] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-30T17:38:03.697499] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-30T17:38:04.041905] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T17:38:04.427409] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T17:38:04.497520] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-30T17:38:05.297518] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-30T17:38:05.468603] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T17:38:06.097472] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-30T17:38:06.221679] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T17:38:06.897495] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-30T17:38:07.104228] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T17:38:07.639591] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-30T17:38:07.697637] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-30T17:38:08.295710] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-30T17:38:08.497575] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-30T17:38:09.297475] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-30T17:38:09.306919] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T17:38:09.309895] [INFO ] [REMOTE ] BME: Full fetch complete (15483 records). [2025-10-30T17:38:09.309965] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-30T17:38:09.667134] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-30T17:38:09.667221] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-30T17:38:09.667525] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-30T17:38:09.667565] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-30T17:38:09.668073] [DEBUG] [LOCAL ] BME: Trimmed 15483 records to 11067 (keeping 200 days of data) [2025-10-30T17:38:09.733784] [DEBUG] [LOCAL ] BME: Primary data saved (11067 records). [2025-10-30T17:38:09.733906] [INFO ] [MAIN ] BME: Full history saved. [2025-10-30T17:38:09.733975] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BME took 19.9s. Estimated remaining: 4h 17m 36s. Rate: 8.0 symbols/min [2025-10-30T17:38:09.905272] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:38:09.909211] [DEBUG] [LOCAL ] BMN: Loaded 2619 existing records from primary storage. [2025-10-30T17:38:09.909352] [INFO ] [MAIN ] BMN: Loaded 2619 existing records. [2025-10-30T17:38:10.092106] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:38:10.092289] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-30T17:38:10.092334] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-30T17:38:10.092451] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-30T17:38:10.092488] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-30T17:38:10.103814] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-30T17:38:10.458546] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:38:10.476290] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T17:38:10.897491] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-30T17:38:11.121390] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-30T17:38:11.669093] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-30T17:38:11.697499] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-30T17:38:12.385265] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T17:38:12.497464] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-30T17:38:13.297458] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-30T17:38:13.405180] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T17:38:14.044686] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T17:38:14.097461] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-30T17:38:14.839682] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-30T17:38:14.897522] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-30T17:38:15.369197] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-30T17:38:15.697505] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-30T17:38:16.497532] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-30T17:38:16.988879] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T17:38:17.297526] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-30T17:38:17.749389] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T17:38:18.019889] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T17:38:18.097565] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-30T17:38:18.892936] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T17:38:18.898130] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-30T17:38:19.697516] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-30T17:38:20.231290] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T17:38:20.240866] [INFO ] [REMOTE ] BMA: Full fetch complete (52473 records). [2025-10-30T17:38:20.241021] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-30T17:38:20.241693] [FATAL] [VALIDATOR ] BMA: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:38:20.241778] [FATAL] [MAIN ] BMA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:38:20.241821] [WARN ] [MAIN ] BMA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:38:20.241858] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-30T17:38:20.241912] [DEBUG] [LOCAL ] BMA: No primary data file found to delete. [2025-10-30T17:38:20.241968] [INFO ] [LOCAL ] BMA: Starting deletion of derivative data. [2025-10-30T17:38:20.242182] [DEBUG] [LOCAL ] BMA: Deleted derivative data file. [2025-10-30T17:38:20.242585] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BMA took 42.0s. Estimated remaining: 4h 17m 49s. Rate: 8.0 symbols/min [2025-10-30T17:38:20.417033] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:38:20.466283] [DEBUG] [LOCAL ] BMO: Loaded 40374 existing records from primary storage. [2025-10-30T17:38:20.466634] [INFO ] [MAIN ] BMO: Loaded 40374 existing records. [2025-10-30T17:38:20.498949] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-30T17:38:20.643187] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T17:38:20.672519] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:38:20.672904] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-30T17:38:20.672985] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-30T17:38:20.673811] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-30T17:38:20.673869] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-30T17:38:20.863208] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-30T17:38:21.064396] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:38:21.297527] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-30T17:38:22.097519] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-30T17:38:22.360033] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T17:38:22.365928] [INFO ] [REMOTE ] BMEZ: Full fetch complete (38566 records). [2025-10-30T17:38:22.366055] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-30T17:38:22.444468] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-30T17:38:22.767282] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-30T17:38:22.767419] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-30T17:38:22.767959] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-30T17:38:22.768020] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-30T17:38:22.768834] [DEBUG] [LOCAL ] BMEZ: Trimmed 38566 records to 24658 (keeping 200 days of data) [2025-10-30T17:38:22.902080] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-30T17:38:22.917278] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24658 records). [2025-10-30T17:38:22.917414] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-30T17:38:22.917494] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BMEZ took 30.0s. Estimated remaining: 4h 17m 9s. Rate: 8.0 symbols/min [2025-10-30T17:38:23.088186] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:38:23.138573] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-30T17:38:23.138904] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-30T17:38:23.295945] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-30T17:38:23.328171] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:38:23.328380] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-30T17:38:23.328430] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-30T17:38:23.329008] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-30T17:38:23.329065] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-30T17:38:23.706564] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-30T17:38:23.713387] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:38:24.497531] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-30T17:38:24.692226] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T17:38:25.297505] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-30T17:38:25.628388] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T17:38:26.097494] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-30T17:38:26.133394] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T17:38:26.139791] [INFO ] [REMOTE ] BMI: Full fetch complete (34233 records). [2025-10-30T17:38:26.139924] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-30T17:38:26.525243] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-30T17:38:26.525326] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-30T17:38:26.525907] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-30T17:38:26.525972] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-30T17:38:26.526968] [DEBUG] [LOCAL ] BMI: Trimmed 34233 records to 24595 (keeping 200 days of data) [2025-10-30T17:38:26.676190] [DEBUG] [LOCAL ] BMI: Primary data saved (24595 records). [2025-10-30T17:38:26.676347] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-30T17:38:26.676439] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMI took 32.5s. Estimated remaining: 4h 16m 36s. Rate: 8.0 symbols/min [2025-10-30T17:38:26.846285] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:38:26.893175] [DEBUG] [LOCAL ] BN: Loaded 52967 existing records from primary storage. [2025-10-30T17:38:26.893480] [INFO ] [MAIN ] BN: Loaded 52967 existing records. [2025-10-30T17:38:26.904496] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-30T17:38:27.076495] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:38:27.076854] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-30T17:38:27.076980] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-30T17:38:27.077478] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-30T17:38:27.077534] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-30T17:38:27.279719] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T17:38:27.470943] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:38:27.697507] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-30T17:38:28.444593] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-30T17:38:28.497531] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-30T17:38:29.015862] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T17:38:29.297488] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-30T17:38:29.721950] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T17:38:30.097533] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-30T17:38:30.544220] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T17:38:30.897509] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-30T17:38:31.529331] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T17:38:31.697486] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-30T17:38:32.274990] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:38:32.497494] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-30T17:38:32.935548] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-30T17:38:33.224704] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T17:38:33.297459] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-30T17:38:34.097471] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-30T17:38:34.418333] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-30T17:38:34.710419] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T17:38:34.897461] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-30T17:38:35.384599] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-30T17:38:35.697502] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-30T17:38:36.497479] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-30T17:38:37.188399] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T17:38:37.297468] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-30T17:38:37.783858] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T17:38:38.097537] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-30T17:38:38.755780] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T17:38:38.897500] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-30T17:38:39.652175] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T17:38:39.697481] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-30T17:38:40.015895] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-30T17:38:40.192553] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T17:38:40.497488] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-30T17:38:41.297540] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-30T17:38:41.675949] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:38:41.861684] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-30T17:38:41.862975] [INFO ] [REMOTE ] BMN: Full fetch complete (3780 records). [2025-10-30T17:38:41.863059] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-30T17:38:42.106530] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-30T17:38:42.228199] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-30T17:38:42.228274] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-30T17:38:42.228387] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-30T17:38:42.228425] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-30T17:38:42.228796] [DEBUG] [LOCAL ] BMN: Trimmed 3780 records to 2649 (keeping 200 days of data) [2025-10-30T17:38:42.244785] [DEBUG] [LOCAL ] BMN: Primary data saved (2649 records). [2025-10-30T17:38:42.244909] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-30T17:38:42.244993] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 32.5s. Estimated remaining: 4h 17m 23s. Rate: 8.0 symbols/min [2025-10-30T17:38:42.419406] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:38:42.444517] [DEBUG] [LOCAL ] BNED: Loaded 27758 existing records from primary storage. [2025-10-30T17:38:42.444791] [INFO ] [MAIN ] BNED: Loaded 27758 existing records. [2025-10-30T17:38:42.628750] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:38:42.629007] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-30T17:38:42.629063] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-30T17:38:42.629370] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-30T17:38:42.629426] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-30T17:38:42.905783] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-30T17:38:42.986614] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:38:43.203348] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T17:38:43.697497] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-30T17:38:44.241399] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T17:38:44.497468] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-30T17:38:44.695587] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T17:38:45.297554] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-30T17:38:46.097466] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-30T17:38:46.364542] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-30T17:38:46.585411] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T17:38:46.897501] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-30T17:38:47.697492] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-30T17:38:47.953509] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-30T17:38:48.191408] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T17:38:48.497504] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-30T17:38:49.297485] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-30T17:38:49.427173] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-30T17:38:49.967004] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-30T17:38:50.097551] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-30T17:38:50.466315] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-30T17:38:50.475454] [INFO ] [REMOTE ] BMO: Full fetch complete (59741 records). [2025-10-30T17:38:50.475573] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-30T17:38:50.864221] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-30T17:38:50.864335] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-30T17:38:50.865083] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-30T17:38:50.865166] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-30T17:38:50.866496] [DEBUG] [LOCAL ] BMO: Trimmed 59741 records to 40703 (keeping 200 days of data) [2025-10-30T17:38:50.920905] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-30T17:38:51.008853] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T17:38:51.151432] [DEBUG] [LOCAL ] BMO: Primary data saved (40703 records). [2025-10-30T17:38:51.151561] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-30T17:38:51.152415] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMO took 30.9s. Estimated remaining: 4h 17m 24s. Rate: 8.0 symbols/min [2025-10-30T17:38:51.328347] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:38:51.336202] [DEBUG] [LOCAL ] BNH: Loaded 4468 existing records from primary storage. [2025-10-30T17:38:51.336442] [INFO ] [MAIN ] BNH: Loaded 4468 existing records. [2025-10-30T17:38:51.525947] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:38:51.526213] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-30T17:38:51.526261] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-30T17:38:51.526623] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-30T17:38:51.526713] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-30T17:38:51.704159] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-30T17:38:51.884096] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:38:52.497486] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-30T17:38:52.715965] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T17:38:52.830497] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-30T17:38:53.297536] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-30T17:38:53.796465] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T17:38:54.097518] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-30T17:38:54.145064] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-30T17:38:54.897512] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-30T17:38:55.303555] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T17:38:55.698432] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-30T17:38:55.701280] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T17:38:55.713430] [INFO ] [REMOTE ] BN: Full fetch complete (76949 records). [2025-10-30T17:38:55.713577] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-30T17:38:56.115306] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-30T17:38:56.115405] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-30T17:38:56.116216] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-30T17:38:56.116279] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-30T17:38:56.117696] [DEBUG] [LOCAL ] BN: Trimmed 76949 records to 53357 (keeping 200 days of data) [2025-10-30T17:38:56.429971] [DEBUG] [LOCAL ] BN: Primary data saved (53357 records). [2025-10-30T17:38:56.430101] [INFO ] [MAIN ] BN: Full history saved. [2025-10-30T17:38:56.430977] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BN took 29.8s. Estimated remaining: 4h 17m 2s. Rate: 8.0 symbols/min [2025-10-30T17:38:56.504848] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-30T17:38:56.603250] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:38:56.607118] [DEBUG] [LOCAL ] BNJ: Loaded 2419 existing records from primary storage. [2025-10-30T17:38:56.607262] [INFO ] [MAIN ] BNJ: Loaded 2419 existing records. [2025-10-30T17:38:56.780228] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:38:56.780444] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-30T17:38:56.780490] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-30T17:38:56.780861] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-30T17:38:56.780916] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-30T17:38:56.950682] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T17:38:57.137256] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:38:57.297515] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-30T17:38:57.617199] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-30T17:38:57.655298] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-30T17:38:58.097552] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-30T17:38:58.564252] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T17:38:58.897496] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-30T17:38:59.392688] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-30T17:38:59.697512] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-30T17:38:59.976132] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-30T17:39:00.497485] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-30T17:39:01.297517] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-30T17:39:02.097524] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-30T17:39:02.159368] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-30T17:39:02.599841] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-30T17:39:02.897539] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-30T17:39:02.936496] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-30T17:39:03.697558] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-30T17:39:04.034498] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-30T17:39:04.141484] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T17:39:04.153177] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-30T17:39:04.153303] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-30T17:39:04.501326] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-30T17:39:04.548153] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-30T17:39:04.548230] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-30T17:39:04.549116] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-30T17:39:04.549178] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-30T17:39:04.550522] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54147 (keeping 200 days of data) [2025-10-30T17:39:04.873739] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-30T17:39:04.873869] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-30T17:39:04.873966] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BMY took 42.0s. Estimated remaining: 4h 17m 1s. Rate: 8.0 symbols/min [2025-10-30T17:39:04.991358] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-30T17:39:05.062107] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:05.103194] [DEBUG] [LOCAL ] BNL: Loaded 46765 existing records from primary storage. [2025-10-30T17:39:05.103507] [INFO ] [MAIN ] BNL: Loaded 46765 existing records. [2025-10-30T17:39:05.288271] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:05.288525] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-30T17:39:05.288573] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-30T17:39:05.289026] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-30T17:39:05.289094] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-30T17:39:05.302746] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-30T17:39:05.641927] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:39:06.097470] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-30T17:39:06.243684] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T17:39:06.433584] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-30T17:39:06.897546] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-30T17:39:07.187432] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-30T17:39:07.697514] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-30T17:39:08.497468] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-30T17:39:08.922956] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-30T17:39:08.944494] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T17:39:09.297517] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-30T17:39:09.565818] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-30T17:39:10.097518] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-30T17:39:10.526455] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-30T17:39:10.897521] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-30T17:39:11.697546] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-30T17:39:12.008592] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T17:39:12.066815] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-30T17:39:12.497511] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-30T17:39:13.052102] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-30T17:39:13.297480] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-30T17:39:13.651230] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-30T17:39:14.097518] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-30T17:39:14.897470] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-30T17:39:14.948021] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-30T17:39:15.697498] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-30T17:39:16.215155] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T17:39:16.497611] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-30T17:39:16.565895] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T17:39:16.952536] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-30T17:39:16.954173] [INFO ] [REMOTE ] BNJ: Full fetch complete (3863 records). [2025-10-30T17:39:16.954292] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-30T17:39:17.302717] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-30T17:39:17.401980] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-30T17:39:17.402064] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-30T17:39:17.402197] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-30T17:39:17.402237] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-30T17:39:17.402595] [DEBUG] [LOCAL ] BNJ: Trimmed 3863 records to 2450 (keeping 200 days of data) [2025-10-30T17:39:17.417714] [DEBUG] [LOCAL ] BNJ: Primary data saved (2450 records). [2025-10-30T17:39:17.417819] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-30T17:39:17.417898] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BNJ took 21.0s. Estimated remaining: 4h 17m 26s. Rate: 8.0 symbols/min [2025-10-30T17:39:17.593375] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:17.644433] [DEBUG] [LOCAL ] BNS: Loaded 51268 existing records from primary storage. [2025-10-30T17:39:17.644773] [INFO ] [MAIN ] BNS: Loaded 51268 existing records. [2025-10-30T17:39:17.824948] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:17.825143] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-30T17:39:17.825189] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-30T17:39:17.825755] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-30T17:39:17.825812] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-30T17:39:17.939951] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-30T17:39:18.102608] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-30T17:39:18.218301] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:39:18.897487] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-30T17:39:19.019055] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-30T17:39:19.023782] [INFO ] [REMOTE ] BNED: Full fetch complete (40954 records). [2025-10-30T17:39:19.023859] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-30T17:39:19.024378] [FATAL] [VALIDATOR ] BNED: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:39:19.024461] [FATAL] [MAIN ] BNED: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:39:19.024503] [WARN ] [MAIN ] BNED: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:39:19.024541] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-30T17:39:19.024595] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-10-30T17:39:19.024629] [INFO ] [LOCAL ] BNED: Starting deletion of derivative data. [2025-10-30T17:39:19.024847] [DEBUG] [LOCAL ] BNED: Deleted derivative data file. [2025-10-30T17:39:19.024934] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BNED took 36.8s. Estimated remaining: 4h 16m 40s. Rate: 8.0 symbols/min [2025-10-30T17:39:19.188675] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:19.193202] [DEBUG] [LOCAL ] BNT: Loaded 3298 existing records from primary storage. [2025-10-30T17:39:19.193352] [INFO ] [MAIN ] BNT: Loaded 3298 existing records. [2025-10-30T17:39:19.374589] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:19.374854] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-30T17:39:19.374911] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-30T17:39:19.375061] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-30T17:39:19.375116] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-30T17:39:19.705681] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-30T17:39:19.758363] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:39:19.959956] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T17:39:20.497493] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-30T17:39:20.961214] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-30T17:39:21.234625] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-30T17:39:21.297503] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-30T17:39:22.097495] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-30T17:39:22.414135] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-30T17:39:22.897472] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-30T17:39:22.932370] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-30T17:39:23.316003] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-30T17:39:23.697500] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-30T17:39:24.497497] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-30T17:39:25.285377] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T17:39:25.297449] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-30T17:39:26.098495] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-30T17:39:26.103742] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-30T17:39:26.650672] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-30T17:39:26.713404] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T17:39:26.897464] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-30T17:39:27.697494] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-30T17:39:28.094387] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T17:39:28.497490] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-30T17:39:28.811732] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T17:39:29.125897] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-30T17:39:29.127521] [INFO ] [REMOTE ] BNH: Full fetch complete (6804 records). [2025-10-30T17:39:29.127588] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-30T17:39:29.308961] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-30T17:39:29.501445] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-30T17:39:29.501531] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-30T17:39:29.501746] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-30T17:39:29.501809] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-30T17:39:29.502278] [DEBUG] [LOCAL ] BNH: Trimmed 6804 records to 4500 (keeping 200 days of data) [2025-10-30T17:39:29.530466] [DEBUG] [LOCAL ] BNH: Primary data saved (4500 records). [2025-10-30T17:39:29.530602] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-30T17:39:29.530731] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNH took 38.4s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-10-30T17:39:29.703882] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:29.711668] [DEBUG] [LOCAL ] BNY: Loaded 7137 existing records from primary storage. [2025-10-30T17:39:29.711847] [INFO ] [MAIN ] BNY: Loaded 7137 existing records. [2025-10-30T17:39:29.893109] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:29.893303] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-30T17:39:29.893349] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-30T17:39:29.893491] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-30T17:39:29.893529] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-30T17:39:30.107493] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-30T17:39:30.276587] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:39:30.494244] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-30T17:39:30.598410] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T17:39:30.897498] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-30T17:39:31.697493] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-30T17:39:32.062357] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T17:39:32.208303] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T17:39:32.497502] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-30T17:39:33.297496] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-30T17:39:33.943242] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T17:39:34.097546] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-30T17:39:34.599833] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T17:39:34.897496] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-30T17:39:35.307265] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T17:39:35.697548] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-30T17:39:36.238985] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-30T17:39:36.272310] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-30T17:39:36.497530] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-30T17:39:37.297508] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-30T17:39:37.677466] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T17:39:37.803142] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-30T17:39:38.097504] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-30T17:39:38.897499] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-30T17:39:39.196514] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T17:39:39.386666] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T17:39:39.697523] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-30T17:39:40.497482] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-30T17:39:40.924308] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-30T17:39:41.244387] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T17:39:41.256566] [INFO ] [REMOTE ] BNS: Full fetch complete (74538 records). [2025-10-30T17:39:41.256743] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-30T17:39:41.302806] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-30T17:39:41.689349] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-30T17:39:41.689439] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-30T17:39:41.690234] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-30T17:39:41.690299] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-30T17:39:41.691728] [DEBUG] [LOCAL ] BNS: Trimmed 74538 records to 51641 (keeping 200 days of data) [2025-10-30T17:39:41.999230] [DEBUG] [LOCAL ] BNS: Primary data saved (51641 records). [2025-10-30T17:39:41.999361] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-30T17:39:42.000285] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNS took 24.6s. Estimated remaining: 4h 17m 17s. Rate: 8.0 symbols/min [2025-10-30T17:39:42.098921] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-30T17:39:42.181570] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:42.182316] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-30T17:39:42.202513] [DEBUG] [LOCAL ] BOC: Loaded 17794 existing records from primary storage. [2025-10-30T17:39:42.202766] [INFO ] [MAIN ] BOC: Loaded 17794 existing records. [2025-10-30T17:39:42.381027] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:42.381275] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-30T17:39:42.381336] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-30T17:39:42.381588] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-30T17:39:42.381678] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-30T17:39:42.682741] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-30T17:39:42.744951] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:39:42.897505] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-30T17:39:43.697495] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-30T17:39:44.200215] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-30T17:39:44.201906] [INFO ] [REMOTE ] BNT: Full fetch complete (4870 records). [2025-10-30T17:39:44.202087] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-30T17:39:44.502067] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-30T17:39:44.575352] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T17:39:44.604345] [INFO ] [REMOTE ] BNL: Full fetch complete (67358 records). [2025-10-30T17:39:44.638706] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-30T17:39:44.723852] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-30T17:39:44.746845] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-30T17:39:44.769950] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-30T17:39:44.795880] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-30T17:39:44.799310] [DEBUG] [LOCAL ] BNT: Trimmed 4870 records to 3318 (keeping 200 days of data) [2025-10-30T17:39:44.878908] [DEBUG] [LOCAL ] BNT: Primary data saved (3318 records). [2025-10-30T17:39:44.900915] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-30T17:39:44.984068] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNT took 26.0s. Estimated remaining: 4h 16m 40s. Rate: 8.0 symbols/min [2025-10-30T17:39:45.123231] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-30T17:39:45.128523] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-30T17:39:45.129515] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-30T17:39:45.129598] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-30T17:39:45.130566] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-30T17:39:45.134190] [DEBUG] [LOCAL ] BNL: Trimmed 67358 records to 47140 (keeping 200 days of data) [2025-10-30T17:39:45.306375] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-30T17:39:45.418037] [DEBUG] [LOCAL ] BNL: Primary data saved (47140 records). [2025-10-30T17:39:45.418172] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-30T17:39:45.418251] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNL took 40.5s. Estimated remaining: 4h 15m 47s. Rate: 8.0 symbols/min [2025-10-30T17:39:46.097510] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-30T17:39:46.130424] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T17:39:46.545575] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T17:39:46.897531] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-30T17:39:47.457999] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T17:39:47.697529] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-30T17:39:48.211250] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T17:39:48.497586] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-30T17:39:49.170529] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T17:39:49.297544] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-30T17:39:49.865923] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-30T17:39:50.097561] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-30T17:39:50.589353] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-30T17:39:50.897498] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-30T17:39:51.374546] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T17:39:51.697496] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-30T17:39:52.351949] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T17:39:52.354267] [INFO ] [REMOTE ] BNY: Full fetch complete (10450 records). [2025-10-30T17:39:52.354336] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-30T17:39:52.502707] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-30T17:39:52.726071] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-30T17:39:52.726144] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-30T17:39:52.726403] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-30T17:39:52.726463] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-30T17:39:52.726932] [DEBUG] [LOCAL ] BNY: Trimmed 10450 records to 7193 (keeping 200 days of data) [2025-10-30T17:39:52.770426] [DEBUG] [LOCAL ] BNY: Primary data saved (7193 records). [2025-10-30T17:39:52.770544] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-30T17:39:52.770619] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNY took 23.2s. Estimated remaining: 4h 15m 38s. Rate: 8.0 symbols/min [2025-10-30T17:39:53.362238] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T17:39:53.367538] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-30T17:39:54.041151] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T17:39:54.097543] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-30T17:39:54.762872] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T17:39:54.897536] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-30T17:39:55.710315] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T17:39:55.715051] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-30T17:39:56.537173] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-30T17:39:56.542435] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-30T17:39:57.243721] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T17:39:57.297460] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-30T17:39:58.177490] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-30T17:39:58.181792] [INFO ] [REMOTE ] BOC: Full fetch complete (25659 records). [2025-10-30T17:39:58.181881] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-30T17:39:58.182315] [FATAL] [VALIDATOR ] BOC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:39:58.182410] [FATAL] [MAIN ] BOC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:39:58.182455] [WARN ] [MAIN ] BOC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:39:58.182494] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-30T17:39:58.182688] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-10-30T17:39:58.182744] [INFO ] [LOCAL ] BOC: Starting deletion of derivative data. [2025-10-30T17:39:58.182918] [DEBUG] [LOCAL ] BOC: Deleted derivative data file. [2025-10-30T17:39:58.183004] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BOC took 16.2s. Estimated remaining: 4h 15m 18s. Rate: 8.0 symbols/min [2025-10-30T17:39:58.823522] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:58.834945] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:58.904567] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:58.901356] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:39:58.930362] [DEBUG] [LOCAL ] BOE: Loaded 17294 existing records from primary storage. [2025-10-30T17:39:58.949347] [DEBUG] [LOCAL ] BOH: Loaded 30400 existing records from primary storage. [2025-10-30T17:39:58.958322] [INFO ] [MAIN ] BOH: Loaded 30400 existing records. [2025-10-30T17:39:58.958193] [INFO ] [MAIN ] BOE: Loaded 17294 existing records. [2025-10-30T17:39:59.114101] [DEBUG] [LOCAL ] BOND: Loaded 32239 existing records from primary storage. [2025-10-30T17:39:59.194474] [DEBUG] [LOCAL ] BOOT: Loaded 39038 existing records from primary storage. [2025-10-30T17:39:59.183611] [INFO ] [MAIN ] BOND: Loaded 32239 existing records. [2025-10-30T17:39:59.245215] [INFO ] [MAIN ] BOOT: Loaded 39038 existing records. [2025-10-30T17:39:59.450661] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:59.481925] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:59.492567] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-30T17:39:59.548252] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-30T17:39:59.548415] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-30T17:39:59.613045] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-30T17:39:59.594955] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-30T17:39:59.655502] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-30T17:39:59.640757] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-30T17:39:59.660873] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-30T17:39:59.687751] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:59.791865] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-30T17:39:59.840250] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-30T17:39:59.845543] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:39:59.861548] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-30T17:39:59.856197] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-30T17:39:59.912676] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-30T17:39:59.926486] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-30T17:40:00.068348] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-30T17:40:00.169865] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-30T17:40:00.881813] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:00.932828] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:00.929935] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-30T17:40:00.957689] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-30T17:40:01.039045] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:01.076905] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-30T17:40:01.231939] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:01.232251] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-30T17:40:02.078468] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T17:40:02.084484] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-30T17:40:02.134232] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:40:02.142845] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-30T17:40:02.759197] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-30T17:40:02.902130] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-30T17:40:02.903935] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T17:40:03.697542] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-30T17:40:04.344010] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T17:40:04.367383] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-30T17:40:04.497563] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-30T17:40:05.247852] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (4.17 seconds). [2025-10-30T17:40:05.297499] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-30T17:40:05.446527] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-30T17:40:06.102681] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-30T17:40:06.114613] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-30T17:40:06.290799] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:40:06.897496] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-30T17:40:07.309539] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T17:40:07.697500] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-30T17:40:08.170065] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T17:40:08.497496] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-30T17:40:09.297536] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-30T17:40:09.584503] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T17:40:10.097491] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-30T17:40:10.254715] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T17:40:10.897475] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-30T17:40:11.121829] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T17:40:11.471373] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (3.77 seconds). [2025-10-30T17:40:11.697490] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-30T17:40:11.723533] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T17:40:12.497493] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-30T17:40:13.297551] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-30T17:40:13.386011] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-30T17:40:13.466411] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:40:14.097499] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-30T17:40:14.366609] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-30T17:40:14.897491] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-30T17:40:15.664666] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-30T17:40:15.697517] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-30T17:40:15.961920] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T17:40:16.497592] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-30T17:40:17.305679] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-30T17:40:17.303233] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T17:40:17.315023] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-30T17:40:18.097511] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-30T17:40:18.417132] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T17:40:18.897510] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-30T17:40:19.251065] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T17:40:19.496434] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-30T17:40:19.697508] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-30T17:40:20.497502] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-30T17:40:20.882364] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T17:40:20.889991] [INFO ] [REMOTE ] BOH: Full fetch complete (45526 records). [2025-10-30T17:40:20.890094] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-30T17:40:21.208680] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T17:40:21.278439] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-30T17:40:21.278515] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-30T17:40:21.279094] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-30T17:40:21.279156] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-30T17:40:21.280111] [DEBUG] [LOCAL ] BOH: Trimmed 45526 records to 30663 (keeping 200 days of data) [2025-10-30T17:40:21.332350] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-30T17:40:21.460706] [DEBUG] [LOCAL ] BOH: Primary data saved (30663 records). [2025-10-30T17:40:21.460843] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-30T17:40:21.460923] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOH took 23.3s. Estimated remaining: 4h 16m 51s. Rate: 8.0 symbols/min [2025-10-30T17:40:21.631539] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:40:21.679860] [DEBUG] [LOCAL ] BORR: Loaded 51031 existing records from primary storage. [2025-10-30T17:40:21.680160] [INFO ] [MAIN ] BORR: Loaded 51031 existing records. [2025-10-30T17:40:21.859077] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:40:21.859289] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-30T17:40:21.859335] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-30T17:40:21.859795] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-30T17:40:21.859858] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-30T17:40:22.097538] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-30T17:40:22.223173] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:22.233502] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-30T17:40:22.897473] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-30T17:40:23.166680] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T17:40:23.697494] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-30T17:40:23.985923] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T17:40:23.990957] [INFO ] [REMOTE ] BOE: Full fetch complete (26643 records). [2025-10-30T17:40:23.991078] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-30T17:40:24.366089] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-30T17:40:24.366172] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-30T17:40:24.366697] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-30T17:40:24.366758] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-30T17:40:24.367504] [DEBUG] [LOCAL ] BOE: Trimmed 26643 records to 17474 (keeping 200 days of data) [2025-10-30T17:40:24.470852] [DEBUG] [LOCAL ] BOE: Primary data saved (17474 records). [2025-10-30T17:40:24.470995] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-30T17:40:24.471074] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOE took 26.3s. Estimated remaining: 4h 16m 14s. Rate: 8.0 symbols/min [2025-10-30T17:40:24.502735] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-30T17:40:24.655851] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:40:24.675793] [DEBUG] [LOCAL ] BOW: Loaded 22530 existing records from primary storage. [2025-10-30T17:40:24.676031] [INFO ] [MAIN ] BOW: Loaded 22530 existing records. [2025-10-30T17:40:24.877878] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:40:24.878457] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-30T17:40:24.878674] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-30T17:40:24.879208] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-30T17:40:24.879396] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-30T17:40:24.994670] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T17:40:25.309324] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-30T17:40:25.314201] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:25.406752] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T17:40:26.097494] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-30T17:40:26.770856] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-30T17:40:26.897486] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-30T17:40:27.047621] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-30T17:40:27.697464] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-30T17:40:27.909693] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T17:40:28.497466] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-30T17:40:28.733967] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T17:40:29.051025] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-30T17:40:29.297503] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-30T17:40:30.097495] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-30T17:40:30.760476] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-30T17:40:30.897490] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-30T17:40:31.613338] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T17:40:31.621770] [INFO ] [REMOTE ] BOOT: Full fetch complete (59721 records). [2025-10-30T17:40:31.621896] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-30T17:40:31.698160] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-30T17:40:32.031866] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-30T17:40:32.031972] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-30T17:40:32.032730] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-30T17:40:32.032907] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-30T17:40:32.051799] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T17:40:32.058286] [DEBUG] [LOCAL ] BOOT: Trimmed 59721 records to 39411 (keeping 200 days of data) [2025-10-30T17:40:32.292523] [DEBUG] [LOCAL ] BOOT: Primary data saved (39411 records). [2025-10-30T17:40:32.292672] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-30T17:40:32.292769] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOOT took 34.1s. Estimated remaining: 4h 16m 9s. Rate: 8.0 symbols/min [2025-10-30T17:40:32.459791] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:40:32.501459] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-30T17:40:32.503348] [DEBUG] [LOCAL ] BOX: Loaded 49974 existing records from primary storage. [2025-10-30T17:40:32.503790] [INFO ] [MAIN ] BOX: Loaded 49974 existing records. [2025-10-30T17:40:32.685508] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:40:32.685743] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-30T17:40:32.685798] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-30T17:40:32.686184] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-30T17:40:32.686222] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-30T17:40:33.056793] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:33.085098] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:40:33.297509] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-30T17:40:33.632777] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T17:40:34.097552] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-30T17:40:34.659247] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T17:40:34.897471] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-30T17:40:34.980311] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T17:40:35.697498] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-30T17:40:36.333186] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T17:40:36.497550] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-30T17:40:36.796885] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T17:40:36.804694] [INFO ] [REMOTE ] BOND: Full fetch complete (46650 records). [2025-10-30T17:40:36.804819] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-30T17:40:37.187551] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-30T17:40:37.187631] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-30T17:40:37.188284] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-30T17:40:37.188333] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-30T17:40:37.189350] [DEBUG] [LOCAL ] BOND: Trimmed 46650 records to 32479 (keeping 200 days of data) [2025-10-30T17:40:37.312473] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-30T17:40:37.406001] [DEBUG] [LOCAL ] BOND: Primary data saved (32479 records). [2025-10-30T17:40:37.406193] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-30T17:40:37.407112] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOND took 39.2s. Estimated remaining: 4h 15m 46s. Rate: 8.0 symbols/min [2025-10-30T17:40:37.600808] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:40:37.620913] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-30T17:40:37.678097] [DEBUG] [LOCAL ] BP: Loaded 53705 existing records from primary storage. [2025-10-30T17:40:37.678420] [INFO ] [MAIN ] BP: Loaded 53705 existing records. [2025-10-30T17:40:37.875528] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:40:37.875761] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-30T17:40:37.875814] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-30T17:40:37.876370] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-30T17:40:37.876428] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-30T17:40:38.104155] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-30T17:40:38.226671] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:38.850035] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T17:40:38.897460] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-30T17:40:39.299537] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T17:40:39.697545] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-30T17:40:40.089293] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T17:40:40.497476] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-30T17:40:40.574306] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T17:40:41.297485] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-30T17:40:42.097515] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-30T17:40:42.165130] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-30T17:40:42.580867] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T17:40:42.785587] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T17:40:42.897511] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-30T17:40:43.608308] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T17:40:43.697460] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-30T17:40:44.497543] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-30T17:40:44.541941] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-30T17:40:45.297517] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-30T17:40:46.021310] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-30T17:40:46.032290] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T17:40:46.097479] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-30T17:40:46.897521] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-30T17:40:47.119139] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-30T17:40:47.124974] [INFO ] [REMOTE ] BOW: Full fetch complete (32241 records). [2025-10-30T17:40:47.125101] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-30T17:40:47.494344] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-30T17:40:47.494439] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-30T17:40:47.495022] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-30T17:40:47.495124] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-30T17:40:47.496182] [DEBUG] [LOCAL ] BOW: Trimmed 32241 records to 22660 (keeping 200 days of data) [2025-10-30T17:40:47.624313] [DEBUG] [LOCAL ] BOW: Primary data saved (22660 records). [2025-10-30T17:40:47.624438] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-30T17:40:47.624515] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BOW took 23.2s. Estimated remaining: 4h 15m 56s. Rate: 8.0 symbols/min [2025-10-30T17:40:47.702690] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-30T17:40:47.799533] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:40:47.831165] [DEBUG] [LOCAL ] BR: Loaded 34227 existing records from primary storage. [2025-10-30T17:40:47.831433] [INFO ] [MAIN ] BR: Loaded 34227 existing records. [2025-10-30T17:40:48.007350] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:40:48.007571] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-30T17:40:48.007619] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-30T17:40:48.008245] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-30T17:40:48.008304] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-30T17:40:48.366594] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:40:48.396376] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T17:40:48.497474] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-30T17:40:49.017683] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T17:40:49.297504] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-30T17:40:49.580983] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T17:40:50.097464] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-30T17:40:50.793182] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T17:40:50.897474] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-30T17:40:51.386981] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T17:40:51.697574] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-30T17:40:52.497468] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-30T17:40:52.626161] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T17:40:52.892229] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-30T17:40:53.297498] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-30T17:40:53.762183] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T17:40:54.097497] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-30T17:40:54.654513] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T17:40:54.897503] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-30T17:40:55.025852] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T17:40:55.697493] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-30T17:40:56.497583] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-30T17:40:56.680951] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-30T17:40:57.102235] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T17:40:57.297601] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-30T17:40:58.097520] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-30T17:40:58.420899] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-30T17:40:58.897573] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-30T17:40:59.231626] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-30T17:40:59.243073] [INFO ] [REMOTE ] BORR: Full fetch complete (74536 records). [2025-10-30T17:40:59.243210] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-30T17:40:59.670606] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-30T17:40:59.670971] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-30T17:40:59.671951] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-30T17:40:59.688046] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-30T17:40:59.702715] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-30T17:40:59.706558] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-30T17:40:59.721306] [DEBUG] [LOCAL ] BORR: Trimmed 74536 records to 51411 (keeping 200 days of data) [2025-10-30T17:40:59.939821] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-30T17:41:00.044597] [DEBUG] [LOCAL ] BORR: Primary data saved (51411 records). [2025-10-30T17:41:00.044760] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-30T17:41:00.044880] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BORR took 38.6s. Estimated remaining: 4h 16m 19s. Rate: 8.0 symbols/min [2025-10-30T17:41:00.218499] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:00.267443] [DEBUG] [LOCAL ] BRBR: Loaded 51878 existing records from primary storage. [2025-10-30T17:41:00.267787] [INFO ] [MAIN ] BRBR: Loaded 51878 existing records. [2025-10-30T17:41:00.447451] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:41:00.447710] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-30T17:41:00.447765] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-30T17:41:00.448323] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-30T17:41:00.448380] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-30T17:41:00.503070] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-30T17:41:00.808180] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:01.297495] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-30T17:41:01.701608] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-30T17:41:01.860453] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-30T17:41:02.097533] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-30T17:41:02.531175] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:41:02.897500] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-30T17:41:03.591811] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T17:41:03.602211] [INFO ] [REMOTE ] BOX: Full fetch complete (71973 records). [2025-10-30T17:41:03.602366] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-30T17:41:03.603168] [FATAL] [VALIDATOR ] BOX: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:41:03.603268] [FATAL] [MAIN ] BOX: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:41:03.603312] [WARN ] [MAIN ] BOX: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:41:03.603349] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-30T17:41:03.603405] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-30T17:41:03.603485] [INFO ] [LOCAL ] BOX: Starting deletion of derivative data. [2025-10-30T17:41:03.603771] [DEBUG] [LOCAL ] BOX: Deleted derivative data file. [2025-10-30T17:41:03.604632] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BOX took 31.3s. Estimated remaining: 4h 15m 46s. Rate: 8.0 symbols/min [2025-10-30T17:41:03.702754] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-30T17:41:03.774678] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:03.792685] [DEBUG] [LOCAL ] BRC: Loaded 17821 existing records from primary storage. [2025-10-30T17:41:03.792913] [INFO ] [MAIN ] BRC: Loaded 17821 existing records. [2025-10-30T17:41:03.973245] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:41:03.973463] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-30T17:41:03.973510] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-30T17:41:03.973727] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-30T17:41:03.973793] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-30T17:41:04.321287] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:04.497515] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-30T17:41:04.870922] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T17:41:04.935008] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-30T17:41:05.297488] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-30T17:41:05.665367] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-30T17:41:06.097465] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-30T17:41:06.198886] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T17:41:06.897505] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-30T17:41:07.088258] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-30T17:41:07.697546] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-30T17:41:08.226121] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T17:41:08.497494] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-30T17:41:09.297508] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-30T17:41:09.639581] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T17:41:09.870968] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-30T17:41:10.098078] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-30T17:41:10.105059] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T17:41:10.897509] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-30T17:41:11.341727] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T17:41:11.697551] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-30T17:41:12.110495] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T17:41:12.497516] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-30T17:41:13.197137] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T17:41:13.297467] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-30T17:41:13.476063] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-30T17:41:13.874908] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-30T17:41:14.097544] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-30T17:41:14.897517] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-30T17:41:15.704118] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-30T17:41:15.709709] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-30T17:41:16.497514] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-30T17:41:16.792592] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T17:41:17.140921] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-30T17:41:17.153071] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-30T17:41:17.153258] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-30T17:41:17.306165] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-30T17:41:17.583229] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-30T17:41:17.583354] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-30T17:41:17.584297] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-30T17:41:17.584380] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-30T17:41:17.598638] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T17:41:17.598835] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 54095 (keeping 200 days of data) [2025-10-30T17:41:17.928733] [DEBUG] [LOCAL ] BP: Primary data saved (54095 records). [2025-10-30T17:41:17.928867] [INFO ] [MAIN ] BP: Full history saved. [2025-10-30T17:41:17.929490] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BP took 40.5s. Estimated remaining: 4h 16m 21s. Rate: 8.0 symbols/min [2025-10-30T17:41:18.110377] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-30T17:41:18.112931] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:18.151712] [DEBUG] [LOCAL ] BRCC: Loaded 40040 existing records from primary storage. [2025-10-30T17:41:18.151982] [INFO ] [MAIN ] BRCC: Loaded 40040 existing records. [2025-10-30T17:41:18.326476] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:41:18.326735] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-30T17:41:18.326788] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-30T17:41:18.327209] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-30T17:41:18.327265] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-30T17:41:18.676349] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:18.787171] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T17:41:18.859917] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-30T17:41:18.897482] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-30T17:41:19.610999] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T17:41:19.697523] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-30T17:41:20.497497] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-30T17:41:21.027938] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T17:41:21.297494] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-30T17:41:21.849166] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T17:41:21.964462] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-30T17:41:22.097496] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-30T17:41:22.807610] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:41:22.897460] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-30T17:41:23.697520] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-30T17:41:24.322316] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T17:41:24.497481] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-30T17:41:24.667829] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T17:41:25.297516] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-30T17:41:25.462216] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-30T17:41:25.466931] [INFO ] [REMOTE ] BRC: Full fetch complete (28154 records). [2025-10-30T17:41:25.467053] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-30T17:41:25.830424] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-30T17:41:25.830515] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-30T17:41:25.830996] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-30T17:41:25.831062] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-30T17:41:25.831975] [DEBUG] [LOCAL ] BRC: Trimmed 28154 records to 17976 (keeping 200 days of data) [2025-10-30T17:41:25.941949] [DEBUG] [LOCAL ] BRC: Primary data saved (17976 records). [2025-10-30T17:41:25.942089] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-30T17:41:25.942166] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BRC took 22.3s. Estimated remaining: 4h 16m 16s. Rate: 7.9 symbols/min [2025-10-30T17:41:26.108414] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-30T17:41:26.110913] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:26.111445] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-30T17:41:26.112259] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-30T17:41:26.112385] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-30T17:41:26.112429] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-30T17:41:26.112472] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-30T17:41:26.112505] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-30T17:41:26.466720] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:26.897514] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-30T17:41:27.336548] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T17:41:27.344883] [INFO ] [REMOTE ] BR: Full fetch complete (50121 records). [2025-10-30T17:41:27.345047] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-30T17:41:27.715831] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-30T17:41:27.765218] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-30T17:41:27.806183] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-30T17:41:27.806677] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-30T17:41:27.807483] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-30T17:41:27.808025] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-30T17:41:27.809447] [DEBUG] [LOCAL ] BR: Trimmed 50121 records to 34592 (keeping 200 days of data) [2025-10-30T17:41:27.974017] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:41:28.000581] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-30T17:41:28.010674] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:41:28.019631] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-30T17:41:28.024819] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:41:28.031177] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-30T17:41:28.031008] [DEBUG] [LOCAL ] BR: Primary data saved (34592 records). [2025-10-30T17:41:28.031446] [INFO ] [MAIN ] BR: Full history saved. [2025-10-30T17:41:28.031552] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-30T17:41:28.031827] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BR took 40.4s. Estimated remaining: 4h 15m 35s. Rate: 8.0 symbols/min [2025-10-30T17:41:28.031734] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-30T17:41:28.032024] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-30T17:41:28.037696] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRCE took 2.1s. Estimated remaining: 4h 14m 41s. Rate: 8.0 symbols/min [2025-10-30T17:41:28.377017] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:28.405213] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:28.405553] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-30T17:41:28.406480] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-30T17:41:28.420287] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-30T17:41:28.441576] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-30T17:41:28.447195] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-30T17:41:28.442591] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-30T17:41:28.459494] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-30T17:41:28.508001] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-30T17:41:28.765073] [DEBUG] [LOCAL ] BRO: Loaded 52110 existing records from primary storage. [2025-10-30T17:41:28.787064] [INFO ] [MAIN ] BRO: Loaded 52110 existing records. [2025-10-30T17:41:29.042843] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:29.063494] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:41:29.063718] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-30T17:41:29.063794] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-30T17:41:29.064104] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-30T17:41:29.064159] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-30T17:41:29.302756] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-30T17:41:29.417101] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:29.515588] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:41:29.515925] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-30T17:41:29.516193] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:41:29.516265] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-30T17:41:29.516344] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:41:29.516416] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-30T17:41:29.516481] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-30T17:41:29.516518] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-30T17:41:29.516556] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-30T17:41:29.516602] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BRIE took 1.5s. Estimated remaining: 4h 13m 57s. Rate: 8.0 symbols/min [2025-10-30T17:41:29.686629] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:29.709611] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T17:41:29.762957] [DEBUG] [LOCAL ] BROS: Loaded 53294 existing records from primary storage. [2025-10-30T17:41:29.763304] [INFO ] [MAIN ] BROS: Loaded 53294 existing records. [2025-10-30T17:41:29.934969] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:41:29.935162] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-30T17:41:29.935213] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-30T17:41:29.935529] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-30T17:41:29.935569] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-30T17:41:30.098491] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-30T17:41:30.286053] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:30.897482] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-30T17:41:31.651389] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:41:31.697464] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-30T17:41:32.137524] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T17:41:32.497482] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-30T17:41:33.297478] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-30T17:41:33.341605] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-30T17:41:34.102598] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-30T17:41:34.128140] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T17:41:34.142369] [INFO ] [REMOTE ] BRBR: Full fetch complete (73415 records). [2025-10-30T17:41:34.142626] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-30T17:41:34.543173] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T17:41:34.589880] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-30T17:41:34.589985] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-30T17:41:34.591015] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-30T17:41:34.591085] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-30T17:41:34.592585] [DEBUG] [LOCAL ] BRBR: Trimmed 73415 records to 52257 (keeping 200 days of data) [2025-10-30T17:41:34.898093] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-30T17:41:34.897982] [DEBUG] [LOCAL ] BRBR: Primary data saved (52257 records). [2025-10-30T17:41:34.899270] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-30T17:41:34.899379] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRBR took 34.9s. Estimated remaining: 4h 13m 36s. Rate: 8.0 symbols/min [2025-10-30T17:41:35.084781] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:35.084939] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-30T17:41:35.084976] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-30T17:41:35.085085] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-30T17:41:35.085126] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-30T17:41:35.085166] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-30T17:41:35.085198] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-30T17:41:35.435069] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:35.697511] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-30T17:41:35.742976] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-30T17:41:35.873937] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:41:35.874418] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-30T17:41:35.874523] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:41:35.874577] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-30T17:41:35.874665] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:41:35.874748] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-30T17:41:35.874826] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-30T17:41:35.874867] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-30T17:41:35.874909] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-30T17:41:35.874963] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRSL took 1.0s. Estimated remaining: 4h 12m 49s. Rate: 8.0 symbols/min [2025-10-30T17:41:36.052345] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:36.052739] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-10-30T17:41:36.052804] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-10-30T17:41:36.053361] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-30T17:41:36.053722] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-30T17:41:36.053937] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-30T17:41:36.054039] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-30T17:41:36.259227] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T17:41:36.468716] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:36.497481] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-30T17:41:37.297513] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-30T17:41:37.618076] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T17:41:38.097560] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-30T17:41:38.491608] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T17:41:38.897510] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-30T17:41:39.591754] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T17:41:39.697473] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-30T17:41:39.882309] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T17:41:40.497491] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-30T17:41:40.734263] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T17:41:41.297504] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-30T17:41:41.675705] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T17:41:42.097496] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-30T17:41:42.727680] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T17:41:42.897520] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-30T17:41:43.527522] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T17:41:43.697477] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-30T17:41:44.224212] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:41:44.497499] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-30T17:41:45.297481] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-30T17:41:45.402786] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T17:41:45.540709] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-30T17:41:46.097496] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-30T17:41:46.671406] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T17:41:46.897491] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-30T17:41:47.112192] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-30T17:41:47.697523] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-30T17:41:48.138460] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T17:41:48.497546] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-30T17:41:48.844708] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T17:41:49.297551] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-30T17:41:49.621519] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T17:41:50.097525] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-30T17:41:50.703067] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-30T17:41:50.897519] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-30T17:41:51.422005] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:41:51.697567] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-30T17:41:52.383769] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T17:41:52.497498] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-30T17:41:52.891565] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T17:41:52.901730] [INFO ] [REMOTE ] BRCC: Full fetch complete (57368 records). [2025-10-30T17:41:52.901884] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-30T17:41:53.280512] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-30T17:41:53.280617] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-30T17:41:53.281331] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-30T17:41:53.281393] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-30T17:41:53.282476] [DEBUG] [LOCAL ] BRCC: Trimmed 57368 records to 40333 (keeping 200 days of data) [2025-10-30T17:41:53.327185] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-30T17:41:53.515899] [DEBUG] [LOCAL ] BRCC: Primary data saved (40333 records). [2025-10-30T17:41:53.516331] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-30T17:41:53.517139] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRCC took 35.6s. Estimated remaining: 4h 13m 44s. Rate: 8.0 symbols/min [2025-10-30T17:41:53.713122] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T17:41:53.716424] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:53.731753] [DEBUG] [LOCAL ] BRT: Loaded 5180 existing records from primary storage. [2025-10-30T17:41:53.731966] [INFO ] [MAIN ] BRT: Loaded 5180 existing records. [2025-10-30T17:41:53.907964] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:41:53.908266] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-30T17:41:53.908318] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-30T17:41:53.908509] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-30T17:41:53.908564] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-30T17:41:54.105760] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-30T17:41:54.287004] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:54.897949] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-30T17:41:54.903744] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-30T17:41:55.096304] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T17:41:55.697497] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-30T17:41:56.455025] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T17:41:56.497453] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-30T17:41:56.975508] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-30T17:41:56.983820] [INFO ] [REMOTE ] BRSP: Full fetch complete (53846 records). [2025-10-30T17:41:56.983973] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-30T17:41:57.302629] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-30T17:41:57.376405] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-30T17:41:57.376493] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-30T17:41:57.377153] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-30T17:41:57.377217] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-30T17:41:57.378323] [DEBUG] [LOCAL ] BRSP: Trimmed 53846 records to 36160 (keeping 200 days of data) [2025-10-30T17:41:57.581941] [DEBUG] [LOCAL ] BRSP: Primary data saved (36160 records). [2025-10-30T17:41:57.582074] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-30T17:41:57.582145] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BRSP took 21.7s. Estimated remaining: 4h 13m 15s. Rate: 8.0 symbols/min [2025-10-30T17:41:57.753159] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:41:57.771865] [DEBUG] [LOCAL ] BRW: Loaded 20780 existing records from primary storage. [2025-10-30T17:41:57.772098] [INFO ] [MAIN ] BRW: Loaded 20780 existing records. [2025-10-30T17:41:57.954063] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:41:57.954358] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-30T17:41:57.954435] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-30T17:41:57.954835] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-30T17:41:57.954906] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-30T17:41:58.099541] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-30T17:41:58.287055] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-30T17:41:58.377987] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:41:58.688564] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-30T17:41:58.909926] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-30T17:41:58.918098] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-30T17:41:59.239188] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-30T17:41:59.697514] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-30T17:42:00.101958] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-30T17:42:00.497527] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-30T17:42:01.297563] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-30T17:42:02.097546] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-30T17:42:02.544017] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-30T17:42:02.897556] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-30T17:42:03.082799] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T17:42:03.344631] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-30T17:42:03.356525] [INFO ] [REMOTE ] BRO: Full fetch complete (75187 records). [2025-10-30T17:42:03.356761] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-30T17:42:03.702743] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-30T17:42:03.758374] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-30T17:42:03.758468] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-30T17:42:03.759266] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-30T17:42:03.759331] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-30T17:42:03.760767] [DEBUG] [LOCAL ] BRO: Trimmed 75187 records to 52499 (keeping 200 days of data) [2025-10-30T17:42:04.083911] [DEBUG] [LOCAL ] BRO: Primary data saved (52499 records). [2025-10-30T17:42:04.084053] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-30T17:42:04.084133] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BRO took 36.0s. Estimated remaining: 4h 13m 2s. Rate: 8.0 symbols/min [2025-10-30T17:42:04.210120] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-30T17:42:04.274285] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:04.323309] [DEBUG] [LOCAL ] BRX: Loaded 51812 existing records from primary storage. [2025-10-30T17:42:04.323706] [INFO ] [MAIN ] BRX: Loaded 51812 existing records. [2025-10-30T17:42:04.503139] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:04.503397] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-30T17:42:04.503473] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-30T17:42:04.499355] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-30T17:42:04.504468] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-30T17:42:04.504540] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-30T17:42:04.875458] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:04.930680] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-30T17:42:04.947275] [INFO ] [REMOTE ] BROS: Full fetch complete (77274 records). [2025-10-30T17:42:04.947486] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-30T17:42:05.298083] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-30T17:42:05.376022] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T17:42:05.400808] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-30T17:42:05.401705] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-30T17:42:05.402599] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-30T17:42:05.402670] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-30T17:42:05.404091] [DEBUG] [LOCAL ] BROS: Trimmed 77274 records to 53684 (keeping 200 days of data) [2025-10-30T17:42:05.714090] [DEBUG] [LOCAL ] BROS: Primary data saved (53684 records). [2025-10-30T17:42:05.714232] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-30T17:42:05.715010] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BROS took 36.2s. Estimated remaining: 4h 12m 19s. Rate: 8.0 symbols/min [2025-10-30T17:42:05.882392] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:05.915678] [DEBUG] [LOCAL ] BSAC: Loaded 32220 existing records from primary storage. [2025-10-30T17:42:05.915962] [INFO ] [MAIN ] BSAC: Loaded 32220 existing records. [2025-10-30T17:42:06.105746] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-30T17:42:06.114085] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:06.114459] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-30T17:42:06.114514] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-30T17:42:06.114738] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-30T17:42:06.114796] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-30T17:42:06.479016] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:06.554886] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T17:42:06.820026] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-30T17:42:06.897498] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-30T17:42:07.672369] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-30T17:42:07.697462] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-30T17:42:08.497475] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-30T17:42:08.565990] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T17:42:08.974523] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-30T17:42:09.297530] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-30T17:42:09.704564] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T17:42:10.097500] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-30T17:42:10.696234] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T17:42:10.897498] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-30T17:42:11.697470] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-30T17:42:11.860997] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-30T17:42:12.451993] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-30T17:42:12.497453] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-30T17:42:13.217874] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-30T17:42:13.297475] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-30T17:42:14.097539] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-30T17:42:14.379925] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T17:42:14.897571] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-30T17:42:15.331822] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:42:15.636227] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-30T17:42:15.697468] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-30T17:42:16.497494] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-30T17:42:16.762844] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-30T17:42:17.297503] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-30T17:42:17.907501] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T17:42:17.952577] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-30T17:42:18.097492] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-30T17:42:18.897497] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-30T17:42:19.241382] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T17:42:19.557099] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T17:42:19.697507] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-30T17:42:20.171041] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-30T17:42:20.497498] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-30T17:42:20.894258] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T17:42:21.297497] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-30T17:42:21.902058] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-30T17:42:21.904325] [INFO ] [REMOTE ] BRT: Full fetch complete (7124 records). [2025-10-30T17:42:21.904397] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-30T17:42:22.099804] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-30T17:42:22.327167] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-30T17:42:22.327244] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-30T17:42:22.327445] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-30T17:42:22.327485] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-30T17:42:22.327892] [DEBUG] [LOCAL ] BRT: Trimmed 7124 records to 5235 (keeping 200 days of data) [2025-10-30T17:42:22.361846] [DEBUG] [LOCAL ] BRT: Primary data saved (5235 records). [2025-10-30T17:42:22.361985] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-30T17:42:22.362112] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BRT took 28.8s. Estimated remaining: 4h 13m 7s. Rate: 8.0 symbols/min [2025-10-30T17:42:22.568753] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:22.600673] [DEBUG] [LOCAL ] BSBR: Loaded 35555 existing records from primary storage. [2025-10-30T17:42:22.600957] [INFO ] [MAIN ] BSBR: Loaded 35555 existing records. [2025-10-30T17:42:22.782015] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:22.782233] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-30T17:42:22.782280] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-30T17:42:22.782591] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-30T17:42:22.782631] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-30T17:42:22.902586] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-30T17:42:23.165830] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:23.633428] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T17:42:23.697468] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-30T17:42:23.992731] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T17:42:24.497503] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-30T17:42:25.297469] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-30T17:42:25.370529] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-30T17:42:25.698479] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:42:26.097501] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-30T17:42:26.182297] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-30T17:42:26.188021] [INFO ] [REMOTE ] BRW: Full fetch complete (29999 records). [2025-10-30T17:42:26.188157] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-30T17:42:26.554709] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-30T17:42:26.554789] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-30T17:42:26.555206] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-30T17:42:26.555246] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-30T17:42:26.555935] [DEBUG] [LOCAL ] BRW: Trimmed 29999 records to 20994 (keeping 200 days of data) [2025-10-30T17:42:26.674131] [DEBUG] [LOCAL ] BRW: Primary data saved (20994 records). [2025-10-30T17:42:26.674248] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-30T17:42:26.674322] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRW took 29.1s. Estimated remaining: 4h 12m 40s. Rate: 8.0 symbols/min [2025-10-30T17:42:26.857613] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:26.866905] [DEBUG] [LOCAL ] BSL: Loaded 8001 existing records from primary storage. [2025-10-30T17:42:26.867109] [INFO ] [MAIN ] BSL: Loaded 8001 existing records. [2025-10-30T17:42:26.898335] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-30T17:42:27.060631] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:27.061179] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-30T17:42:27.061234] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-30T17:42:27.061453] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-30T17:42:27.061524] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-30T17:42:27.155948] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T17:42:27.484590] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:27.697610] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-30T17:42:28.362163] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-30T17:42:28.497508] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-30T17:42:28.694631] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:42:29.297499] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-30T17:42:29.490725] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T17:42:29.824808] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T17:42:30.097482] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-30T17:42:30.897541] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-30T17:42:31.477068] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-30T17:42:31.554484] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T17:42:31.697489] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-30T17:42:32.190346] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T17:42:32.497544] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-30T17:42:33.297490] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-30T17:42:33.673728] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T17:42:33.693538] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-30T17:42:34.097582] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-30T17:42:34.897746] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-30T17:42:34.967506] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T17:42:35.697506] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-30T17:42:35.992320] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T17:42:36.234071] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-30T17:42:36.497552] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-30T17:42:37.297506] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-30T17:42:37.630301] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T17:42:37.752632] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-30T17:42:38.097484] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-30T17:42:38.593955] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-30T17:42:38.897475] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-30T17:42:39.341192] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-30T17:42:39.697528] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-30T17:42:40.244166] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T17:42:40.497510] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-30T17:42:41.297539] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-30T17:42:41.472710] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T17:42:42.004860] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T17:42:42.007854] [INFO ] [REMOTE ] BSL: Full fetch complete (13050 records). [2025-10-30T17:42:42.007974] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-30T17:42:42.102566] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-30T17:42:42.379229] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-30T17:42:42.379310] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-30T17:42:42.379603] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-30T17:42:42.379664] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-30T17:42:42.380158] [DEBUG] [LOCAL ] BSL: Trimmed 13050 records to 8036 (keeping 200 days of data) [2025-10-30T17:42:42.430671] [DEBUG] [LOCAL ] BSL: Primary data saved (8036 records). [2025-10-30T17:42:42.430820] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-30T17:42:42.430901] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BSL took 15.8s. Estimated remaining: 4h 13m 22s. Rate: 8.0 symbols/min [2025-10-30T17:42:42.621931] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:42.651063] [DEBUG] [LOCAL ] BSM: Loaded 31732 existing records from primary storage. [2025-10-30T17:42:42.651341] [INFO ] [MAIN ] BSM: Loaded 31732 existing records. [2025-10-30T17:42:42.825017] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:42.825208] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-30T17:42:42.825253] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-30T17:42:42.825494] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-30T17:42:42.825549] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-30T17:42:42.902624] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-30T17:42:43.206004] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:43.208246] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T17:42:43.697539] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-30T17:42:44.467070] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-30T17:42:44.497497] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-30T17:42:44.800400] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T17:42:44.807468] [INFO ] [REMOTE ] BSAC: Full fetch complete (45668 records). [2025-10-30T17:42:44.807621] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-30T17:42:45.195077] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-30T17:42:45.195156] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-30T17:42:45.195762] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-30T17:42:45.195825] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-30T17:42:45.197335] [DEBUG] [LOCAL ] BSAC: Trimmed 45668 records to 32463 (keeping 200 days of data) [2025-10-30T17:42:45.312697] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-30T17:42:45.401130] [DEBUG] [LOCAL ] BSAC: Primary data saved (32463 records). [2025-10-30T17:42:45.401260] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-30T17:42:45.401365] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BSAC took 39.7s. Estimated remaining: 4h 12m 48s. Rate: 8.0 symbols/min [2025-10-30T17:42:45.567166] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:45.584228] [DEBUG] [LOCAL ] BST: Loaded 17904 existing records from primary storage. [2025-10-30T17:42:45.584500] [INFO ] [MAIN ] BST: Loaded 17904 existing records. [2025-10-30T17:42:45.759572] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:45.759914] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-30T17:42:45.759967] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-30T17:42:45.760427] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-30T17:42:45.760486] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-30T17:42:46.104517] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-30T17:42:46.126530] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:46.448491] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T17:42:46.897577] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-30T17:42:47.036929] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-30T17:42:47.300412] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (2.80 seconds). [2025-10-30T17:42:47.312393] [INFO ] [REMOTE ] BRX: Full fetch complete (75186 records). [2025-10-30T17:42:47.312566] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-30T17:42:47.702752] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-30T17:42:47.703688] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-30T17:42:47.703764] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-30T17:42:47.705236] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-30T17:42:47.705394] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-30T17:42:47.706983] [DEBUG] [LOCAL ] BRX: Trimmed 75186 records to 52199 (keeping 200 days of data) [2025-10-30T17:42:48.027305] [DEBUG] [LOCAL ] BRX: Primary data saved (52199 records). [2025-10-30T17:42:48.027606] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-30T17:42:48.027787] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BRX took 43.9s. Estimated remaining: 4h 12m 11s. Rate: 8.0 symbols/min [2025-10-30T17:42:48.091918] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T17:42:48.220777] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:48.242567] [DEBUG] [LOCAL ] BSTZ: Loaded 24123 existing records from primary storage. [2025-10-30T17:42:48.242853] [INFO ] [MAIN ] BSTZ: Loaded 24123 existing records. [2025-10-30T17:42:48.416415] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:48.416685] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-30T17:42:48.416748] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-30T17:42:48.417000] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-30T17:42:48.417055] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-30T17:42:48.506214] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-30T17:42:48.783638] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:48.803773] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T17:42:49.297574] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-30T17:42:49.381082] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T17:42:50.097557] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-30T17:42:50.195028] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-30T17:42:50.897493] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-30T17:42:51.230616] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T17:42:51.697505] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-30T17:42:51.770055] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T17:42:52.497535] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-30T17:42:52.744895] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T17:42:53.297569] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-30T17:42:53.548789] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-30T17:42:54.097557] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-30T17:42:54.206257] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T17:42:54.897550] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-30T17:42:55.418315] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-30T17:42:55.697540] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-30T17:42:56.133829] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T17:42:56.143188] [INFO ] [REMOTE ] BSBR: Full fetch complete (50845 records). [2025-10-30T17:42:56.143392] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-30T17:42:56.501607] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-30T17:42:56.588377] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-30T17:42:56.588595] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-30T17:42:56.589581] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-30T17:42:56.589695] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-30T17:42:56.591303] [DEBUG] [LOCAL ] BSBR: Trimmed 50845 records to 35785 (keeping 200 days of data) [2025-10-30T17:42:56.612824] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T17:42:56.852097] [DEBUG] [LOCAL ] BSBR: Primary data saved (35785 records). [2025-10-30T17:42:56.852260] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-30T17:42:56.852364] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSBR took 34.5s. Estimated remaining: 4h 12m 12s. Rate: 8.0 symbols/min [2025-10-30T17:42:57.060943] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:42:57.111971] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-30T17:42:57.112402] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-30T17:42:57.318010] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:42:57.311203] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T17:42:57.318112] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-30T17:42:57.318514] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-30T17:42:57.318823] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-30T17:42:57.325157] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-30T17:42:57.325231] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-30T17:42:57.680984] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:42:58.097493] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-30T17:42:58.259456] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T17:42:58.897515] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-30T17:42:59.543784] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T17:42:59.697527] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-30T17:42:59.776788] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T17:43:00.497573] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-30T17:43:01.297493] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-30T17:43:02.023734] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-30T17:43:02.061525] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-30T17:43:02.097480] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-30T17:43:02.897592] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-30T17:43:03.434283] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-30T17:43:03.697537] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-30T17:43:03.830736] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-30T17:43:04.247788] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-30T17:43:04.497496] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-30T17:43:04.858384] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T17:43:05.147073] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T17:43:05.297577] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-30T17:43:06.097465] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-30T17:43:06.501005] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T17:43:06.897468] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-30T17:43:07.168985] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-30T17:43:07.604035] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:43:07.697480] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-30T17:43:08.497499] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-30T17:43:08.713865] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-30T17:43:08.720825] [INFO ] [REMOTE ] BSM: Full fetch complete (46411 records). [2025-10-30T17:43:08.720974] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-30T17:43:09.109063] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-30T17:43:09.109292] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-30T17:43:09.110236] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-30T17:43:09.110306] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-30T17:43:09.111680] [DEBUG] [LOCAL ] BSM: Trimmed 46411 records to 31939 (keeping 200 days of data) [2025-10-30T17:43:09.302181] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-30T17:43:09.327306] [DEBUG] [LOCAL ] BSM: Primary data saved (31939 records). [2025-10-30T17:43:09.328056] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-30T17:43:09.328176] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BSM took 26.9s. Estimated remaining: 4h 12m 34s. Rate: 8.0 symbols/min [2025-10-30T17:43:09.469963] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:43:09.530746] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:09.539056] [DEBUG] [LOCAL ] BTA: Loaded 5582 existing records from primary storage. [2025-10-30T17:43:09.539302] [INFO ] [MAIN ] BTA: Loaded 5582 existing records. [2025-10-30T17:43:09.724130] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:43:09.724343] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-30T17:43:09.724412] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-30T17:43:09.724586] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-30T17:43:09.724626] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-30T17:43:10.075098] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:43:10.097479] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-30T17:43:10.326822] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-30T17:43:10.330842] [INFO ] [REMOTE ] BST: Full fetch complete (28183 records). [2025-10-30T17:43:10.330940] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-30T17:43:10.685579] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-30T17:43:10.685679] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-30T17:43:10.686096] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-30T17:43:10.686137] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-30T17:43:10.686821] [DEBUG] [LOCAL ] BST: Trimmed 28183 records to 18060 (keeping 200 days of data) [2025-10-30T17:43:10.793822] [DEBUG] [LOCAL ] BST: Primary data saved (18060 records). [2025-10-30T17:43:10.793961] [INFO ] [MAIN ] BST: Full history saved. [2025-10-30T17:43:10.794037] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BST took 25.4s. Estimated remaining: 4h 11m 51s. Rate: 8.0 symbols/min [2025-10-30T17:43:10.902695] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-30T17:43:10.966853] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:11.019402] [DEBUG] [LOCAL ] BTE: Loaded 52664 existing records from primary storage. [2025-10-30T17:43:11.019756] [INFO ] [MAIN ] BTE: Loaded 52664 existing records. [2025-10-30T17:43:11.191449] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:43:11.191679] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-30T17:43:11.191738] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-30T17:43:11.192091] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-30T17:43:11.192148] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-30T17:43:11.545563] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:43:11.630769] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T17:43:11.697511] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-30T17:43:11.790166] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T17:43:12.262905] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-30T17:43:12.497523] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-30T17:43:13.297467] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-30T17:43:13.403939] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T17:43:14.097494] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-30T17:43:14.818952] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-30T17:43:14.897495] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-30T17:43:15.445725] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T17:43:15.697730] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-30T17:43:16.112336] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T17:43:16.497496] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-30T17:43:16.919312] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T17:43:17.297485] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-30T17:43:17.827888] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T17:43:18.097466] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-30T17:43:18.128929] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-30T17:43:18.569775] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T17:43:18.897496] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-30T17:43:19.697490] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-30T17:43:20.069017] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T17:43:20.497495] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-30T17:43:21.297479] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-30T17:43:21.651082] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-30T17:43:21.747940] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T17:43:21.749625] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-30T17:43:22.097506] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-30T17:43:22.704333] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-30T17:43:22.897542] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-30T17:43:23.697522] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-30T17:43:23.734201] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-30T17:43:24.229265] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-30T17:43:24.497527] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-30T17:43:24.934955] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-30T17:43:25.297502] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-30T17:43:26.097518] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-30T17:43:26.897475] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-30T17:43:26.958623] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-30T17:43:27.151603] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T17:43:27.157229] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36024 records). [2025-10-30T17:43:27.157338] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-30T17:43:27.525001] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-30T17:43:27.525079] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-30T17:43:27.525562] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-30T17:43:27.525623] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-30T17:43:27.526470] [DEBUG] [LOCAL ] BSTZ: Trimmed 36024 records to 24281 (keeping 200 days of data) [2025-10-30T17:43:27.669185] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24281 records). [2025-10-30T17:43:27.669311] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-30T17:43:27.669387] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BSTZ took 39.6s. Estimated remaining: 4h 12m 38s. Rate: 8.0 symbols/min [2025-10-30T17:43:27.701723] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-30T17:43:27.839249] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:27.884977] [DEBUG] [LOCAL ] BTI: Loaded 53583 existing records from primary storage. [2025-10-30T17:43:27.885284] [INFO ] [MAIN ] BTI: Loaded 53583 existing records. [2025-10-30T17:43:28.070586] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:43:28.070930] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-30T17:43:28.070988] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-30T17:43:28.071461] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-30T17:43:28.071502] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-30T17:43:28.465514] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:43:28.480515] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T17:43:28.497456] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-30T17:43:28.897184] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-30T17:43:29.266012] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-30T17:43:29.297495] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-30T17:43:29.717083] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-30T17:43:30.097496] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-30T17:43:30.897501] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-30T17:43:31.395556] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T17:43:31.697471] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-30T17:43:31.871155] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-30T17:43:31.882957] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-30T17:43:31.883080] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-30T17:43:32.281547] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-30T17:43:32.281666] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-30T17:43:32.282549] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-30T17:43:32.282613] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-30T17:43:32.284031] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 54078 (keeping 200 days of data) [2025-10-30T17:43:32.503761] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-30T17:43:32.606047] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-30T17:43:32.606175] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-30T17:43:32.606765] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BSX took 35.8s. Estimated remaining: 4h 12m 16s. Rate: 8.0 symbols/min [2025-10-30T17:43:32.773437] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:32.783700] [DEBUG] [LOCAL ] BTO: Loaded 8607 existing records from primary storage. [2025-10-30T17:43:32.783914] [INFO ] [MAIN ] BTO: Loaded 8607 existing records. [2025-10-30T17:43:32.964887] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:43:32.965158] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-30T17:43:32.965212] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-30T17:43:32.965412] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-30T17:43:32.965468] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-30T17:43:33.303749] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-30T17:43:33.331668] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:43:33.367677] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-30T17:43:33.683182] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:43:33.955348] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T17:43:33.957235] [INFO ] [REMOTE ] BTA: Full fetch complete (8854 records). [2025-10-30T17:43:33.957302] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-30T17:43:34.107557] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-30T17:43:34.321767] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-30T17:43:34.321838] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-30T17:43:34.322050] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-30T17:43:34.322087] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-30T17:43:34.322474] [DEBUG] [LOCAL ] BTA: Trimmed 8854 records to 5613 (keeping 200 days of data) [2025-10-30T17:43:34.354723] [DEBUG] [LOCAL ] BTA: Primary data saved (5613 records). [2025-10-30T17:43:34.354802] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-30T17:43:34.354870] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BTA took 25.0s. Estimated remaining: 4h 11m 35s. Rate: 8.0 symbols/min [2025-10-30T17:43:34.522514] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:34.538895] [DEBUG] [LOCAL ] BTT: Loaded 14930 existing records from primary storage. [2025-10-30T17:43:34.539114] [INFO ] [MAIN ] BTT: Loaded 14930 existing records. [2025-10-30T17:43:34.716517] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:43:34.716743] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-30T17:43:34.716806] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-30T17:43:34.717017] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-30T17:43:34.717054] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-30T17:43:34.898800] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-30T17:43:34.899189] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T17:43:35.111903] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:43:35.697563] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-30T17:43:36.199486] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T17:43:36.260176] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T17:43:36.497532] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-30T17:43:37.094356] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T17:43:37.297488] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-30T17:43:38.097515] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-30T17:43:38.816027] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-30T17:43:38.897517] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-30T17:43:39.258109] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-30T17:43:39.290829] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-30T17:43:39.697502] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-30T17:43:40.173841] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T17:43:40.497519] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-30T17:43:40.943996] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-30T17:43:41.297518] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-30T17:43:42.097581] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-30T17:43:42.897528] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-30T17:43:43.279110] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-30T17:43:43.525871] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T17:43:43.656471] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T17:43:43.697541] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-30T17:43:44.497593] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-30T17:43:45.070098] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-30T17:43:45.297550] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-30T17:43:45.506597] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-30T17:43:45.694349] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T17:43:46.097584] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-30T17:43:46.792743] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T17:43:46.897526] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-30T17:43:47.698548] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T17:43:47.698679] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-30T17:43:48.206164] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T17:43:48.497484] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-30T17:43:49.269924] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-30T17:43:49.297482] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-30T17:43:49.869032] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-30T17:43:50.097590] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-30T17:43:50.698121] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-30T17:43:50.897533] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-30T17:43:51.697591] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-30T17:43:52.419355] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-30T17:43:52.484393] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-30T17:43:52.497666] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-30T17:43:53.297507] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-30T17:43:53.778026] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T17:43:53.888834] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-30T17:43:54.097574] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-30T17:43:54.897533] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-30T17:43:55.697532] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-30T17:43:56.117250] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-30T17:43:56.130425] [INFO ] [REMOTE ] BTE: Full fetch complete (76346 records). [2025-10-30T17:43:56.130720] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-30T17:43:56.501707] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-30T17:43:56.600423] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-30T17:43:56.632995] [INFO ] [REMOTE ] BTO: Full fetch complete (13252 records). [2025-10-30T17:43:56.633134] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-30T17:43:56.633579] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-30T17:43:56.665865] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-30T17:43:56.672131] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-30T17:43:56.679019] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-30T17:43:56.813779] [DEBUG] [LOCAL ] BTE: Trimmed 76346 records to 53042 (keeping 200 days of data) [2025-10-30T17:43:56.815486] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-30T17:43:57.305218] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-30T17:43:57.304229] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-30T17:43:57.308796] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-30T17:43:57.313948] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-30T17:43:57.314624] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-30T17:43:57.328678] [DEBUG] [LOCAL ] BTO: Trimmed 13252 records to 8649 (keeping 200 days of data) [2025-10-30T17:43:57.392679] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T17:43:57.446154] [INFO ] [REMOTE ] BTT: Full fetch complete (22450 records). [2025-10-30T17:43:57.489241] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-30T17:43:57.488626] [DEBUG] [LOCAL ] BTE: Primary data saved (53042 records). [2025-10-30T17:43:57.494325] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-30T17:43:57.494461] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BTE took 46.7s. Estimated remaining: 4h 12m 58s. Rate: 8.0 symbols/min [2025-10-30T17:43:57.610190] [DEBUG] [LOCAL ] BTO: Primary data saved (8649 records). [2025-10-30T17:43:57.664393] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-30T17:43:57.674803] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BTO took 25.1s. Estimated remaining: 4h 12m 8s. Rate: 8.0 symbols/min [2025-10-30T17:43:58.015230] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:58.104637] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:58.131037] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-30T17:43:58.150315] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-30T17:43:58.154223] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-30T17:43:58.154637] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-30T17:43:58.170605] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-30T17:43:58.196087] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-30T17:43:58.291326] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-30T17:43:58.324086] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-30T17:43:58.329729] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-30T17:43:58.348868] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-30T17:43:58.384349] [DEBUG] [LOCAL ] BTT: Trimmed 22450 records to 15016 (keeping 200 days of data) [2025-10-30T17:43:58.578780] [DEBUG] [LOCAL ] BTU: Loaded 53317 existing records from primary storage. [2025-10-30T17:43:58.602223] [INFO ] [MAIN ] BTU: Loaded 53317 existing records. [2025-10-30T17:43:58.696951] [DEBUG] [LOCAL ] BTT: Primary data saved (15016 records). [2025-10-30T17:43:58.708399] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-30T17:43:58.734466] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTT took 24.4s. Estimated remaining: 4h 11m 24s. Rate: 8.0 symbols/min [2025-10-30T17:43:58.873342] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:43:58.888374] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-30T17:43:59.040116] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:43:59.043717] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-30T17:43:59.043941] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-30T17:43:59.054924] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-30T17:43:59.065360] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-30T17:43:59.123538] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:43:59.177068] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:59.188196] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-30T17:43:59.188631] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:43:59.194534] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-30T17:43:59.210370] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:43:59.220042] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-30T17:43:59.220217] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-30T17:43:59.220351] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-30T17:43:59.226310] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-30T17:43:59.242212] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTX took 1.6s. Estimated remaining: 4h 10m 36s. Rate: 8.0 symbols/min [2025-10-30T17:43:59.484918] [DEBUG] [LOCAL ] BTZ: Loaded 21816 existing records from primary storage. [2025-10-30T17:43:59.530980] [INFO ] [MAIN ] BTZ: Loaded 21816 existing records. [2025-10-30T17:43:59.629697] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-30T17:43:59.796540] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-30T17:43:59.784967] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:43:59.810744] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-30T17:43:59.838998] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:43:59.940937] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:43:59.941260] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-30T17:43:59.941317] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-30T17:43:59.941679] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-30T17:43:59.941740] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-30T17:44:00.149050] [DEBUG] [LOCAL ] BUD: Loaded 52576 existing records from primary storage. [2025-10-30T17:44:00.224635] [INFO ] [MAIN ] BUD: Loaded 52576 existing records. [2025-10-30T17:44:00.494468] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:44:00.511121] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-30T17:44:00.531844] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:44:00.532990] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-30T17:44:00.533042] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-30T17:44:00.533455] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-30T17:44:00.533496] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-30T17:44:00.911372] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:44:01.297503] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-30T17:44:01.751161] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-30T17:44:01.797543] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-30T17:44:02.103969] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-30T17:44:02.110349] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-30T17:44:02.696926] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T17:44:02.897545] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-30T17:44:03.353342] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T17:44:03.697516] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-30T17:44:03.723828] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T17:44:04.497538] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-30T17:44:05.039731] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:44:05.231877] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-30T17:44:05.297498] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-30T17:44:06.097519] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-30T17:44:06.163820] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T17:44:06.897540] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-30T17:44:07.596291] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T17:44:07.697558] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-30T17:44:08.507615] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-30T17:44:08.513033] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-30T17:44:09.168141] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T17:44:09.297487] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-30T17:44:10.097525] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-30T17:44:10.194002] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-30T17:44:10.736334] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T17:44:10.881532] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-30T17:44:10.897477] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-30T17:44:11.524944] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T17:44:11.697497] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-30T17:44:12.497506] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-30T17:44:12.995038] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T17:44:13.282505] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-30T17:44:13.297459] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-30T17:44:13.979290] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T17:44:14.097506] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-30T17:44:14.897498] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-30T17:44:15.373286] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:44:15.697476] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-30T17:44:16.300570] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T17:44:16.417925] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T17:44:16.497454] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-30T17:44:17.297496] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-30T17:44:17.385369] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T17:44:17.390765] [INFO ] [REMOTE ] BTZ: Full fetch complete (33046 records). [2025-10-30T17:44:17.390849] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-30T17:44:17.391514] [FATAL] [VALIDATOR ] BTZ: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:44:17.391596] [FATAL] [MAIN ] BTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:44:17.391638] [WARN ] [MAIN ] BTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:44:17.391741] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-30T17:44:17.391836] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-10-30T17:44:17.391885] [INFO ] [LOCAL ] BTZ: Starting deletion of derivative data. [2025-10-30T17:44:17.392101] [DEBUG] [LOCAL ] BTZ: Deleted derivative data file. [2025-10-30T17:44:17.392202] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BTZ took 18.6s. Estimated remaining: 4h 11m 29s. Rate: 8.0 symbols/min [2025-10-30T17:44:17.561575] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:44:17.574522] [DEBUG] [LOCAL ] BUI: Loaded 11528 existing records from primary storage. [2025-10-30T17:44:17.574756] [INFO ] [MAIN ] BUI: Loaded 11528 existing records. [2025-10-30T17:44:17.748146] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:44:17.748349] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-30T17:44:17.748396] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-30T17:44:17.748567] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-30T17:44:17.748603] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-30T17:44:18.103462] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-30T17:44:18.108304] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:44:18.615523] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T17:44:18.897523] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-30T17:44:19.697508] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-30T17:44:20.125605] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-30T17:44:20.138093] [INFO ] [REMOTE ] BTI: Full fetch complete (77660 records). [2025-10-30T17:44:20.138244] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-30T17:44:20.461280] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T17:44:20.512060] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-30T17:44:20.550969] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-30T17:44:20.551164] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-30T17:44:20.552075] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-30T17:44:20.552157] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-30T17:44:20.553626] [DEBUG] [LOCAL ] BTI: Trimmed 77660 records to 53973 (keeping 200 days of data) [2025-10-30T17:44:20.680764] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-30T17:44:20.923290] [DEBUG] [LOCAL ] BTI: Primary data saved (53973 records). [2025-10-30T17:44:20.923436] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-30T17:44:20.923566] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTI took 53.3s. Estimated remaining: 4h 10m 60s. Rate: 8.0 symbols/min [2025-10-30T17:44:21.102877] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:44:21.104410] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-30T17:44:21.147361] [DEBUG] [LOCAL ] BUR: Loaded 45471 existing records from primary storage. [2025-10-30T17:44:21.147676] [INFO ] [MAIN ] BUR: Loaded 45471 existing records. [2025-10-30T17:44:21.302891] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-30T17:44:21.323406] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:44:21.323951] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-30T17:44:21.324024] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-30T17:44:21.324419] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-30T17:44:21.324461] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-30T17:44:21.689333] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:44:21.910881] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-30T17:44:22.097482] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-30T17:44:22.642411] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T17:44:22.897496] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-30T17:44:23.697488] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-30T17:44:24.333818] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T17:44:24.497489] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-30T17:44:24.994628] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T17:44:25.297488] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-30T17:44:25.674750] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T17:44:25.690181] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-30T17:44:26.097556] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-30T17:44:26.897498] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-30T17:44:27.226230] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T17:44:27.356596] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-30T17:44:27.697603] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-30T17:44:28.497562] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-30T17:44:29.124431] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T17:44:29.297501] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-30T17:44:29.396952] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T17:44:29.408865] [INFO ] [REMOTE ] BTU: Full fetch complete (77309 records). [2025-10-30T17:44:29.409027] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-30T17:44:29.852445] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-30T17:44:29.852524] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-30T17:44:29.853310] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-30T17:44:29.853372] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-30T17:44:29.854829] [DEBUG] [LOCAL ] BTU: Trimmed 77309 records to 53707 (keeping 200 days of data) [2025-10-30T17:44:30.129254] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-30T17:44:30.178735] [DEBUG] [LOCAL ] BTU: Primary data saved (53707 records). [2025-10-30T17:44:30.178881] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-30T17:44:30.179740] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BTU took 32.7s. Estimated remaining: 4h 11m 2s. Rate: 8.0 symbols/min [2025-10-30T17:44:30.354126] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:44:30.398727] [DEBUG] [LOCAL ] BURL: Loaded 45002 existing records from primary storage. [2025-10-30T17:44:30.399101] [INFO ] [MAIN ] BURL: Loaded 45002 existing records. [2025-10-30T17:44:30.594728] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:44:30.595025] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-30T17:44:30.595189] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-30T17:44:30.595759] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-30T17:44:30.595927] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-30T17:44:30.722906] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T17:44:30.903738] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-30T17:44:30.994468] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:44:31.540204] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T17:44:31.697498] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-30T17:44:32.066032] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T17:44:32.497502] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-30T17:44:32.894405] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T17:44:33.297577] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-30T17:44:33.867008] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-30T17:44:34.097566] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-30T17:44:34.413420] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T17:44:34.752606] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-30T17:44:34.897490] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-30T17:44:35.464163] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-30T17:44:35.697550] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-30T17:44:36.497490] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-30T17:44:36.988349] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T17:44:37.297531] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-30T17:44:37.618749] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T17:44:38.097613] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-30T17:44:38.769767] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T17:44:38.897583] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-30T17:44:39.303997] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T17:44:39.697549] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-30T17:44:40.224157] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T17:44:40.350224] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T17:44:40.353416] [INFO ] [REMOTE ] BUI: Full fetch complete (16438 records). [2025-10-30T17:44:40.353496] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-30T17:44:40.507437] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-30T17:44:40.767946] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-30T17:44:40.768023] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-30T17:44:40.768335] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-30T17:44:40.768374] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-30T17:44:40.768911] [DEBUG] [LOCAL ] BUI: Trimmed 16438 records to 11597 (keeping 200 days of data) [2025-10-30T17:44:40.838467] [DEBUG] [LOCAL ] BUI: Primary data saved (11597 records). [2025-10-30T17:44:40.838589] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-30T17:44:40.838688] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BUI took 23.4s. Estimated remaining: 4h 11m 12s. Rate: 8.0 symbols/min [2025-10-30T17:44:41.297576] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-30T17:44:41.821534] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T17:44:42.097523] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-30T17:44:42.668208] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T17:44:42.897474] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-30T17:44:43.697494] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-30T17:44:43.797453] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T17:44:43.808950] [INFO ] [REMOTE ] BUD: Full fetch complete (76489 records). [2025-10-30T17:44:43.809067] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-30T17:44:44.206364] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-30T17:44:44.206571] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-30T17:44:44.207473] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-30T17:44:44.207536] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-30T17:44:44.208935] [DEBUG] [LOCAL ] BUD: Trimmed 76489 records to 52966 (keeping 200 days of data) [2025-10-30T17:44:44.345256] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-30T17:44:44.515020] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-30T17:44:44.563981] [DEBUG] [LOCAL ] BUD: Primary data saved (52966 records). [2025-10-30T17:44:44.564109] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-30T17:44:44.564189] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BUD took 45.3s. Estimated remaining: 4h 10m 44s. Rate: 8.0 symbols/min [2025-10-30T17:44:45.622788] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T17:44:45.633153] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-30T17:44:46.879307] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T17:44:46.890158] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-30T17:44:48.009726] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:44:48.019280] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-30T17:44:49.396004] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T17:44:49.409080] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-30T17:44:50.869426] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T17:44:50.880225] [INFO ] [REMOTE ] BURL: Full fetch complete (65643 records). [2025-10-30T17:44:50.880459] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-30T17:44:51.283259] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-30T17:44:51.283343] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-30T17:44:51.284081] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-30T17:44:51.284144] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-30T17:44:51.285427] [DEBUG] [LOCAL ] BURL: Trimmed 65643 records to 45323 (keeping 200 days of data) [2025-10-30T17:44:51.601003] [DEBUG] [LOCAL ] BURL: Primary data saved (45323 records). [2025-10-30T17:44:51.601148] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-30T17:44:51.601835] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BURL took 21.4s. Estimated remaining: 4h 10m 34s. Rate: 8.0 symbols/min [2025-10-30T17:45:11.435164] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (27.74 seconds). [2025-10-30T17:45:11.445546] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-30T17:45:13.054526] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T17:45:13.065118] [INFO ] [REMOTE ] BUR: Full fetch complete (64928 records). [2025-10-30T17:45:13.065249] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-30T17:45:13.448312] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-30T17:45:13.448393] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-30T17:45:13.449104] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-30T17:45:13.449168] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-30T17:45:13.450448] [DEBUG] [LOCAL ] BUR: Trimmed 64928 records to 45854 (keeping 200 days of data) [2025-10-30T17:45:13.732960] [DEBUG] [LOCAL ] BUR: Primary data saved (45854 records). [2025-10-30T17:45:13.733087] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-30T17:45:13.734113] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BUR took 52.8s. Estimated remaining: 4h 11m 48s. Rate: 8.0 symbols/min [2025-10-30T17:45:14.410244] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:14.461714] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:14.482220] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:14.486229] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-30T17:45:14.485711] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:14.486902] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-30T17:45:14.487262] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-30T17:45:14.487308] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-30T17:45:14.487351] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-30T17:45:14.487446] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-30T17:45:14.830980] [DEBUG] [LOCAL ] BV: Loaded 38296 existing records from primary storage. [2025-10-30T17:45:14.831861] [DEBUG] [LOCAL ] BW: Loaded 40402 existing records from primary storage. [2025-10-30T17:45:14.837965] [DEBUG] [LOCAL ] BVN: Loaded 44527 existing records from primary storage. [2025-10-30T17:45:14.846519] [INFO ] [MAIN ] BV: Loaded 38296 existing records. [2025-10-30T17:45:14.855182] [INFO ] [MAIN ] BW: Loaded 40402 existing records. [2025-10-30T17:45:14.861725] [INFO ] [MAIN ] BVN: Loaded 44527 existing records. [2025-10-30T17:45:15.110998] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:15.161562] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-30T17:45:15.499709] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:15.469463] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:15.525695] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:15.526385] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-30T17:45:15.526536] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-30T17:45:15.526578] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-30T17:45:15.526213] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-30T17:45:15.526841] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-30T17:45:15.526970] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-30T17:45:15.527306] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-30T17:45:15.527346] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-30T17:45:15.527450] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-30T17:45:15.527556] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-30T17:45:15.527610] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-30T17:45:15.589911] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-30T17:45:16.416940] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T17:45:16.478159] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-30T17:45:16.560889] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:16.622750] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-30T17:45:16.667065] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:16.697213] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-30T17:45:16.696956] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:16.698252] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-30T17:45:17.565269] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T17:45:17.568063] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-30T17:45:17.984297] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T17:45:17.990794] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-30T17:45:18.064812] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T17:45:18.073786] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-30T17:45:18.083285] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T17:45:18.087202] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-30T17:45:18.340380] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-30T17:45:18.348563] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-30T17:45:18.744691] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-30T17:45:18.750382] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-30T17:45:18.868972] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T17:45:18.877407] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-30T17:45:18.904946] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T17:45:18.914235] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-30T17:45:19.295913] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T17:45:19.305228] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-30T17:45:19.443492] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T17:45:19.448113] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-30T17:45:20.082141] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T17:45:20.086416] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-30T17:45:20.370762] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T17:45:20.381598] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-30T17:45:20.682828] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-30T17:45:20.689636] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-30T17:45:21.265107] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T17:45:21.269885] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-30T17:45:21.688820] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T17:45:21.704726] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-30T17:45:22.874435] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-30T17:45:22.883828] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-30T17:45:23.922545] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T17:45:23.931726] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-30T17:45:25.163008] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T17:45:25.172856] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-30T17:45:26.306778] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T17:45:26.319303] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-30T17:45:27.543469] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T17:45:27.553968] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-30T17:45:29.061162] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T17:45:29.073274] [INFO ] [REMOTE ] BVN: Full fetch complete (63858 records). [2025-10-30T17:45:29.073436] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-30T17:45:29.469104] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-30T17:45:29.469185] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-30T17:45:29.469877] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-30T17:45:29.469940] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-30T17:45:29.471135] [DEBUG] [LOCAL ] BVN: Trimmed 63858 records to 44896 (keeping 200 days of data) [2025-10-30T17:45:29.727837] [DEBUG] [LOCAL ] BVN: Primary data saved (44896 records). [2025-10-30T17:45:29.727959] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-30T17:45:29.728036] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BVN took 16.0s. Estimated remaining: 4h 12m 27s. Rate: 7.9 symbols/min [2025-10-30T17:45:29.897903] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:29.944490] [DEBUG] [LOCAL ] BWA: Loaded 51996 existing records from primary storage. [2025-10-30T17:45:29.944839] [INFO ] [MAIN ] BWA: Loaded 51996 existing records. [2025-10-30T17:45:30.129419] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:30.129833] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-30T17:45:30.129907] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-30T17:45:30.130465] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-30T17:45:30.130750] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-30T17:45:30.473240] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:30.473553] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-30T17:45:31.803599] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (12.93 seconds). [2025-10-30T17:45:31.812287] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-30T17:45:31.868353] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-30T17:45:31.878602] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-30T17:45:32.896350] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T17:45:32.904801] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-30T17:45:33.048110] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T17:45:33.059248] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-30T17:45:33.911885] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T17:45:33.921891] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-30T17:45:34.415267] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:45:34.426488] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-30T17:45:34.931423] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-30T17:45:34.939479] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-30T17:45:35.578898] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T17:45:35.590470] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-30T17:45:36.869869] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T17:45:36.880661] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-30T17:45:38.018272] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T17:45:38.033602] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-30T17:45:41.952772] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (23.04 seconds). [2025-10-30T17:45:41.962127] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-30T17:45:42.386084] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (21.12 seconds). [2025-10-30T17:45:42.389810] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-30T17:45:43.221533] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:45:43.231471] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-30T17:45:43.283941] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T17:45:43.287680] [INFO ] [REMOTE ] BUXX: Full fetch complete (20835 records). [2025-10-30T17:45:43.287761] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-30T17:45:43.468017] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (8.53 seconds). [2025-10-30T17:45:43.547897] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-30T17:45:43.702944] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-30T17:45:43.703023] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-30T17:45:43.703416] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-30T17:45:43.703455] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-30T17:45:43.704091] [DEBUG] [LOCAL ] BUXX: Trimmed 20835 records to 15198 (keeping 200 days of data) [2025-10-30T17:45:43.799166] [DEBUG] [LOCAL ] BUXX: Primary data saved (15198 records). [2025-10-30T17:45:43.799309] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-30T17:45:43.799382] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BUXX took 30.0s. Estimated remaining: 4h 12m 56s. Rate: 7.9 symbols/min [2025-10-30T17:45:43.985158] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:43.997615] [DEBUG] [LOCAL ] BWG: Loaded 12322 existing records from primary storage. [2025-10-30T17:45:43.997890] [INFO ] [MAIN ] BWG: Loaded 12322 existing records. [2025-10-30T17:45:44.198247] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:44.198883] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-30T17:45:44.198977] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-30T17:45:44.199241] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-30T17:45:44.199301] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-30T17:45:44.574921] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (6.54 seconds). [2025-10-30T17:45:44.614687] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-30T17:45:44.695665] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:44.698726] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-30T17:45:44.701407] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-30T17:45:44.710307] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-30T17:45:44.736260] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T17:45:44.746106] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-30T17:45:45.458571] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T17:45:45.462240] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-30T17:45:45.578705] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T17:45:45.587734] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-30T17:45:45.771021] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T17:45:45.783170] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-30T17:45:45.930587] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T17:45:45.933429] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-30T17:45:46.176000] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T17:45:46.187438] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-30T17:45:46.311887] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-30T17:45:46.314369] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-30T17:45:46.605572] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T17:45:46.612629] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-30T17:45:46.785884] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T17:45:46.789360] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-30T17:45:46.896533] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T17:45:46.908228] [INFO ] [REMOTE ] BV: Full fetch complete (55285 records). [2025-10-30T17:45:46.908423] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-30T17:45:47.325538] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-30T17:45:47.325834] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-30T17:45:47.326927] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-30T17:45:47.327047] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-30T17:45:47.328579] [DEBUG] [LOCAL ] BV: Trimmed 55285 records to 38595 (keeping 200 days of data) [2025-10-30T17:45:47.519693] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T17:45:47.603259] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-30T17:45:47.614579] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T17:45:47.633771] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-30T17:45:47.659923] [DEBUG] [LOCAL ] BV: Primary data saved (38595 records). [2025-10-30T17:45:47.660111] [INFO ] [MAIN ] BV: Full history saved. [2025-10-30T17:45:47.660222] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BV took 33.9s. Estimated remaining: 4h 12m 28s. Rate: 7.9 symbols/min [2025-10-30T17:45:47.865917] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:47.895863] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T17:45:47.906512] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-30T17:45:47.930866] [DEBUG] [LOCAL ] BWLP: Loaded 31700 existing records from primary storage. [2025-10-30T17:45:47.931145] [INFO ] [MAIN ] BWLP: Loaded 31700 existing records. [2025-10-30T17:45:48.110209] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:48.110405] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-30T17:45:48.110452] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-30T17:45:48.111170] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-30T17:45:48.111249] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-30T17:45:48.367567] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-30T17:45:48.404319] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-30T17:45:48.482929] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:48.483237] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-30T17:45:49.036560] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T17:45:49.061326] [INFO ] [REMOTE ] BWA: Full fetch complete (75850 records). [2025-10-30T17:45:49.062262] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-30T17:45:49.062822] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-30T17:45:49.068001] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-30T17:45:49.474612] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-30T17:45:49.474816] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-30T17:45:49.475624] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-30T17:45:49.475716] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-30T17:45:49.477083] [DEBUG] [LOCAL ] BWA: Trimmed 75850 records to 52386 (keeping 200 days of data) [2025-10-30T17:45:49.709319] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:45:49.726612] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-30T17:45:49.857020] [DEBUG] [LOCAL ] BWA: Primary data saved (52386 records). [2025-10-30T17:45:49.858328] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-30T17:45:49.868724] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-30T17:45:49.869815] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BWA took 20.1s. Estimated remaining: 4h 11m 51s. Rate: 7.9 symbols/min [2025-10-30T17:45:49.882464] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-30T17:45:50.021431] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T17:45:50.057733] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-30T17:45:50.087805] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:50.089322] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-10-30T17:45:50.089371] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-10-30T17:45:50.089506] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-30T17:45:50.089550] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-30T17:45:50.089591] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-30T17:45:50.089623] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-30T17:45:50.440603] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:50.440945] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-30T17:45:50.705432] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T17:45:50.712045] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-30T17:45:50.750422] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-30T17:45:50.754196] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-30T17:45:50.973526] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T17:45:50.975241] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-30T17:45:51.359195] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T17:45:51.360862] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-30T17:45:51.392574] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-30T17:45:51.395770] [INFO ] [REMOTE ] BWG: Full fetch complete (17464 records). [2025-10-30T17:45:51.395871] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-30T17:45:51.837745] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-30T17:45:51.876772] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-30T17:45:51.940158] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-30T17:45:51.940321] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-30T17:45:51.940933] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-30T17:45:51.941064] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-30T17:45:51.946416] [DEBUG] [LOCAL ] BWG: Trimmed 17464 records to 12394 (keeping 200 days of data) [2025-10-30T17:45:51.946203] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-30T17:45:52.023205] [INFO ] [REMOTE ] BW: Full fetch complete (59365 records). [2025-10-30T17:45:52.053414] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T17:45:52.053706] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-30T17:45:52.088456] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-30T17:45:52.443895] [DEBUG] [LOCAL ] BWG: Primary data saved (12394 records). [2025-10-30T17:45:52.447893] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-30T17:45:52.448260] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWG took 8.6s. Estimated remaining: 4h 11m 16s. Rate: 8.0 symbols/min [2025-10-30T17:45:52.663190] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-30T17:45:52.673222] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T17:45:52.672709] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-30T17:45:52.676346] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-30T17:45:52.690416] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-30T17:45:52.691782] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-30T17:45:52.735815] [DEBUG] [LOCAL ] BW: Trimmed 59365 records to 40744 (keeping 200 days of data) [2025-10-30T17:45:52.825346] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:52.834802] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-10-30T17:45:52.835235] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-10-30T17:45:52.835396] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-30T17:45:52.862352] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-30T17:45:52.862893] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-10-30T17:45:52.880690] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-30T17:45:53.350087] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T17:45:53.385623] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-30T17:45:53.422515] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:53.436177] [DEBUG] [LOCAL ] BW: Primary data saved (40744 records). [2025-10-30T17:45:53.431784] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-30T17:45:53.436344] [INFO ] [MAIN ] BW: Full history saved. [2025-10-30T17:45:53.444713] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BW took 39.7s. Estimated remaining: 4h 10m 33s. Rate: 8.0 symbols/min [2025-10-30T17:45:53.464727] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:45:53.528582] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-30T17:45:53.650413] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:53.657743] [DEBUG] [LOCAL ] BWSN: Loaded 5024 existing records from primary storage. [2025-10-30T17:45:53.658000] [INFO ] [MAIN ] BWSN: Loaded 5024 existing records. [2025-10-30T17:45:53.845803] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:53.846055] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-30T17:45:53.846118] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-30T17:45:53.846305] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-30T17:45:53.846372] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-30T17:45:53.940504] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-30T17:45:53.950369] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-30T17:45:53.990344] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T17:45:54.040781] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-30T17:45:54.255683] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:54.256048] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-30T17:45:54.342947] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T17:45:54.344311] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-30T17:45:54.579552] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-30T17:45:54.587276] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-30T17:45:54.787407] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-30T17:45:54.790485] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-30T17:45:54.795890] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-30T17:45:54.797927] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-30T17:45:54.801220] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T17:45:54.802239] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-30T17:45:55.075252] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-30T17:45:55.076900] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-30T17:45:55.142128] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-30T17:45:55.143637] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-30T17:45:55.270230] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-30T17:45:55.272984] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-30T17:45:55.437579] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-30T17:45:55.539534] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T17:45:55.589306] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T17:45:55.657717] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T17:45:55.697493] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-30T17:45:56.095099] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T17:45:56.497509] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-30T17:45:56.784981] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-30T17:45:57.297523] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-30T17:45:58.097500] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-30T17:45:58.276566] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T17:45:58.608846] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-30T17:45:58.611148] [INFO ] [REMOTE ] BWMX: Full fetch complete (10150 records). [2025-10-30T17:45:58.611226] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-30T17:45:58.902588] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-30T17:45:58.997450] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-30T17:45:58.997527] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-30T17:45:58.997805] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-30T17:45:58.997867] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-30T17:45:58.998307] [DEBUG] [LOCAL ] BWMX: Trimmed 10150 records to 8131 (keeping 200 days of data) [2025-10-30T17:45:59.047023] [DEBUG] [LOCAL ] BWMX: Primary data saved (8131 records). [2025-10-30T17:45:59.047156] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-30T17:45:59.047227] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWMX took 9.2s. Estimated remaining: 4h 10m 15s. Rate: 8.0 symbols/min [2025-10-30T17:45:59.224840] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:45:59.271038] [DEBUG] [LOCAL ] BWXT: Loaded 47088 existing records from primary storage. [2025-10-30T17:45:59.271334] [INFO ] [MAIN ] BWXT: Loaded 47088 existing records. [2025-10-30T17:45:59.464044] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:45:59.464248] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-30T17:45:59.464296] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-30T17:45:59.464873] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-30T17:45:59.464930] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-30T17:45:59.705030] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-30T17:45:59.822543] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:45:59.959477] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T17:46:00.184843] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T17:46:00.497519] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-30T17:46:01.297539] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-30T17:46:02.097555] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-30T17:46:02.487444] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-30T17:46:02.489297] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T17:46:02.897534] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-30T17:46:03.697472] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-30T17:46:03.789423] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-30T17:46:04.102429] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T17:46:04.258041] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T17:46:04.265018] [INFO ] [REMOTE ] BWLP: Full fetch complete (47573 records). [2025-10-30T17:46:04.265142] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-30T17:46:04.265775] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:46:04.265864] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:46:04.265907] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:46:04.265949] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-30T17:46:04.266036] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-30T17:46:04.266088] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-10-30T17:46:04.266305] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-10-30T17:46:04.266899] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWLP took 16.6s. Estimated remaining: 4h 9m 55s. Rate: 8.0 symbols/min [2025-10-30T17:46:04.439616] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:46:04.496094] [DEBUG] [LOCAL ] BX: Loaded 53481 existing records from primary storage. [2025-10-30T17:46:04.496412] [INFO ] [MAIN ] BX: Loaded 53481 existing records. [2025-10-30T17:46:04.507065] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-30T17:46:04.674440] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:46:04.674621] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-30T17:46:04.674698] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-30T17:46:04.675192] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-30T17:46:04.675230] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-30T17:46:05.026043] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:46:05.092663] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-30T17:46:05.093700] [INFO ] [REMOTE ] BWNB: Full fetch complete (5578 records). [2025-10-30T17:46:05.093786] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-30T17:46:05.302603] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-30T17:46:05.456248] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-30T17:46:05.456360] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-30T17:46:05.456535] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-30T17:46:05.456575] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-30T17:46:05.457032] [DEBUG] [LOCAL ] BWNB: Trimmed 5578 records to 4023 (keeping 200 days of data) [2025-10-30T17:46:05.482460] [DEBUG] [LOCAL ] BWNB: Primary data saved (4023 records). [2025-10-30T17:46:05.482576] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-30T17:46:05.482670] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BWNB took 13.0s. Estimated remaining: 4h 9m 13s. Rate: 8.0 symbols/min [2025-10-30T17:46:05.653169] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:46:05.667606] [DEBUG] [LOCAL ] BXC: Loaded 13068 existing records from primary storage. [2025-10-30T17:46:05.667884] [INFO ] [MAIN ] BXC: Loaded 13068 existing records. [2025-10-30T17:46:05.873330] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:46:05.873559] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-30T17:46:05.873611] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-30T17:46:05.873876] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-30T17:46:05.873938] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-30T17:46:06.097981] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T17:46:06.126533] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-30T17:46:06.326872] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:46:06.897740] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-30T17:46:07.542176] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-30T17:46:07.646911] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T17:46:07.697476] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-30T17:46:08.497520] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-30T17:46:08.995084] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T17:46:09.297513] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-30T17:46:10.097490] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-30T17:46:10.185088] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-30T17:46:10.406960] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T17:46:10.603415] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-30T17:46:10.897510] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-30T17:46:11.472490] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-30T17:46:11.697486] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-30T17:46:12.380256] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-30T17:46:12.497481] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-30T17:46:13.199907] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-30T17:46:13.297466] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-30T17:46:13.984176] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T17:46:14.097495] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-30T17:46:14.897512] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-30T17:46:15.434523] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:46:15.697502] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-30T17:46:16.316536] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T17:46:16.497518] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-30T17:46:17.290501] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T17:46:17.301096] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-30T17:46:17.905109] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T17:46:18.097479] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-30T17:46:18.133566] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-30T17:46:18.897492] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-30T17:46:19.621637] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T17:46:19.697537] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-30T17:46:19.860668] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-30T17:46:20.497501] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-30T17:46:21.150063] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T17:46:21.178328] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T17:46:21.297517] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-30T17:46:21.770120] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-30T17:46:22.097501] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-30T17:46:22.758755] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T17:46:22.897539] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-30T17:46:23.370988] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-30T17:46:23.697524] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-30T17:46:24.497503] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-30T17:46:25.098786] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T17:46:25.297524] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-30T17:46:26.037322] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-30T17:46:26.040433] [INFO ] [REMOTE ] BXC: Full fetch complete (18292 records). [2025-10-30T17:46:26.040526] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-30T17:46:26.102991] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-30T17:46:26.437300] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-30T17:46:26.437467] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-30T17:46:26.438079] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-30T17:46:26.438155] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-30T17:46:26.439081] [DEBUG] [LOCAL ] BXC: Trimmed 18292 records to 13143 (keeping 200 days of data) [2025-10-30T17:46:26.504094] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T17:46:26.562365] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-30T17:46:26.564323] [DEBUG] [LOCAL ] BXC: Primary data saved (13143 records). [2025-10-30T17:46:26.575524] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-30T17:46:26.575813] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BXC took 21.1s. Estimated remaining: 4h 10m 19s. Rate: 8.0 symbols/min [2025-10-30T17:46:26.756886] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:46:26.802443] [DEBUG] [LOCAL ] BXMT: Loaded 47117 existing records from primary storage. [2025-10-30T17:46:26.802848] [INFO ] [MAIN ] BXMT: Loaded 47117 existing records. [2025-10-30T17:46:26.902691] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-30T17:46:26.982920] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:46:26.983114] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-30T17:46:26.983161] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-30T17:46:26.983371] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-30T17:46:26.983426] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-30T17:46:27.340918] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:46:27.616836] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T17:46:27.618632] [INFO ] [REMOTE ] BWSN: Full fetch complete (6469 records). [2025-10-30T17:46:27.618746] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-30T17:46:27.702668] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-30T17:46:28.016288] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-30T17:46:28.016373] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-30T17:46:28.016552] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-30T17:46:28.016591] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-30T17:46:28.016992] [DEBUG] [LOCAL ] BWSN: Trimmed 6469 records to 5056 (keeping 200 days of data) [2025-10-30T17:46:28.046563] [DEBUG] [LOCAL ] BWSN: Primary data saved (5056 records). [2025-10-30T17:46:28.046668] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-30T17:46:28.046773] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BWSN took 34.6s. Estimated remaining: 4h 9m 39s. Rate: 8.0 symbols/min [2025-10-30T17:46:28.209472] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:46:28.209676] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-10-30T17:46:28.209729] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-10-30T17:46:28.209803] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-30T17:46:28.209839] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-30T17:46:28.209879] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-10-30T17:46:28.209909] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-30T17:46:28.502735] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-30T17:46:28.555968] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:46:29.230027] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T17:46:29.297513] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-30T17:46:30.097482] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-30T17:46:30.212330] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T17:46:30.312723] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-30T17:46:30.897639] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-30T17:46:31.697491] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-30T17:46:31.864797] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-30T17:46:32.042142] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T17:46:32.497506] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-30T17:46:33.297540] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-30T17:46:33.588571] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-30T17:46:33.633995] [INFO ] [REMOTE ] BWXT: Full fetch complete (68158 records). [2025-10-30T17:46:33.637276] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-30T17:46:33.657320] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T17:46:34.072351] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-30T17:46:34.072605] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-30T17:46:34.073391] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-30T17:46:34.073469] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-30T17:46:34.087943] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T17:46:34.093341] [DEBUG] [LOCAL ] BWXT: Trimmed 68158 records to 47442 (keeping 200 days of data) [2025-10-30T17:46:34.149421] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-30T17:46:34.401131] [DEBUG] [LOCAL ] BWXT: Primary data saved (47442 records). [2025-10-30T17:46:34.401281] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-30T17:46:34.402017] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BWXT took 35.4s. Estimated remaining: 4h 9m 25s. Rate: 8.0 symbols/min [2025-10-30T17:46:34.573092] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:46:34.618338] [DEBUG] [LOCAL ] BXP: Loaded 49716 existing records from primary storage. [2025-10-30T17:46:34.618628] [INFO ] [MAIN ] BXP: Loaded 49716 existing records. [2025-10-30T17:46:34.794263] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:46:34.794494] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-30T17:46:34.794542] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-30T17:46:34.794923] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-30T17:46:34.794980] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-30T17:46:34.900101] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-30T17:46:35.157903] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:46:35.702723] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-30T17:46:35.720724] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-30T17:46:36.391566] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T17:46:36.430883] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-30T17:46:36.497522] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-30T17:46:37.297494] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-30T17:46:38.097472] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-30T17:46:38.286488] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-30T17:46:38.557150] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:46:38.897498] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-30T17:46:38.991794] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-30T17:46:39.697500] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-30T17:46:40.463406] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-30T17:46:40.497449] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-30T17:46:40.594831] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T17:46:40.606610] [INFO ] [REMOTE ] BX: Full fetch complete (77611 records). [2025-10-30T17:46:40.606780] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-30T17:46:41.006112] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-30T17:46:41.006188] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-30T17:46:41.007065] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-30T17:46:41.007130] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-30T17:46:41.008585] [DEBUG] [LOCAL ] BX: Trimmed 77611 records to 53871 (keeping 200 days of data) [2025-10-30T17:46:41.313458] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-30T17:46:41.341025] [DEBUG] [LOCAL ] BX: Primary data saved (53871 records). [2025-10-30T17:46:41.403137] [INFO ] [MAIN ] BX: Full history saved. [2025-10-30T17:46:41.404162] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BX took 37.1s. Estimated remaining: 4h 9m 15s. Rate: 8.0 symbols/min [2025-10-30T17:46:41.452948] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-30T17:46:41.597797] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:46:41.643515] [DEBUG] [LOCAL ] BXSL: Loaded 48171 existing records from primary storage. [2025-10-30T17:46:41.643858] [INFO ] [MAIN ] BXSL: Loaded 48171 existing records. [2025-10-30T17:46:41.832996] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:46:41.833235] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-30T17:46:41.833283] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-30T17:46:41.833798] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-30T17:46:41.833859] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-30T17:46:42.104898] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-30T17:46:42.241415] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:46:42.759747] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T17:46:42.897522] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-30T17:46:43.507794] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:46:43.697493] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-30T17:46:44.069783] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T17:46:44.497523] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-30T17:46:44.759931] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T17:46:45.297489] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-30T17:46:45.806124] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T17:46:46.097521] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-30T17:46:46.535707] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:46:46.897491] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-30T17:46:47.286493] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T17:46:47.406493] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-30T17:46:47.697492] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-30T17:46:48.280200] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T17:46:48.497525] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-30T17:46:49.297495] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-30T17:46:49.873861] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-30T17:46:50.009114] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:46:50.097491] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-30T17:46:50.897709] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-30T17:46:51.281029] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T17:46:51.697556] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-30T17:46:51.905485] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T17:46:51.910129] [INFO ] [REMOTE ] BXMX: Full fetch complete (28458 records). [2025-10-30T17:46:51.910232] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-30T17:46:52.280275] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-30T17:46:52.280361] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-30T17:46:52.280811] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-30T17:46:52.280872] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-30T17:46:52.281615] [DEBUG] [LOCAL ] BXMX: Trimmed 28458 records to 18812 (keeping 200 days of data) [2025-10-30T17:46:52.391264] [DEBUG] [LOCAL ] BXMX: Primary data saved (18812 records). [2025-10-30T17:46:52.391402] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-30T17:46:52.391473] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXMX took 24.3s. Estimated remaining: 4h 9m 26s. Rate: 8.0 symbols/min [2025-10-30T17:46:52.502778] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-30T17:46:52.564024] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:46:52.564536] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-30T17:46:52.564603] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-30T17:46:52.564774] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-30T17:46:52.564841] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-30T17:46:52.564909] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-30T17:46:52.564968] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-30T17:46:52.929367] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:46:52.981849] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T17:46:53.297556] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-30T17:46:53.892082] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T17:46:54.088185] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T17:46:54.097456] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-30T17:46:54.702633] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T17:46:54.897525] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-30T17:46:55.697506] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-30T17:46:56.075060] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T17:46:56.404030] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-30T17:46:56.497544] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-30T17:46:57.297498] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-30T17:46:57.935186] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T17:46:58.097508] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-30T17:46:58.617189] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-30T17:46:58.897522] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-30T17:46:59.524375] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T17:46:59.697538] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-30T17:46:59.970239] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T17:47:00.497516] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-30T17:47:01.302622] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-30T17:47:01.317667] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-30T17:47:01.721354] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T17:47:02.097494] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-30T17:47:02.704935] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T17:47:02.897560] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-30T17:47:03.470024] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T17:47:03.697501] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-30T17:47:04.477632] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-30T17:47:04.488899] [INFO ] [REMOTE ] BXMT: Full fetch complete (69865 records). [2025-10-30T17:47:04.489106] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-30T17:47:04.501819] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-30T17:47:04.582687] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T17:47:04.903908] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-30T17:47:04.903985] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-30T17:47:04.904738] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-30T17:47:04.904799] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-30T17:47:04.906060] [DEBUG] [LOCAL ] BXMT: Trimmed 69865 records to 47507 (keeping 200 days of data) [2025-10-30T17:47:05.201092] [DEBUG] [LOCAL ] BXMT: Primary data saved (47507 records). [2025-10-30T17:47:05.201224] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-30T17:47:05.201302] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BXMT took 38.6s. Estimated remaining: 4h 9m 47s. Rate: 8.0 symbols/min [2025-10-30T17:47:05.300359] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-30T17:47:05.368148] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:05.405581] [DEBUG] [LOCAL ] BYD: Loaded 44947 existing records from primary storage. [2025-10-30T17:47:05.405881] [INFO ] [MAIN ] BYD: Loaded 44947 existing records. [2025-10-30T17:47:05.579892] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:47:05.580105] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-30T17:47:05.580152] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-30T17:47:05.580464] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-30T17:47:05.580521] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-30T17:47:05.935444] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:05.962260] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T17:47:06.097451] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-30T17:47:06.628968] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T17:47:06.897484] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-30T17:47:07.397939] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T17:47:07.697503] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-30T17:47:07.877376] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T17:47:08.497499] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-30T17:47:09.040081] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T17:47:09.297507] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-30T17:47:09.817500] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T17:47:10.097499] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-30T17:47:10.397123] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T17:47:10.897476] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-30T17:47:11.697546] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-30T17:47:12.214198] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-30T17:47:12.227295] [INFO ] [REMOTE ] BXP: Full fetch complete (72248 records). [2025-10-30T17:47:12.227435] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-30T17:47:12.421842] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-30T17:47:12.502636] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-30T17:47:12.677207] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-30T17:47:12.677293] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-30T17:47:12.678069] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-30T17:47:12.678137] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-30T17:47:12.679528] [DEBUG] [LOCAL ] BXP: Trimmed 72248 records to 50105 (keeping 200 days of data) [2025-10-30T17:47:12.984956] [DEBUG] [LOCAL ] BXP: Primary data saved (50105 records). [2025-10-30T17:47:12.985249] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-30T17:47:12.986039] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXP took 38.6s. Estimated remaining: 4h 9m 41s. Rate: 8.0 symbols/min [2025-10-30T17:47:13.164393] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:13.204696] [DEBUG] [LOCAL ] BYM: Loaded 11222 existing records from primary storage. [2025-10-30T17:47:13.205083] [INFO ] [MAIN ] BYM: Loaded 11222 existing records. [2025-10-30T17:47:13.272281] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T17:47:13.318542] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-30T17:47:13.363204] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-30T17:47:13.420910] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:47:13.421099] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-30T17:47:13.421150] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-30T17:47:13.421326] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-30T17:47:13.421382] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-30T17:47:13.775781] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:14.097492] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-30T17:47:14.535512] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T17:47:14.897492] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-30T17:47:15.697467] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-30T17:47:15.778477] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T17:47:15.789998] [INFO ] [REMOTE ] BXSL: Full fetch complete (70273 records). [2025-10-30T17:47:15.790112] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-30T17:47:16.183773] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-30T17:47:16.183882] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-30T17:47:16.184709] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-30T17:47:16.184844] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-30T17:47:16.209766] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T17:47:16.218588] [DEBUG] [LOCAL ] BXSL: Trimmed 70273 records to 48556 (keeping 200 days of data) [2025-10-30T17:47:16.497945] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-30T17:47:16.511813] [DEBUG] [LOCAL ] BXSL: Primary data saved (48556 records). [2025-10-30T17:47:16.511943] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-30T17:47:16.512530] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BXSL took 35.1s. Estimated remaining: 4h 9m 12s. Rate: 8.0 symbols/min [2025-10-30T17:47:16.706728] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:16.703417] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-30T17:47:16.711617] [DEBUG] [LOCAL ] BZH: No existing data file found in primary storage. [2025-10-30T17:47:16.711785] [WARN ] [MAIN ] BZH: No existing data found, performing full refresh instead. [2025-10-30T17:47:16.711926] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-30T17:47:16.711991] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-30T17:47:16.712314] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-10-30T17:47:16.712365] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-30T17:47:17.085070] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:17.297499] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-30T17:47:17.667691] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T17:47:18.097516] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-30T17:47:18.243361] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T17:47:18.807875] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-30T17:47:18.897503] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-30T17:47:19.697546] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-30T17:47:19.746323] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-30T17:47:19.751865] [INFO ] [REMOTE ] BY: Full fetch complete (29832 records). [2025-10-30T17:47:19.752003] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-30T17:47:20.161400] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-30T17:47:20.161515] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-30T17:47:20.162205] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-30T17:47:20.162276] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-30T17:47:20.163471] [DEBUG] [LOCAL ] BY: Trimmed 29832 records to 21558 (keeping 200 days of data) [2025-10-30T17:47:20.312321] [DEBUG] [LOCAL ] BY: Primary data saved (21558 records). [2025-10-30T17:47:20.312570] [INFO ] [MAIN ] BY: Full history saved. [2025-10-30T17:47:20.312709] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BY took 27.9s. Estimated remaining: 4h 8m 45s. Rate: 8.0 symbols/min [2025-10-30T17:47:20.496046] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:20.497547] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-30T17:47:20.549882] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-30T17:47:20.550268] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-30T17:47:20.772188] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:47:20.772403] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-30T17:47:20.772451] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-30T17:47:20.773054] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-30T17:47:20.773111] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-30T17:47:21.119698] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T17:47:21.201122] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:21.251311] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-30T17:47:21.297496] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-30T17:47:22.097515] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-30T17:47:22.897489] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-30T17:47:23.021780] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-30T17:47:23.305218] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T17:47:23.593044] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T17:47:23.697487] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-30T17:47:24.283943] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-30T17:47:24.497535] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-30T17:47:25.297510] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-30T17:47:25.797247] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T17:47:25.839392] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-30T17:47:26.097488] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-30T17:47:26.897560] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-30T17:47:27.323046] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:47:27.663196] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-30T17:47:27.697490] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-30T17:47:28.209848] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-30T17:47:28.497497] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-30T17:47:28.926372] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-30T17:47:29.297483] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-30T17:47:29.812769] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T17:47:30.097567] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-30T17:47:30.765384] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-30T17:47:30.768428] [INFO ] [REMOTE ] BYM: Full fetch complete (17274 records). [2025-10-30T17:47:30.768519] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-30T17:47:30.768979] [FATAL] [VALIDATOR ] BYM: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:47:30.769058] [FATAL] [MAIN ] BYM: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:47:30.769100] [WARN ] [MAIN ] BYM: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:47:30.769138] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-30T17:47:30.769192] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-30T17:47:30.769228] [INFO ] [LOCAL ] BYM: Starting deletion of derivative data. [2025-10-30T17:47:30.769408] [DEBUG] [LOCAL ] BYM: Deleted derivative data file. [2025-10-30T17:47:30.769495] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BYM took 17.8s. Estimated remaining: 4h 8m 53s. Rate: 8.0 symbols/min [2025-10-30T17:47:30.907738] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-30T17:47:30.949273] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:30.969921] [DEBUG] [LOCAL ] CAAP: Loaded 19799 existing records from primary storage. [2025-10-30T17:47:30.970185] [INFO ] [MAIN ] CAAP: Loaded 19799 existing records. [2025-10-30T17:47:31.156318] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:47:31.156530] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-30T17:47:31.156578] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-30T17:47:31.156780] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-30T17:47:31.156841] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-30T17:47:31.506099] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:31.697522] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-30T17:47:32.253590] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T17:47:32.263973] [INFO ] [REMOTE ] BYD: Full fetch complete (65694 records). [2025-10-30T17:47:32.264105] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-30T17:47:32.502789] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-30T17:47:32.663042] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-30T17:47:32.663132] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-30T17:47:32.663970] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-30T17:47:32.664035] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-30T17:47:32.665333] [DEBUG] [LOCAL ] BYD: Trimmed 65694 records to 45299 (keeping 200 days of data) [2025-10-30T17:47:32.930813] [DEBUG] [LOCAL ] BYD: Primary data saved (45299 records). [2025-10-30T17:47:32.930940] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-30T17:47:32.931019] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. BYD took 27.7s. Estimated remaining: 4h 8m 17s. Rate: 8.0 symbols/min [2025-10-30T17:47:33.097483] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:33.114272] [DEBUG] [LOCAL ] CABO: Loaded 16438 existing records from primary storage. [2025-10-30T17:47:33.114486] [INFO ] [MAIN ] CABO: Loaded 16438 existing records. [2025-10-30T17:47:33.319539] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:47:33.314178] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-30T17:47:33.321025] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-30T17:47:33.321204] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-30T17:47:33.321439] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-30T17:47:33.321504] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-30T17:47:33.695531] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:33.751195] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T17:47:33.752798] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-30T17:47:34.097514] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-30T17:47:34.279853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T17:47:34.897515] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-30T17:47:35.697518] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-30T17:47:35.859692] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T17:47:35.986222] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-30T17:47:36.203155] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T17:47:36.497514] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-30T17:47:37.297493] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-30T17:47:37.921602] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-30T17:47:38.097455] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-30T17:47:38.404575] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-30T17:47:38.761056] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-30T17:47:38.897494] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-30T17:47:39.697505] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-30T17:47:40.482027] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T17:47:40.497451] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-30T17:47:40.669409] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:47:41.297493] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-30T17:47:41.884930] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-30T17:47:42.079042] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-30T17:47:42.097485] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-30T17:47:42.897489] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-30T17:47:42.962512] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-30T17:47:43.697498] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-30T17:47:43.902308] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T17:47:44.401778] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-30T17:47:44.497550] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-30T17:47:45.297493] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-30T17:47:45.325570] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-30T17:47:46.097556] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-30T17:47:46.842533] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-30T17:47:46.897554] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-30T17:47:47.150849] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-30T17:47:47.516985] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-30T17:47:47.697497] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-30T17:47:48.497580] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-30T17:47:49.297486] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-30T17:47:49.403677] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T17:47:49.610602] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-30T17:47:50.097506] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-30T17:47:50.372766] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T17:47:50.897580] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-30T17:47:51.651046] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-30T17:47:51.697482] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-30T17:47:51.847093] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T17:47:52.497531] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-30T17:47:53.124231] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T17:47:53.297502] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-30T17:47:53.837241] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-30T17:47:53.850861] [INFO ] [REMOTE ] C: Full fetch complete (77919 records). [2025-10-30T17:47:53.851079] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-30T17:47:54.050003] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T17:47:54.102763] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-30T17:47:54.298976] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-30T17:47:54.299125] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-30T17:47:54.300357] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-30T17:47:54.300425] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-30T17:47:54.302481] [DEBUG] [LOCAL ] C: Trimmed 77919 records to 54131 (keeping 200 days of data) [2025-10-30T17:47:54.664530] [DEBUG] [LOCAL ] C: Primary data saved (54131 records). [2025-10-30T17:47:54.664802] [INFO ] [MAIN ] C: Full history saved. [2025-10-30T17:47:54.665868] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. C took 34.4s. Estimated remaining: 4h 9m 24s. Rate: 8.0 symbols/min [2025-10-30T17:47:54.837948] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:54.867917] [DEBUG] [LOCAL ] CACI: Loaded 21764 existing records from primary storage. [2025-10-30T17:47:54.868355] [INFO ] [MAIN ] CACI: Loaded 21764 existing records. [2025-10-30T17:47:54.902739] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-30T17:47:55.079605] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:47:55.080208] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-30T17:47:55.080360] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-30T17:47:55.080880] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-30T17:47:55.080944] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-30T17:47:55.428506] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T17:47:55.503262] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:55.529526] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T17:47:55.697518] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-30T17:47:56.497537] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-30T17:47:56.645292] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T17:47:57.257062] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T17:47:57.259926] [INFO ] [REMOTE ] CABO: Full fetch complete (23060 records). [2025-10-30T17:47:57.260009] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-30T17:47:57.302875] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-30T17:47:57.623974] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-30T17:47:57.624053] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-30T17:47:57.624462] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-30T17:47:57.624501] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-30T17:47:57.625103] [DEBUG] [LOCAL ] CABO: Trimmed 23060 records to 16528 (keeping 200 days of data) [2025-10-30T17:47:57.721675] [DEBUG] [LOCAL ] CABO: Primary data saved (16528 records). [2025-10-30T17:47:57.721815] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-30T17:47:57.721899] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. CABO took 24.8s. Estimated remaining: 4h 8m 53s. Rate: 8.0 symbols/min [2025-10-30T17:47:57.891062] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:47:57.932058] [DEBUG] [LOCAL ] CADE: Loaded 49755 existing records from primary storage. [2025-10-30T17:47:57.932380] [INFO ] [MAIN ] CADE: Loaded 49755 existing records. [2025-10-30T17:47:58.103162] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-30T17:47:58.127880] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:47:58.128527] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-30T17:47:58.128621] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-30T17:47:58.129216] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-30T17:47:58.129272] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-30T17:47:58.527011] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:47:58.546855] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:47:58.897511] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-30T17:47:58.979811] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T17:47:59.697498] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-30T17:48:00.049821] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T17:48:00.497563] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-30T17:48:00.740006] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T17:48:01.297497] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-30T17:48:02.097533] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-30T17:48:02.825727] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-30T17:48:02.897483] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-30T17:48:03.372034] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T17:48:03.378969] [INFO ] [REMOTE ] BZH: Full fetch complete (47024 records). [2025-10-30T17:48:03.379115] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-30T17:48:03.713567] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-30T17:48:03.826015] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-30T17:48:03.834079] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-30T17:48:03.848471] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-30T17:48:03.851486] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-30T17:48:03.854294] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-30T17:48:03.863581] [DEBUG] [LOCAL ] BZH: Trimmed 47024 records to 31698 (keeping 200 days of data) [2025-10-30T17:48:03.993297] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T17:48:04.098947] [DEBUG] [LOCAL ] BZH: Primary data saved (31698 records). [2025-10-30T17:48:04.099139] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-30T17:48:04.099230] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. BZH took 47.6s. Estimated remaining: 4h 8m 40s. Rate: 8.0 symbols/min [2025-10-30T17:48:04.277057] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:48:04.314289] [DEBUG] [LOCAL ] CAE: Loaded 38626 existing records from primary storage. [2025-10-30T17:48:04.314617] [INFO ] [MAIN ] CAE: Loaded 38626 existing records. [2025-10-30T17:48:04.503317] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-30T17:48:04.509672] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:48:04.511149] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-30T17:48:04.511219] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-30T17:48:04.511850] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-30T17:48:04.511919] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-30T17:48:04.926674] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T17:48:04.930942] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:48:05.297536] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-30T17:48:05.765513] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:48:06.097550] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-30T17:48:06.294395] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T17:48:06.897497] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-30T17:48:07.071772] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-30T17:48:07.077255] [INFO ] [REMOTE ] CAAP: Full fetch complete (28097 records). [2025-10-30T17:48:07.077389] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-30T17:48:07.077944] [FATAL] [VALIDATOR ] CAAP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:48:07.078028] [FATAL] [MAIN ] CAAP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:48:07.078071] [WARN ] [MAIN ] CAAP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:48:07.078155] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-30T17:48:07.078225] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-10-30T17:48:07.078262] [INFO ] [LOCAL ] CAAP: Starting deletion of derivative data. [2025-10-30T17:48:07.078416] [DEBUG] [LOCAL ] CAAP: Deleted derivative data file. [2025-10-30T17:48:07.078504] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. CAAP took 36.3s. Estimated remaining: 4h 8m 9s. Rate: 8.0 symbols/min [2025-10-30T17:48:07.251200] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:48:07.256016] [DEBUG] [LOCAL ] CAF: Loaded 3345 existing records from primary storage. [2025-10-30T17:48:07.256211] [INFO ] [MAIN ] CAF: Loaded 3345 existing records. [2025-10-30T17:48:07.436524] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:48:07.436745] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-30T17:48:07.436797] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-30T17:48:07.436928] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-30T17:48:07.436965] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-30T17:48:07.711306] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-30T17:48:07.793469] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:48:07.814038] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T17:48:08.497496] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-30T17:48:09.051849] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T17:48:09.053332] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:48:09.297492] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-30T17:48:10.097536] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-30T17:48:10.756404] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T17:48:10.897581] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-30T17:48:11.277414] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T17:48:11.318635] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T17:48:11.697496] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-30T17:48:12.497527] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-30T17:48:12.912055] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-30T17:48:12.992897] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T17:48:13.297480] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-30T17:48:13.702756] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-30T17:48:14.097506] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-30T17:48:14.897457] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-30T17:48:15.091048] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T17:48:15.697499] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-30T17:48:16.026882] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T17:48:16.072041] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T17:48:16.497498] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-30T17:48:17.297544] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-30T17:48:17.701622] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T17:48:18.021453] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-30T17:48:18.097728] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-30T17:48:18.406955] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-30T17:48:18.897494] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-30T17:48:19.697519] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-30T17:48:20.286845] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T17:48:20.497542] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-30T17:48:20.760961] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T17:48:21.297509] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-30T17:48:21.609919] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T17:48:22.097556] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-30T17:48:22.441531] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T17:48:22.897537] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-30T17:48:23.488760] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T17:48:23.697527] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-30T17:48:23.900211] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-30T17:48:24.497488] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-30T17:48:24.762187] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T17:48:24.867014] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-30T17:48:25.297507] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-30T17:48:25.646962] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-30T17:48:26.097502] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-30T17:48:26.371797] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-30T17:48:26.897512] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-30T17:48:27.697520] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-30T17:48:28.323596] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T17:48:28.335205] [INFO ] [REMOTE ] CADE: Full fetch complete (70928 records). [2025-10-30T17:48:28.335342] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-30T17:48:28.503427] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-30T17:48:28.719028] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-30T17:48:28.719110] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-30T17:48:28.719895] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-30T17:48:28.719959] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-30T17:48:28.721319] [DEBUG] [LOCAL ] CADE: Trimmed 70928 records to 50144 (keeping 200 days of data) [2025-10-30T17:48:29.041312] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T17:48:29.064318] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-30T17:48:29.068455] [INFO ] [REMOTE ] CAF: Full fetch complete (5565 records). [2025-10-30T17:48:29.069881] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-30T17:48:29.117761] [DEBUG] [LOCAL ] CADE: Primary data saved (50144 records). [2025-10-30T17:48:29.149877] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-30T17:48:29.167375] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CADE took 31.4s. Estimated remaining: 4h 9m 16s. Rate: 7.9 symbols/min [2025-10-30T17:48:29.316948] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-30T17:48:29.532034] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:48:29.645603] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-30T17:48:29.645704] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-30T17:48:29.645868] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-30T17:48:29.645908] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-30T17:48:29.646306] [DEBUG] [LOCAL ] CAF: Trimmed 5565 records to 3378 (keeping 200 days of data) [2025-10-30T17:48:29.679003] [DEBUG] [LOCAL ] CAF: Primary data saved (3378 records). [2025-10-30T17:48:29.679171] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-30T17:48:29.679258] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CAF took 22.6s. Estimated remaining: 4h 8m 33s. Rate: 8.0 symbols/min [2025-10-30T17:48:29.817104] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-30T17:48:29.842714] [INFO ] [MAIN ] CAG: Loaded 53666 existing records. [2025-10-30T17:48:29.934634] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:48:30.049299] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:48:30.049602] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-30T17:48:30.049695] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-30T17:48:30.050154] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-30T17:48:30.050232] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-30T17:48:30.100222] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-30T17:48:30.319673] [DEBUG] [LOCAL ] CAH: Loaded 51345 existing records from primary storage. [2025-10-30T17:48:30.347613] [INFO ] [MAIN ] CAH: Loaded 51345 existing records. [2025-10-30T17:48:30.620271] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:48:30.642614] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:48:30.642778] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-30T17:48:30.642824] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-30T17:48:30.643360] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-30T17:48:30.643417] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-30T17:48:30.926401] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-30T17:48:31.033583] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:48:31.041235] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-30T17:48:31.057416] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T17:48:31.062783] [INFO ] [REMOTE ] CAE: Full fetch complete (56626 records). [2025-10-30T17:48:31.063240] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-30T17:48:31.458006] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-30T17:48:31.458117] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-30T17:48:31.458800] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-30T17:48:31.458861] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-30T17:48:31.460010] [DEBUG] [LOCAL ] CAE: Trimmed 56626 records to 38916 (keeping 200 days of data) [2025-10-30T17:48:31.676787] [DEBUG] [LOCAL ] CAE: Primary data saved (38916 records). [2025-10-30T17:48:31.676915] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-30T17:48:31.677457] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CAE took 27.6s. Estimated remaining: 4h 7m 57s. Rate: 8.0 symbols/min [2025-10-30T17:48:31.709160] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-30T17:48:31.856522] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:48:31.895934] [DEBUG] [LOCAL ] CAL: Loaded 42422 existing records from primary storage. [2025-10-30T17:48:31.896219] [INFO ] [MAIN ] CAL: Loaded 42422 existing records. [2025-10-30T17:48:32.070945] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:48:32.071234] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-30T17:48:32.071303] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-30T17:48:32.071817] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-30T17:48:32.071878] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-30T17:48:32.435504] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:48:32.467068] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-30T17:48:32.492127] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T17:48:32.498017] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-30T17:48:33.297511] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-30T17:48:33.731861] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:48:34.097496] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-30T17:48:34.379383] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T17:48:34.897505] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-30T17:48:35.399128] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T17:48:35.697512] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-30T17:48:35.935173] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T17:48:36.497521] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-30T17:48:37.017727] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:48:37.165724] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T17:48:37.297576] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-30T17:48:38.097487] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-30T17:48:38.216758] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-30T17:48:38.220977] [INFO ] [REMOTE ] CACI: Full fetch complete (38010 records). [2025-10-30T17:48:38.221061] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-30T17:48:38.221534] [FATAL] [VALIDATOR ] CACI: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:48:38.221616] [FATAL] [MAIN ] CACI: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:48:38.221691] [WARN ] [MAIN ] CACI: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:48:38.221745] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-30T17:48:38.221802] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-10-30T17:48:38.221836] [INFO ] [LOCAL ] CACI: Starting deletion of derivative data. [2025-10-30T17:48:38.222011] [DEBUG] [LOCAL ] CACI: Deleted derivative data file. [2025-10-30T17:48:38.222096] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CACI took 43.6s. Estimated remaining: 4h 7m 44s. Rate: 8.0 symbols/min [2025-10-30T17:48:38.396613] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:48:38.442565] [DEBUG] [LOCAL ] CALX: Loaded 36866 existing records from primary storage. [2025-10-30T17:48:38.442968] [INFO ] [MAIN ] CALX: Loaded 36866 existing records. [2025-10-30T17:48:38.664076] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:48:38.664299] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-30T17:48:38.664363] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-30T17:48:38.664763] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-30T17:48:38.664818] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-30T17:48:38.902628] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-30T17:48:39.015064] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:48:39.554182] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-30T17:48:39.697502] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-30T17:48:40.350030] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T17:48:40.497511] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-30T17:48:40.740447] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T17:48:41.297499] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-30T17:48:41.732690] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T17:48:42.050627] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T17:48:42.097453] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-30T17:48:42.897512] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-30T17:48:43.122455] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T17:48:43.697506] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-30T17:48:44.367621] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T17:48:44.497455] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-30T17:48:45.107821] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T17:48:45.297502] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-30T17:48:45.761861] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T17:48:46.097494] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-30T17:48:46.589612] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T17:48:46.897527] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-30T17:48:47.327461] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T17:48:47.697505] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-30T17:48:48.370268] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T17:48:48.497523] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-30T17:48:49.088291] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T17:48:49.297494] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-30T17:48:49.661438] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T17:48:50.097508] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-30T17:48:50.449557] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T17:48:50.897514] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-30T17:48:51.525980] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T17:48:51.697498] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-30T17:48:52.242506] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:48:52.497506] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-30T17:48:52.816368] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T17:48:53.297503] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-30T17:48:53.753181] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T17:48:54.097537] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-30T17:48:54.452717] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T17:48:54.897533] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-30T17:48:55.697519] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-30T17:48:55.847384] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-30T17:48:56.125730] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T17:48:56.497537] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-30T17:48:57.068807] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T17:48:57.297617] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-30T17:48:58.113317] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-30T17:48:58.131198] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T17:48:58.151885] [INFO ] [REMOTE ] CAG: Full fetch complete (77828 records). [2025-10-30T17:48:58.152135] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-30T17:48:58.723960] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-30T17:48:58.724882] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-30T17:48:58.725797] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-30T17:48:58.727783] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T17:48:58.727982] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-30T17:48:58.737898] [DEBUG] [LOCAL ] CAG: Trimmed 77828 records to 54056 (keeping 200 days of data) [2025-10-30T17:48:58.905833] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-30T17:48:59.055758] [DEBUG] [LOCAL ] CAG: Primary data saved (54056 records). [2025-10-30T17:48:59.055884] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-30T17:48:59.055961] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CAG took 29.9s. Estimated remaining: 4h 8m 44s. Rate: 7.9 symbols/min [2025-10-30T17:48:59.226386] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:48:59.250252] [DEBUG] [LOCAL ] CANG: Loaded 27056 existing records from primary storage. [2025-10-30T17:48:59.250513] [INFO ] [MAIN ] CANG: Loaded 27056 existing records. [2025-10-30T17:48:59.434463] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:48:59.435008] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-30T17:48:59.435058] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-30T17:48:59.435352] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-30T17:48:59.435392] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-30T17:48:59.701277] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-30T17:48:59.815593] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:48:59.847879] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T17:48:59.885930] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-30T17:48:59.897392] [INFO ] [REMOTE ] CAH: Full fetch complete (74893 records). [2025-10-30T17:48:59.897560] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-30T17:49:00.286818] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-30T17:49:00.286903] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-30T17:49:00.287798] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-30T17:49:00.287868] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-30T17:49:00.289311] [DEBUG] [LOCAL ] CAH: Trimmed 74893 records to 51735 (keeping 200 days of data) [2025-10-30T17:49:00.505139] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-30T17:49:00.617886] [DEBUG] [LOCAL ] CAH: Primary data saved (51735 records). [2025-10-30T17:49:00.618034] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-30T17:49:00.618672] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAH took 30.9s. Estimated remaining: 4h 8m 7s. Rate: 8.0 symbols/min [2025-10-30T17:49:00.785393] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:49:00.785569] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-10-30T17:49:00.785606] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-10-30T17:49:00.785733] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-30T17:49:00.785777] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-30T17:49:00.785818] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-30T17:49:00.785849] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-30T17:49:01.137962] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:49:01.297514] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-30T17:49:01.573094] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-30T17:49:02.053683] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:49:02.097570] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-30T17:49:02.612022] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-30T17:49:02.904123] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-30T17:49:02.910352] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T17:49:03.697523] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-30T17:49:04.132851] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T17:49:04.140768] [INFO ] [REMOTE ] CALX: Full fetch complete (54181 records). [2025-10-30T17:49:04.140933] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-30T17:49:04.498220] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-30T17:49:04.536369] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-30T17:49:04.536952] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-30T17:49:04.537798] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-30T17:49:04.537862] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-30T17:49:04.539044] [DEBUG] [LOCAL ] CALX: Trimmed 54181 records to 37233 (keeping 200 days of data) [2025-10-30T17:49:04.762991] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T17:49:04.792920] [DEBUG] [LOCAL ] CALX: Primary data saved (37233 records). [2025-10-30T17:49:04.793073] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-30T17:49:04.793170] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CALX took 26.6s. Estimated remaining: 4h 7m 42s. Rate: 8.0 symbols/min [2025-10-30T17:49:04.973246] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:49:04.980217] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-30T17:49:05.034444] [DEBUG] [LOCAL ] CARR: Loaded 53601 existing records from primary storage. [2025-10-30T17:49:05.034787] [INFO ] [MAIN ] CARR: Loaded 53601 existing records. [2025-10-30T17:49:05.234632] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:49:05.234858] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-30T17:49:05.234907] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-30T17:49:05.235233] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-30T17:49:05.235271] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-30T17:49:05.302745] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-30T17:49:05.586553] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:49:06.097521] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-30T17:49:06.318521] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T17:49:06.891314] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-30T17:49:06.897469] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-30T17:49:07.559084] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-30T17:49:07.697546] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-30T17:49:08.497495] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-30T17:49:08.521963] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-30T17:49:09.297533] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-30T17:49:09.764063] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T17:49:09.981462] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T17:49:10.097517] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-30T17:49:10.897513] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-30T17:49:11.322467] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T17:49:11.697498] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-30T17:49:11.764952] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T17:49:12.188084] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T17:49:12.497498] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-30T17:49:13.297498] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-30T17:49:14.080593] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T17:49:14.081729] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-30T17:49:14.097444] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-30T17:49:14.897497] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-30T17:49:15.702701] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-30T17:49:15.723225] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-30T17:49:16.226345] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T17:49:16.311094] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T17:49:16.497539] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-30T17:49:17.297537] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-30T17:49:17.893208] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-30T17:49:18.097507] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-30T17:49:18.535510] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T17:49:18.536083] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-30T17:49:18.546969] [INFO ] [REMOTE ] CAL: Full fetch complete (61605 records). [2025-10-30T17:49:18.547094] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-30T17:49:18.547872] [FATAL] [VALIDATOR ] CAL: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:49:18.547963] [FATAL] [MAIN ] CAL: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:49:18.548049] [WARN ] [MAIN ] CAL: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:49:18.548125] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-30T17:49:18.548189] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-30T17:49:18.548226] [INFO ] [LOCAL ] CAL: Starting deletion of derivative data. [2025-10-30T17:49:18.548434] [DEBUG] [LOCAL ] CAL: Deleted derivative data file. [2025-10-30T17:49:18.548983] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CAL took 46.9s. Estimated remaining: 4h 8m 6s. Rate: 8.0 symbols/min [2025-10-30T17:49:18.726032] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:49:18.762700] [DEBUG] [LOCAL ] CARS: Loaded 39477 existing records from primary storage. [2025-10-30T17:49:18.762973] [INFO ] [MAIN ] CARS: Loaded 39477 existing records. [2025-10-30T17:49:18.902679] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-30T17:49:18.939516] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:49:18.939875] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-30T17:49:18.939925] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-30T17:49:18.940292] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-30T17:49:18.940347] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-30T17:49:19.284777] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:49:19.359056] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T17:49:19.697535] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-30T17:49:20.497514] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-30T17:49:21.025225] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T17:49:21.297540] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-30T17:49:21.594053] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T17:49:22.097516] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-30T17:49:22.647942] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T17:49:22.681106] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T17:49:22.897516] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-30T17:49:23.697458] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-30T17:49:23.915623] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T17:49:24.230257] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T17:49:24.497555] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-30T17:49:25.045216] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T17:49:25.050135] [INFO ] [REMOTE ] CAPL: Full fetch complete (8724 records). [2025-10-30T17:49:25.050243] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-30T17:49:25.302724] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-30T17:49:25.424570] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-30T17:49:25.424674] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-30T17:49:25.424904] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-30T17:49:25.424965] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-30T17:49:25.425387] [DEBUG] [LOCAL ] CAPL: Trimmed 8724 records to 5310 (keeping 200 days of data) [2025-10-30T17:49:25.456683] [DEBUG] [LOCAL ] CAPL: Primary data saved (5310 records). [2025-10-30T17:49:25.456844] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-30T17:49:25.456920] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CAPL took 24.8s. Estimated remaining: 4h 7m 55s. Rate: 8.0 symbols/min [2025-10-30T17:49:25.623294] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:49:25.672580] [DEBUG] [LOCAL ] CAT: Loaded 52901 existing records from primary storage. [2025-10-30T17:49:25.672945] [INFO ] [MAIN ] CAT: Loaded 52901 existing records. [2025-10-30T17:49:25.857415] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:49:25.858513] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-30T17:49:25.858574] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-30T17:49:25.859739] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-30T17:49:25.859801] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-30T17:49:26.102637] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-30T17:49:26.220043] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:49:26.897474] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-30T17:49:26.967548] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-30T17:49:27.323265] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T17:49:27.697499] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-30T17:49:27.899842] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T17:49:28.497513] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-30T17:49:29.097296] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T17:49:29.297511] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-30T17:49:30.097479] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-30T17:49:30.285635] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-30T17:49:30.684785] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T17:49:30.868996] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-30T17:49:30.897496] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-30T17:49:31.697524] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-30T17:49:32.497536] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-30T17:49:32.767107] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-30T17:49:32.779367] [INFO ] [REMOTE ] CARR: Full fetch complete (77770 records). [2025-10-30T17:49:32.779519] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-30T17:49:33.119793] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T17:49:33.156122] [INFO ] [REMOTE ] CANG: Full fetch complete (39003 records). [2025-10-30T17:49:33.158188] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-30T17:49:33.239158] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-30T17:49:33.265903] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-30T17:49:33.278298] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-30T17:49:33.298728] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-30T17:49:33.290018] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-30T17:49:33.380760] [DEBUG] [LOCAL ] CARR: Trimmed 77770 records to 53991 (keeping 200 days of data) [2025-10-30T17:49:33.718038] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-30T17:49:33.718124] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-30T17:49:33.718753] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-30T17:49:33.718847] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-30T17:49:33.817567] [DEBUG] [LOCAL ] CANG: Trimmed 39003 records to 27266 (keeping 200 days of data) [2025-10-30T17:49:34.034998] [DEBUG] [LOCAL ] CARR: Primary data saved (53991 records). [2025-10-30T17:49:34.035200] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-30T17:49:34.043613] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CARR took 29.3s. Estimated remaining: 4h 7m 53s. Rate: 8.0 symbols/min [2025-10-30T17:49:34.122380] [DEBUG] [LOCAL ] CANG: Primary data saved (27266 records). [2025-10-30T17:49:34.162155] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-30T17:49:34.190621] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CANG took 35.1s. Estimated remaining: 4h 7m 8s. Rate: 8.0 symbols/min [2025-10-30T17:49:34.336364] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:49:34.486990] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:49:34.492515] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-30T17:49:34.497205] [DEBUG] [LOCAL ] CATO: Loaded 6626 existing records from primary storage. [2025-10-30T17:49:34.507607] [INFO ] [MAIN ] CATO: Loaded 6626 existing records. [2025-10-30T17:49:34.508745] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-30T17:49:34.636136] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T17:49:34.747396] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:49:34.747747] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-30T17:49:34.747860] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-30T17:49:34.764751] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-30T17:49:34.764845] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-30T17:49:34.764682] [DEBUG] [LOCAL ] CAVA: Loaded 53532 existing records from primary storage. [2025-10-30T17:49:34.807776] [INFO ] [MAIN ] CAVA: Loaded 53532 existing records. [2025-10-30T17:49:34.920301] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-30T17:49:35.242206] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:49:35.254578] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-30T17:49:35.259793] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-30T17:49:35.307321] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-30T17:49:35.312954] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-30T17:49:35.312884] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:49:35.661355] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:49:35.697452] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-30T17:49:36.497485] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-30T17:49:36.699194] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-30T17:49:37.092409] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-30T17:49:37.297472] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-30T17:49:37.409719] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-30T17:49:37.537623] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-10-30T17:49:38.097518] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-30T17:49:38.423071] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T17:49:38.897503] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-30T17:49:39.697526] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-30T17:49:40.220892] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-30T17:49:40.232831] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-30T17:49:40.497471] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-30T17:49:40.591479] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-30T17:49:41.056216] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T17:49:41.297512] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-30T17:49:42.097500] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-30T17:49:42.597001] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T17:49:42.897502] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-30T17:49:43.187773] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-30T17:49:43.697499] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-30T17:49:44.132189] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-30T17:49:44.497514] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-30T17:49:44.572313] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-30T17:49:45.297515] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-30T17:49:45.825034] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T17:49:46.097511] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-30T17:49:46.850556] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-30T17:49:46.897521] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-30T17:49:47.697482] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-30T17:49:47.731113] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-30T17:49:48.289316] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-30T17:49:48.497477] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-30T17:49:48.719067] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-30T17:49:49.297529] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-30T17:49:50.097458] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-30T17:49:50.578632] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-30T17:49:50.596477] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-30T17:49:50.897463] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-30T17:49:50.977612] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-30T17:49:51.697508] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-30T17:49:52.454357] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T17:49:52.497474] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-30T17:49:52.564557] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T17:49:53.297515] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-30T17:49:54.097474] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-30T17:49:54.348751] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-30T17:49:54.897486] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-30T17:49:55.162596] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-30T17:49:55.424762] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-30T17:49:55.426152] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T17:49:55.437817] [INFO ] [REMOTE ] CARS: Full fetch complete (56822 records). [2025-10-30T17:49:55.437930] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-30T17:49:55.702778] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-30T17:49:55.843863] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-30T17:49:55.843943] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-30T17:49:55.844711] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-30T17:49:55.844777] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-30T17:49:55.845959] [DEBUG] [LOCAL ] CARS: Trimmed 56822 records to 39754 (keeping 200 days of data) [2025-10-30T17:49:56.071733] [DEBUG] [LOCAL ] CARS: Primary data saved (39754 records). [2025-10-30T17:49:56.071866] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-30T17:49:56.072449] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CARS took 37.5s. Estimated remaining: 4h 8m 12s. Rate: 7.9 symbols/min [2025-10-30T17:49:56.243221] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:49:56.286744] [DEBUG] [LOCAL ] CB: Loaded 49898 existing records from primary storage. [2025-10-30T17:49:56.287052] [INFO ] [MAIN ] CB: Loaded 49898 existing records. [2025-10-30T17:49:56.471471] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:49:56.471729] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-30T17:49:56.471783] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-30T17:49:56.472295] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-30T17:49:56.472350] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-30T17:49:56.503120] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-30T17:49:56.828078] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:49:56.968342] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-30T17:49:57.297496] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-30T17:49:57.543132] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-30T17:49:57.556916] [INFO ] [REMOTE ] CAT: Full fetch complete (76863 records). [2025-10-30T17:49:57.557072] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-30T17:49:57.923322] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-30T17:49:57.940745] [INFO ] [REMOTE ] CATO: Full fetch complete (10573 records). [2025-10-30T17:49:57.966612] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-30T17:49:58.106973] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-30T17:49:58.119687] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-30T17:49:58.119842] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-30T17:49:58.126041] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-30T17:49:58.126202] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-30T17:49:58.199981] [DEBUG] [LOCAL ] CAT: Trimmed 76863 records to 53290 (keeping 200 days of data) [2025-10-30T17:49:58.571155] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-30T17:49:58.573520] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-30T17:49:58.573857] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-30T17:49:58.573959] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-30T17:49:58.631604] [DEBUG] [LOCAL ] CATO: Trimmed 10573 records to 6674 (keeping 200 days of data) [2025-10-30T17:49:58.724907] [DEBUG] [LOCAL ] CATO: Primary data saved (6674 records). [2025-10-30T17:49:58.726705] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-30T17:49:58.727048] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CATO took 24.7s. Estimated remaining: 4h 7m 40s. Rate: 7.9 symbols/min [2025-10-30T17:49:58.821022] [DEBUG] [LOCAL ] CAT: Primary data saved (53290 records). [2025-10-30T17:49:58.821150] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-30T17:49:58.821903] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CAT took 33.4s. Estimated remaining: 4h 6m 56s. Rate: 8.0 symbols/min [2025-10-30T17:49:58.897461] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-30T17:49:59.490943] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-30T17:49:59.697483] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-30T17:50:01.252443] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-30T17:50:01.264709] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-30T17:50:01.474606] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-30T17:50:01.484811] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-30T17:50:03.554064] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-30T17:50:03.565757] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-30T17:50:03.978504] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-30T17:50:03.989393] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-30T17:50:05.756592] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-30T17:50:05.767858] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-30T17:50:06.096113] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-30T17:50:06.107245] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-30T17:50:07.412770] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T17:50:07.426513] [INFO ] [REMOTE ] CAVA: Full fetch complete (77482 records). [2025-10-30T17:50:07.426810] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-30T17:50:07.825443] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-30T17:50:07.825708] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-30T17:50:07.826609] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-30T17:50:07.836847] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-30T17:50:07.856951] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-30T17:50:07.867014] [DEBUG] [LOCAL ] CAVA: Trimmed 77482 records to 53922 (keeping 200 days of data) [2025-10-30T17:50:07.868636] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-30T17:50:08.173519] [DEBUG] [LOCAL ] CAVA: Primary data saved (53922 records). [2025-10-30T17:50:08.173668] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-30T17:50:08.173762] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CAVA took 34.0s. Estimated remaining: 4h 6m 58s. Rate: 8.0 symbols/min [2025-10-30T17:50:09.207260] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T17:50:09.217378] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-30T17:50:10.990853] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-30T17:50:11.002160] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-30T17:50:12.144825] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T17:50:12.156312] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-30T17:50:13.793471] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-30T17:50:13.806048] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-30T17:50:16.295080] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-30T17:50:16.306251] [INFO ] [REMOTE ] CB: Full fetch complete (72839 records). [2025-10-30T17:50:16.306408] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-30T17:50:16.684238] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-30T17:50:16.684312] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-30T17:50:16.685061] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-30T17:50:16.685127] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-30T17:50:16.686457] [DEBUG] [LOCAL ] CB: Trimmed 72839 records to 50283 (keeping 200 days of data) [2025-10-30T17:50:16.993239] [DEBUG] [LOCAL ] CB: Primary data saved (50283 records). [2025-10-30T17:50:16.993392] [INFO ] [MAIN ] CB: Full history saved. [2025-10-30T17:50:16.994013] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CB took 20.9s. Estimated remaining: 4h 6m 56s. Rate: 8.0 symbols/min [2025-10-30T17:50:17.714076] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:17.680007] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:17.792870] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:17.790778] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:17.793770] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-30T17:50:17.793825] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-30T17:50:17.793933] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-30T17:50:17.793975] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-30T17:50:17.794015] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-30T17:50:17.794047] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-30T17:50:17.897449] [DEBUG] [LOCAL ] CBNA: Loaded 2764 existing records from primary storage. [2025-10-30T17:50:17.897838] [DEBUG] [LOCAL ] CBAN: Loaded 9961 existing records from primary storage. [2025-10-30T17:50:17.903355] [INFO ] [MAIN ] CBNA: Loaded 2764 existing records. [2025-10-30T17:50:17.908686] [INFO ] [MAIN ] CBAN: Loaded 9961 existing records. [2025-10-30T17:50:18.020496] [DEBUG] [LOCAL ] CBL: Loaded 15560 existing records from primary storage. [2025-10-30T17:50:18.070540] [INFO ] [MAIN ] CBL: Loaded 15560 existing records. [2025-10-30T17:50:18.612681] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:18.629406] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:18.640182] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-30T17:50:18.653474] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-30T17:50:18.686817] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-30T17:50:18.653635] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-30T17:50:18.717068] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-30T17:50:18.717271] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-30T17:50:18.717233] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-30T17:50:18.718343] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-30T17:50:18.716978] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:18.723962] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-30T17:50:18.855005] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-30T17:50:18.869141] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-30T17:50:18.879582] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-30T17:50:19.079917] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:19.127154] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-30T17:50:19.449604] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:50:19.565124] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-30T17:50:19.667910] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:50:19.717703] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-30T17:50:19.737198] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:50:19.768324] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-30T17:50:19.914480] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:19.899950] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-30T17:50:19.928211] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-30T17:50:19.960103] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:19.998417] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-30T17:50:20.017265] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-30T17:50:20.021259] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-30T17:50:20.021050] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:20.022191] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBO took 3.0s. Estimated remaining: 4h 6m 27s. Rate: 8.0 symbols/min [2025-10-30T17:50:20.022715] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-30T17:50:20.196612] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:20.243983] [DEBUG] [LOCAL ] CBRE: Loaded 50224 existing records from primary storage. [2025-10-30T17:50:20.244337] [INFO ] [MAIN ] CBRE: Loaded 50224 existing records. [2025-10-30T17:50:20.426997] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:20.427324] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-30T17:50:20.427394] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-30T17:50:20.427734] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-30T17:50:20.427792] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-30T17:50:20.547365] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T17:50:20.569793] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-30T17:50:20.798017] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-30T17:50:20.822922] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-30T17:50:20.860219] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:20.861025] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-30T17:50:20.975785] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T17:50:20.976406] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T17:50:20.981788] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-30T17:50:20.984220] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-30T17:50:21.225848] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-30T17:50:21.227308] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-30T17:50:21.493218] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T17:50:21.496525] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-30T17:50:21.520073] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-30T17:50:21.521597] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-30T17:50:21.658171] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-30T17:50:21.663020] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-30T17:50:21.952172] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-30T17:50:21.954264] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-30T17:50:22.182600] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T17:50:22.187259] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-30T17:50:22.285824] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-30T17:50:22.288106] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-30T17:50:22.364312] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T17:50:22.369077] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-30T17:50:22.488455] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-30T17:50:22.517840] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-30T17:50:22.754091] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-30T17:50:22.897479] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-30T17:50:23.039947] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-30T17:50:23.697500] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-30T17:50:24.127339] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:50:24.361374] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T17:50:24.497557] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-30T17:50:25.081635] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T17:50:25.297506] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-30T17:50:26.001090] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T17:50:26.097516] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-30T17:50:26.897501] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-30T17:50:27.421244] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-30T17:50:27.449629] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T17:50:27.697507] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-30T17:50:28.173451] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-30T17:50:28.497501] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-30T17:50:29.079538] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T17:50:29.297503] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-30T17:50:29.799172] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T17:50:30.097495] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-30T17:50:30.799147] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-30T17:50:30.897499] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-30T17:50:31.691361] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T17:50:31.697447] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-30T17:50:32.226001] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T17:50:32.497494] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-30T17:50:33.247217] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-30T17:50:33.249905] [INFO ] [REMOTE ] CBAN: Full fetch complete (16389 records). [2025-10-30T17:50:33.249978] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-30T17:50:33.307435] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-30T17:50:33.651167] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-30T17:50:33.651248] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-30T17:50:33.651611] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-30T17:50:33.651677] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-30T17:50:33.652186] [DEBUG] [LOCAL ] CBAN: Trimmed 16389 records to 10021 (keeping 200 days of data) [2025-10-30T17:50:33.710233] [DEBUG] [LOCAL ] CBAN: Primary data saved (10021 records). [2025-10-30T17:50:33.710363] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-30T17:50:33.710443] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBAN took 16.7s. Estimated remaining: 4h 6m 49s. Rate: 8.0 symbols/min [2025-10-30T17:50:33.873968] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:33.903105] [DEBUG] [LOCAL ] CBT: Loaded 30424 existing records from primary storage. [2025-10-30T17:50:33.903384] [INFO ] [MAIN ] CBT: Loaded 30424 existing records. [2025-10-30T17:50:34.080145] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:34.080364] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-30T17:50:34.080414] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-30T17:50:34.080669] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-30T17:50:34.080726] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-30T17:50:34.102721] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-30T17:50:34.427099] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:34.764260] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-30T17:50:34.768351] [INFO ] [REMOTE ] CBL: Full fetch complete (24371 records). [2025-10-30T17:50:34.768482] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-30T17:50:34.899690] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-30T17:50:34.903007] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-30T17:50:35.193151] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-30T17:50:35.193256] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-30T17:50:35.193736] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-30T17:50:35.193796] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-30T17:50:35.194367] [DEBUG] [LOCAL ] CBL: Trimmed 24371 records to 15628 (keeping 200 days of data) [2025-10-30T17:50:35.285126] [DEBUG] [LOCAL ] CBL: Primary data saved (15628 records). [2025-10-30T17:50:35.285252] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-30T17:50:35.285329] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBL took 18.3s. Estimated remaining: 4h 6m 13s. Rate: 8.0 symbols/min [2025-10-30T17:50:35.458858] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:35.479061] [DEBUG] [LOCAL ] CBU: Loaded 22228 existing records from primary storage. [2025-10-30T17:50:35.479301] [INFO ] [MAIN ] CBU: Loaded 22228 existing records. [2025-10-30T17:50:35.654435] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:35.654633] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-30T17:50:35.654717] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-30T17:50:35.655043] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-30T17:50:35.655101] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-30T17:50:35.708477] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-30T17:50:36.011585] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:36.065762] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T17:50:36.164608] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T17:50:36.497491] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-30T17:50:37.297495] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-30T17:50:37.647139] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-30T17:50:37.869826] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T17:50:38.097502] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-30T17:50:38.491986] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-30T17:50:38.492986] [INFO ] [REMOTE ] CBNA: Full fetch complete (4172 records). [2025-10-30T17:50:38.493057] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-30T17:50:38.878781] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-30T17:50:38.878874] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-30T17:50:38.879018] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-30T17:50:38.879058] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-30T17:50:38.879450] [DEBUG] [LOCAL ] CBNA: Trimmed 4172 records to 2767 (keeping 200 days of data) [2025-10-30T17:50:38.895955] [DEBUG] [LOCAL ] CBNA: Primary data saved (2767 records). [2025-10-30T17:50:38.896081] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-30T17:50:38.896171] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBNA took 21.9s. Estimated remaining: 4h 5m 46s. Rate: 8.0 symbols/min [2025-10-30T17:50:38.907476] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-30T17:50:39.079861] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:39.080027] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-30T17:50:39.080071] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-30T17:50:39.080207] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-30T17:50:39.080315] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-30T17:50:39.080384] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-30T17:50:39.080430] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-30T17:50:39.462401] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:39.697498] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-30T17:50:39.982363] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:50:39.985739] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-30T17:50:39.985664] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T17:50:39.985912] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:50:39.993053] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-30T17:50:39.993121] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:50:39.993168] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-30T17:50:39.993224] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-30T17:50:39.993259] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-30T17:50:39.993297] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-30T17:50:39.993338] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CBX took 1.1s. Estimated remaining: 4h 5m 8s. Rate: 8.0 symbols/min [2025-10-30T17:50:40.192579] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:40.224220] [DEBUG] [LOCAL ] CBZ: Loaded 34340 existing records from primary storage. [2025-10-30T17:50:40.224488] [INFO ] [MAIN ] CBZ: Loaded 34340 existing records. [2025-10-30T17:50:40.413077] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:40.413277] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-30T17:50:40.413327] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-30T17:50:40.413746] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-30T17:50:40.413806] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-30T17:50:40.502699] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-30T17:50:40.772912] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:41.297483] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-30T17:50:41.406272] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T17:50:42.097472] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-30T17:50:42.264726] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T17:50:42.902695] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-30T17:50:42.914513] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T17:50:43.697546] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-30T17:50:44.077032] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T17:50:44.497525] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-30T17:50:44.555566] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-30T17:50:45.297498] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-30T17:50:45.473485] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T17:50:46.042498] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T17:50:46.097488] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-30T17:50:46.897469] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-30T17:50:46.962147] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T17:50:47.697588] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-30T17:50:48.159403] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T17:50:48.497471] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-30T17:50:48.574953] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-30T17:50:49.297501] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-30T17:50:49.660113] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T17:50:50.097567] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-30T17:50:50.381369] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T17:50:50.897551] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-30T17:50:51.011183] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T17:50:51.697471] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-30T17:50:51.776202] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-30T17:50:52.412084] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-30T17:50:52.497497] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-30T17:50:53.297500] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-30T17:50:53.852505] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-30T17:50:54.097578] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-30T17:50:54.234575] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-30T17:50:54.897520] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-30T17:50:54.990350] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T17:50:55.538965] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T17:50:55.697539] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-30T17:50:56.497517] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-30T17:50:56.587377] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T17:50:57.297490] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-30T17:50:57.915829] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T17:50:57.927438] [INFO ] [REMOTE ] CBRE: Full fetch complete (73706 records). [2025-10-30T17:50:57.927596] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-30T17:50:58.109423] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-30T17:50:58.339202] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-30T17:50:58.339468] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-30T17:50:58.340471] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-30T17:50:58.340671] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-30T17:50:58.342344] [DEBUG] [LOCAL ] CBRE: Trimmed 73706 records to 50598 (keeping 200 days of data) [2025-10-30T17:50:58.490108] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T17:50:58.683130] [DEBUG] [LOCAL ] CBRE: Primary data saved (50598 records). [2025-10-30T17:50:58.683266] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-30T17:50:58.683992] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBRE took 38.7s. Estimated remaining: 4h 5m 54s. Rate: 8.0 symbols/min [2025-10-30T17:50:58.864526] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:50:58.897471] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-30T17:50:58.915419] [DEBUG] [LOCAL ] CC: Loaded 52957 existing records from primary storage. [2025-10-30T17:50:58.915750] [INFO ] [MAIN ] CC: Loaded 52957 existing records. [2025-10-30T17:50:59.100777] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:50:59.101146] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-30T17:50:59.101333] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-30T17:50:59.108665] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-30T17:50:59.108755] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-30T17:50:59.226004] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T17:50:59.493043] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:50:59.610397] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-30T17:50:59.697507] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-30T17:51:00.497531] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-30T17:51:01.158084] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T17:51:01.297596] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-30T17:51:02.097553] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-30T17:51:02.543633] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T17:51:02.565257] [INFO ] [REMOTE ] CBT: Full fetch complete (45696 records). [2025-10-30T17:51:02.565459] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-30T17:51:02.567002] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-30T17:51:02.910012] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-30T17:51:02.964072] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-30T17:51:02.964184] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-30T17:51:02.965013] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-30T17:51:02.965079] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-30T17:51:02.966109] [DEBUG] [LOCAL ] CBT: Trimmed 45696 records to 30675 (keeping 200 days of data) [2025-10-30T17:51:03.156844] [DEBUG] [LOCAL ] CBT: Primary data saved (30675 records). [2025-10-30T17:51:03.157099] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-30T17:51:03.157280] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBT took 29.4s. Estimated remaining: 4h 5m 32s. Rate: 8.0 symbols/min [2025-10-30T17:51:03.331899] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T17:51:03.373215] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:51:03.429053] [DEBUG] [LOCAL ] CCI: Loaded 53099 existing records from primary storage. [2025-10-30T17:51:03.429431] [INFO ] [MAIN ] CCI: Loaded 53099 existing records. [2025-10-30T17:51:03.621537] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:51:03.621778] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-30T17:51:03.621829] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-30T17:51:03.622287] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-30T17:51:03.622326] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-30T17:51:03.702736] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-30T17:51:03.971171] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:51:04.164843] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T17:51:04.497500] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-30T17:51:04.765236] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T17:51:05.297539] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-30T17:51:06.063433] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-30T17:51:06.097493] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-30T17:51:06.098487] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T17:51:06.897541] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-30T17:51:07.422725] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T17:51:07.697494] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-30T17:51:07.836180] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T17:51:07.841890] [INFO ] [REMOTE ] CBU: Full fetch complete (32619 records). [2025-10-30T17:51:07.842035] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-30T17:51:08.266728] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-30T17:51:08.266840] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-30T17:51:08.267634] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-30T17:51:08.267729] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-30T17:51:08.268870] [DEBUG] [LOCAL ] CBU: Trimmed 32619 records to 22387 (keeping 200 days of data) [2025-10-30T17:51:08.416906] [DEBUG] [LOCAL ] CBU: Primary data saved (22387 records). [2025-10-30T17:51:08.417075] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-30T17:51:08.417176] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CBU took 33.1s. Estimated remaining: 4h 5m 13s. Rate: 8.0 symbols/min [2025-10-30T17:51:08.502682] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-30T17:51:08.614252] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:51:08.614595] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-30T17:51:08.614702] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-30T17:51:08.614846] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-30T17:51:08.614888] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-30T17:51:08.614931] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-30T17:51:08.614965] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-30T17:51:08.997716] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:51:09.027555] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T17:51:09.036751] [INFO ] [REMOTE ] CBZ: Full fetch complete (47100 records). [2025-10-30T17:51:09.036943] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-30T17:51:09.302783] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-30T17:51:09.493322] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-30T17:51:09.493468] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-30T17:51:09.494447] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-30T17:51:09.494521] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-30T17:51:09.496108] [DEBUG] [LOCAL ] CBZ: Trimmed 47100 records to 34683 (keeping 200 days of data) [2025-10-30T17:51:09.709850] [DEBUG] [LOCAL ] CBZ: Primary data saved (34683 records). [2025-10-30T17:51:09.710061] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-30T17:51:09.710182] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CBZ took 29.7s. Estimated remaining: 4h 4m 36s. Rate: 8.0 symbols/min [2025-10-30T17:51:09.898487] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:51:09.916422] [DEBUG] [LOCAL ] CCIF: Loaded 15065 existing records from primary storage. [2025-10-30T17:51:09.916797] [INFO ] [MAIN ] CCIF: Loaded 15065 existing records. [2025-10-30T17:51:10.107890] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-30T17:51:10.111166] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:51:10.112084] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-30T17:51:10.113314] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-30T17:51:10.113616] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-30T17:51:10.113708] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-30T17:51:10.282061] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-30T17:51:10.599012] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:51:10.619924] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-30T17:51:10.648052] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T17:51:10.897551] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-30T17:51:11.697533] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-30T17:51:11.945727] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-30T17:51:12.282733] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T17:51:12.497516] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-30T17:51:13.297578] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-30T17:51:13.560599] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-30T17:51:13.838993] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T17:51:14.097521] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-30T17:51:14.351209] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-30T17:51:14.897549] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-30T17:51:15.187501] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-30T17:51:15.697492] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-30T17:51:16.497559] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-30T17:51:17.269824] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-30T17:51:17.290591] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T17:51:17.297445] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-30T17:51:17.833991] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-30T17:51:18.097489] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-30T17:51:18.897505] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-30T17:51:19.392534] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T17:51:19.697501] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-30T17:51:20.195412] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T17:51:20.223218] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T17:51:20.497499] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-30T17:51:21.055879] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-30T17:51:21.297522] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-30T17:51:21.984614] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T17:51:22.097522] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-30T17:51:22.461327] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-30T17:51:22.897508] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-30T17:51:23.697554] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-30T17:51:23.955678] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-30T17:51:24.304543] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T17:51:24.497533] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-30T17:51:24.766706] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-30T17:51:25.297499] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-30T17:51:25.584079] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-30T17:51:26.097500] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-30T17:51:26.897553] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-30T17:51:27.621541] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-30T17:51:27.697470] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-30T17:51:27.744227] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-30T17:51:28.147026] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-30T17:51:28.148173] [INFO ] [REMOTE ] CCIA: Full fetch complete (2196 records). [2025-10-30T17:51:28.148244] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-30T17:51:28.333963] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-30T17:51:28.334153] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:51:28.334222] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:51:28.334295] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-30T17:51:28.334379] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-30T17:51:28.334435] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-30T17:51:28.334480] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-30T17:51:28.334547] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CCIA took 19.9s. Estimated remaining: 4h 5m 22s. Rate: 8.0 symbols/min [2025-10-30T17:51:28.504049] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-30T17:51:28.507694] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:51:28.559250] [DEBUG] [LOCAL ] CCJ: Loaded 53691 existing records from primary storage. [2025-10-30T17:51:28.559561] [INFO ] [MAIN ] CCJ: Loaded 53691 existing records. [2025-10-30T17:51:28.740125] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:51:28.740335] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-30T17:51:28.740421] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-30T17:51:28.741110] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-30T17:51:28.741169] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-30T17:51:29.127519] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:51:29.297513] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-30T17:51:30.007343] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T17:51:30.097512] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-30T17:51:30.897490] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-30T17:51:30.992852] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T17:51:31.454408] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T17:51:31.543990] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T17:51:31.697488] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-30T17:51:32.497564] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-30T17:51:33.095912] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T17:51:33.297533] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-30T17:51:33.937515] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T17:51:34.097507] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-30T17:51:34.620178] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T17:51:34.682146] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T17:51:34.897479] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-30T17:51:35.697470] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-30T17:51:35.758719] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T17:51:36.497480] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-30T17:51:37.267081] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T17:51:37.297457] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-30T17:51:37.990810] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T17:51:38.097525] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-30T17:51:38.897547] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-30T17:51:38.940235] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-30T17:51:39.238393] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T17:51:39.241559] [INFO ] [REMOTE ] CCIF: Full fetch complete (21758 records). [2025-10-30T17:51:39.241630] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-30T17:51:39.242068] [FATAL] [VALIDATOR ] CCIF: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:51:39.242147] [FATAL] [MAIN ] CCIF: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:51:39.242208] [WARN ] [MAIN ] CCIF: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:51:39.242248] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-30T17:51:39.242302] [DEBUG] [LOCAL ] CCIF: No primary data file found to delete. [2025-10-30T17:51:39.242345] [INFO ] [LOCAL ] CCIF: Starting deletion of derivative data. [2025-10-30T17:51:39.242543] [DEBUG] [LOCAL ] CCIF: Deleted derivative data file. [2025-10-30T17:51:39.242626] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CCIF took 29.5s. Estimated remaining: 4h 5m 30s. Rate: 8.0 symbols/min [2025-10-30T17:51:39.407676] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:51:39.447343] [DEBUG] [LOCAL ] CCK: Loaded 46467 existing records from primary storage. [2025-10-30T17:51:39.447638] [INFO ] [MAIN ] CCK: Loaded 46467 existing records. [2025-10-30T17:51:39.623573] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:51:39.623794] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-30T17:51:39.623841] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-30T17:51:39.624209] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-30T17:51:39.624266] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-30T17:51:39.702572] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-30T17:51:39.980991] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:51:40.403165] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T17:51:40.414485] [INFO ] [REMOTE ] CC: Full fetch complete (75848 records). [2025-10-30T17:51:40.414676] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-30T17:51:40.415450] [FATAL] [VALIDATOR ] CC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:51:40.415536] [FATAL] [MAIN ] CC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:51:40.415579] [WARN ] [MAIN ] CC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:51:40.415669] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-30T17:51:40.415748] [DEBUG] [LOCAL ] CC: No primary data file found to delete. [2025-10-30T17:51:40.415784] [INFO ] [LOCAL ] CC: Starting deletion of derivative data. [2025-10-30T17:51:40.415967] [DEBUG] [LOCAL ] CC: Deleted derivative data file. [2025-10-30T17:51:40.416059] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CC took 41.7s. Estimated remaining: 4h 4m 53s. Rate: 8.0 symbols/min [2025-10-30T17:51:40.506329] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-30T17:51:40.593044] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:51:40.640834] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-30T17:51:40.641151] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-30T17:51:40.814360] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:51:40.814554] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-30T17:51:40.814600] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-30T17:51:40.815076] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-30T17:51:40.815133] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-30T17:51:41.155718] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:51:41.297499] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-30T17:51:41.614920] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-30T17:51:41.940293] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T17:51:42.097510] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-30T17:51:42.897522] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-30T17:51:43.211509] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-30T17:51:43.413771] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T17:51:43.697495] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-30T17:51:44.497221] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T17:51:44.508245] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-30T17:51:44.511183] [INFO ] [REMOTE ] CCI: Full fetch complete (77097 records). [2025-10-30T17:51:44.511389] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-30T17:51:44.950599] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-30T17:51:44.950750] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-30T17:51:44.951690] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-30T17:51:44.951857] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-30T17:51:44.953508] [DEBUG] [LOCAL ] CCI: Trimmed 77097 records to 53488 (keeping 200 days of data) [2025-10-30T17:51:45.076601] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-30T17:51:45.303204] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-30T17:51:45.318308] [DEBUG] [LOCAL ] CCI: Primary data saved (53488 records). [2025-10-30T17:51:45.318532] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-30T17:51:45.319432] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCI took 42.2s. Estimated remaining: 4h 4m 33s. Rate: 8.0 symbols/min [2025-10-30T17:51:45.490017] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:51:45.533333] [DEBUG] [LOCAL ] CCO: Loaded 48735 existing records from primary storage. [2025-10-30T17:51:45.533614] [INFO ] [MAIN ] CCO: Loaded 48735 existing records. [2025-10-30T17:51:45.709909] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:51:45.710117] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-30T17:51:45.710163] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-30T17:51:45.710600] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-30T17:51:45.710669] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-30T17:51:46.062531] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:51:46.102616] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-30T17:51:46.119361] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-30T17:51:46.897520] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-30T17:51:47.186978] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-30T17:51:47.460330] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:51:47.697528] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-30T17:51:48.389371] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-30T17:51:48.497485] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-30T17:51:49.146690] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T17:51:49.297498] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-30T17:51:50.097511] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-30T17:51:50.197343] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-30T17:51:50.897526] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-30T17:51:51.117126] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T17:51:51.602103] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-30T17:51:51.697458] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-30T17:51:51.983982] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T17:51:52.497508] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-30T17:51:53.297480] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-30T17:51:53.505928] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-30T17:51:53.536033] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T17:51:54.097502] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-30T17:51:54.463971] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T17:51:54.897540] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-30T17:51:55.127805] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T17:51:55.697491] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-30T17:51:55.958613] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T17:51:56.497471] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-30T17:51:56.869383] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T17:51:57.297492] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-30T17:51:58.097454] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-30T17:51:58.177802] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-30T17:51:58.897472] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-30T17:51:59.069322] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-30T17:51:59.251937] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T17:51:59.697525] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-30T17:52:00.497518] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-30T17:52:00.893286] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-30T17:52:01.297502] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-30T17:52:01.526425] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-30T17:52:02.095748] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-30T17:52:02.105756] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-30T17:52:02.897526] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-30T17:52:03.333003] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-30T17:52:03.344136] [INFO ] [REMOTE ] CCJ: Full fetch complete (77451 records). [2025-10-30T17:52:03.344257] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-30T17:52:03.345037] [FATAL] [VALIDATOR ] CCJ: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:52:03.345124] [FATAL] [MAIN ] CCJ: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:52:03.345168] [WARN ] [MAIN ] CCJ: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:52:03.345229] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-30T17:52:03.345285] [DEBUG] [LOCAL ] CCJ: No primary data file found to delete. [2025-10-30T17:52:03.345319] [INFO ] [LOCAL ] CCJ: Starting deletion of derivative data. [2025-10-30T17:52:03.345461] [DEBUG] [LOCAL ] CCJ: Deleted derivative data file. [2025-10-30T17:52:03.346130] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCJ took 35.0s. Estimated remaining: 4h 5m 15s. Rate: 8.0 symbols/min [2025-10-30T17:52:03.514627] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:03.554541] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-30T17:52:03.553356] [DEBUG] [LOCAL ] CCRD: Loaded 9641 existing records from primary storage. [2025-10-30T17:52:03.564454] [INFO ] [MAIN ] CCRD: Loaded 9641 existing records. [2025-10-30T17:52:03.708632] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-30T17:52:03.747639] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:52:03.747813] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-30T17:52:03.747894] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-30T17:52:03.748108] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-30T17:52:03.748167] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-30T17:52:04.102102] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:04.182889] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T17:52:04.497491] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-30T17:52:05.297516] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-30T17:52:05.401519] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T17:52:05.412029] [INFO ] [REMOTE ] CCK: Full fetch complete (68120 records). [2025-10-30T17:52:05.412162] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-30T17:52:05.825155] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-30T17:52:05.834701] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-30T17:52:05.836070] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-30T17:52:05.837261] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T17:52:05.846821] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-30T17:52:05.848940] [DEBUG] [LOCAL ] CCK: Trimmed 68120 records to 46787 (keeping 200 days of data) [2025-10-30T17:52:06.111088] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-30T17:52:06.135526] [DEBUG] [LOCAL ] CCK: Primary data saved (46787 records). [2025-10-30T17:52:06.135631] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-30T17:52:06.135741] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCK took 26.9s. Estimated remaining: 4h 4m 45s. Rate: 8.0 symbols/min [2025-10-30T17:52:06.302397] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:06.329358] [DEBUG] [LOCAL ] CCS: Loaded 29789 existing records from primary storage. [2025-10-30T17:52:06.329632] [INFO ] [MAIN ] CCS: Loaded 29789 existing records. [2025-10-30T17:52:06.503283] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:52:06.503514] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-30T17:52:06.503594] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-30T17:52:06.503918] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-30T17:52:06.503986] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-30T17:52:06.856222] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:06.897467] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-30T17:52:07.176494] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-30T17:52:07.368465] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T17:52:07.697494] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-30T17:52:07.923285] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T17:52:08.497492] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-30T17:52:09.297484] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-30T17:52:09.403966] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-30T17:52:09.915497] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T17:52:10.078358] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-30T17:52:10.097457] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-30T17:52:10.897506] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-30T17:52:11.076972] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T17:52:11.697504] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-30T17:52:12.404711] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T17:52:12.415298] [INFO ] [REMOTE ] CCO: Full fetch complete (67550 records). [2025-10-30T17:52:12.415411] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-30T17:52:12.507529] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-30T17:52:12.799980] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-30T17:52:12.800070] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-30T17:52:12.800968] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-30T17:52:12.801032] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-30T17:52:12.802395] [DEBUG] [LOCAL ] CCO: Trimmed 67550 records to 49070 (keeping 200 days of data) [2025-10-30T17:52:13.070874] [DEBUG] [LOCAL ] CCO: Primary data saved (49070 records). [2025-10-30T17:52:13.071003] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-30T17:52:13.071864] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCO took 27.8s. Estimated remaining: 4h 4m 35s. Rate: 8.0 symbols/min [2025-10-30T17:52:13.241891] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:13.261423] [DEBUG] [LOCAL ] CCU: Loaded 20856 existing records from primary storage. [2025-10-30T17:52:13.261673] [INFO ] [MAIN ] CCU: Loaded 20856 existing records. [2025-10-30T17:52:13.303636] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-30T17:52:13.444114] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:52:13.444421] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-30T17:52:13.444487] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-30T17:52:13.444921] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-30T17:52:13.445054] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-30T17:52:13.622719] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-30T17:52:13.896517] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:13.899900] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-30T17:52:13.993607] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T17:52:14.097525] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-30T17:52:14.897471] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-30T17:52:15.041763] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T17:52:15.642216] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T17:52:15.697471] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-30T17:52:16.109828] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T17:52:16.497495] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-30T17:52:17.002730] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T17:52:17.297525] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-30T17:52:18.097501] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-30T17:52:18.859244] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-30T17:52:18.897545] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-30T17:52:19.240149] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-30T17:52:19.253476] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-30T17:52:19.253727] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-30T17:52:19.644295] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-30T17:52:19.644448] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-30T17:52:19.645550] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-30T17:52:19.645674] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-30T17:52:19.647374] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 54190 (keeping 200 days of data) [2025-10-30T17:52:19.701956] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-30T17:52:19.897899] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T17:52:20.010173] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-10-30T17:52:20.010315] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-30T17:52:20.011059] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCL took 39.6s. Estimated remaining: 4h 4m 24s. Rate: 8.0 symbols/min [2025-10-30T17:52:20.178149] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:20.178337] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-30T17:52:20.178374] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-30T17:52:20.178483] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-30T17:52:20.178524] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-30T17:52:20.178566] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-30T17:52:20.178599] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-30T17:52:20.501678] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-30T17:52:20.525785] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:20.883552] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T17:52:21.297479] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-30T17:52:21.426447] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T17:52:22.097455] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-30T17:52:22.170369] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T17:52:22.588608] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T17:52:22.897501] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-30T17:52:23.688797] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-30T17:52:23.697446] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-30T17:52:24.445187] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T17:52:24.497536] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-30T17:52:25.297474] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-30T17:52:25.360216] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-30T17:52:26.029703] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T17:52:26.097480] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-30T17:52:26.737122] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-30T17:52:26.897536] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-30T17:52:27.501757] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-30T17:52:27.697582] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-30T17:52:28.497479] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-30T17:52:28.658954] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T17:52:29.220734] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T17:52:29.297456] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-30T17:52:30.097466] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-30T17:52:30.195574] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-30T17:52:30.199700] [INFO ] [REMOTE ] CCU: Full fetch complete (32122 records). [2025-10-30T17:52:30.199774] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-30T17:52:30.563884] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-30T17:52:30.564062] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-30T17:52:30.564671] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-30T17:52:30.564751] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-30T17:52:30.574689] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-30T17:52:30.577896] [DEBUG] [LOCAL ] CCU: Trimmed 32122 records to 20999 (keeping 200 days of data) [2025-10-30T17:52:30.697020] [DEBUG] [LOCAL ] CCU: Primary data saved (20999 records). [2025-10-30T17:52:30.697139] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-30T17:52:30.697216] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCU took 17.6s. Estimated remaining: 4h 4m 32s. Rate: 8.0 symbols/min [2025-10-30T17:52:30.861858] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:30.897624] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-30T17:52:30.915315] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-30T17:52:30.915681] [INFO ] [MAIN ] CDE: Loaded 53644 existing records. [2025-10-30T17:52:31.095905] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:52:31.096187] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-30T17:52:31.096249] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-30T17:52:31.096845] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-30T17:52:31.096906] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-30T17:52:31.462884] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:31.617590] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T17:52:31.697464] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-30T17:52:32.266106] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T17:52:32.497538] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-30T17:52:32.554787] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-30T17:52:32.555103] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-01 [2025-10-30T17:52:32.555190] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:52:32.555236] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-30T17:52:32.555271] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:52:32.555336] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-30T17:52:32.555441] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-30T17:52:32.555483] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-30T17:52:32.555524] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-30T17:52:32.555570] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCZ took 12.5s. Estimated remaining: 4h 3m 58s. Rate: 8.0 symbols/min [2025-10-30T17:52:32.731153] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:32.742772] [DEBUG] [LOCAL ] CDLR: Loaded 10165 existing records from primary storage. [2025-10-30T17:52:32.742997] [INFO ] [MAIN ] CDLR: Loaded 10165 existing records. [2025-10-30T17:52:32.927550] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:52:32.927786] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-30T17:52:32.927840] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-30T17:52:32.928042] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-30T17:52:32.928083] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-30T17:52:33.307728] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-30T17:52:33.313003] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:34.010484] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T17:52:34.097570] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-30T17:52:34.635340] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-30T17:52:34.637885] [INFO ] [REMOTE ] CCRD: Full fetch complete (11779 records). [2025-10-30T17:52:34.638004] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-30T17:52:34.902693] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-30T17:52:35.041516] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-30T17:52:35.041592] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-30T17:52:35.041896] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-30T17:52:35.041957] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-30T17:52:35.042432] [DEBUG] [LOCAL ] CCRD: Trimmed 11779 records to 9726 (keeping 200 days of data) [2025-10-30T17:52:35.097997] [DEBUG] [LOCAL ] CCRD: Primary data saved (9726 records). [2025-10-30T17:52:35.098117] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-30T17:52:35.098195] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CCRD took 31.8s. Estimated remaining: 4h 3m 27s. Rate: 8.0 symbols/min [2025-10-30T17:52:35.280009] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:35.280246] [DEBUG] [LOCAL ] CDP: No existing data file found in primary storage. [2025-10-30T17:52:35.280296] [WARN ] [MAIN ] CDP: No existing data found, performing full refresh instead. [2025-10-30T17:52:35.280405] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-30T17:52:35.280447] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-30T17:52:35.280490] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-10-30T17:52:35.280525] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-30T17:52:35.640842] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T17:52:35.644577] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:35.697498] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-30T17:52:36.497525] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-30T17:52:36.781586] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-30T17:52:36.788190] [INFO ] [REMOTE ] CCS: Full fetch complete (44781 records). [2025-10-30T17:52:36.788351] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-30T17:52:36.973214] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-30T17:52:37.191888] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-30T17:52:37.191971] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-30T17:52:37.192519] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-30T17:52:37.192558] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-30T17:52:37.193531] [DEBUG] [LOCAL ] CCS: Trimmed 44781 records to 29960 (keeping 200 days of data) [2025-10-30T17:52:37.305805] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-30T17:52:37.381402] [DEBUG] [LOCAL ] CCS: Primary data saved (29960 records). [2025-10-30T17:52:37.381561] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-30T17:52:37.381668] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CCS took 31.2s. Estimated remaining: 4h 2m 55s. Rate: 8.0 symbols/min [2025-10-30T17:52:37.562290] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:37.584146] [DEBUG] [LOCAL ] CDRE: Loaded 24381 existing records from primary storage. [2025-10-30T17:52:37.584416] [INFO ] [MAIN ] CDRE: Loaded 24381 existing records. [2025-10-30T17:52:37.766830] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:52:37.767048] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-30T17:52:37.767098] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-30T17:52:37.767327] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-30T17:52:37.767382] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-30T17:52:38.099551] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-30T17:52:38.123940] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:38.545900] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T17:52:38.897513] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-30T17:52:39.508428] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T17:52:39.697506] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-30T17:52:39.766617] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-30T17:52:40.497481] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-30T17:52:40.608533] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T17:52:41.108056] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T17:52:41.297525] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-30T17:52:41.894831] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T17:52:42.097494] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-30T17:52:42.897489] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-30T17:52:42.978122] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-30T17:52:43.697512] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-30T17:52:44.231374] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T17:52:44.497563] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-30T17:52:44.958959] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-30T17:52:45.287968] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-30T17:52:45.297576] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-30T17:52:46.097462] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-30T17:52:46.252061] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T17:52:46.745785] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T17:52:46.897491] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-30T17:52:47.697466] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-30T17:52:47.754909] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-30T17:52:48.497493] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-30T17:52:49.124144] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T17:52:49.297478] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-30T17:52:49.611352] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T17:52:50.097479] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-30T17:52:50.178249] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T17:52:50.669683] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-30T17:52:50.897490] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-30T17:52:51.608867] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T17:52:51.697490] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-30T17:52:52.497498] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-30T17:52:52.730078] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T17:52:53.292997] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T17:52:53.301398] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-30T17:52:54.097504] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-30T17:52:54.353581] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T17:52:54.802846] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:52:54.897519] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-30T17:52:55.697507] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-30T17:52:55.995107] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T17:52:56.205476] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-30T17:52:56.497547] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-30T17:52:57.297526] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-30T17:52:57.396207] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-30T17:52:57.402180] [INFO ] [REMOTE ] CDRE: Full fetch complete (34840 records). [2025-10-30T17:52:57.402350] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-30T17:52:57.805026] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-30T17:52:57.805136] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-30T17:52:57.805943] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-30T17:52:57.806012] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-30T17:52:57.807174] [DEBUG] [LOCAL ] CDRE: Trimmed 34840 records to 24525 (keeping 200 days of data) [2025-10-30T17:52:57.958427] [DEBUG] [LOCAL ] CDRE: Primary data saved (24525 records). [2025-10-30T17:52:57.958565] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-30T17:52:57.958669] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDRE took 20.6s. Estimated remaining: 4h 3m 48s. Rate: 8.0 symbols/min [2025-10-30T17:52:58.110970] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-30T17:52:58.144924] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:52:58.190589] [DEBUG] [LOCAL ] CE: Loaded 51118 existing records from primary storage. [2025-10-30T17:52:58.190936] [INFO ] [MAIN ] CE: Loaded 51118 existing records. [2025-10-30T17:52:58.374099] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:52:58.374320] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-30T17:52:58.374369] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-30T17:52:58.374895] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-30T17:52:58.374953] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-30T17:52:58.726206] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:52:58.766571] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T17:52:58.897539] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-30T17:52:59.249243] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T17:52:59.697497] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-30T17:53:00.332428] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T17:53:00.497504] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-30T17:53:01.206218] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T17:53:01.297488] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-30T17:53:02.097496] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-30T17:53:02.328855] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-30T17:53:02.603795] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T17:53:02.614284] [INFO ] [REMOTE ] CDP: Full fetch complete (62213 records). [2025-10-30T17:53:02.614528] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-30T17:53:02.902680] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-30T17:53:03.031206] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-30T17:53:03.031327] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-30T17:53:03.032428] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-30T17:53:03.032528] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-30T17:53:03.034324] [DEBUG] [LOCAL ] CDP: Trimmed 62213 records to 42455 (keeping 200 days of data) [2025-10-30T17:53:03.291445] [DEBUG] [LOCAL ] CDP: Primary data saved (42455 records). [2025-10-30T17:53:03.291570] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-30T17:53:03.291660] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDP took 28.2s. Estimated remaining: 4h 3m 31s. Rate: 8.0 symbols/min [2025-10-30T17:53:03.469061] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:03.475315] [DEBUG] [LOCAL ] CEE: Loaded 4818 existing records from primary storage. [2025-10-30T17:53:03.475487] [INFO ] [MAIN ] CEE: Loaded 4818 existing records. [2025-10-30T17:53:03.665693] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:53:03.692053] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-30T17:53:03.693155] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T17:53:03.697546] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-30T17:53:03.693286] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-30T17:53:03.697879] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-30T17:53:03.709108] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-30T17:53:03.709754] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-30T17:53:04.071997] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:04.269250] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-30T17:53:04.497484] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-30T17:53:05.297498] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-30T17:53:05.677935] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T17:53:06.001939] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-30T17:53:06.005569] [INFO ] [REMOTE ] CDLR: Full fetch complete (14536 records). [2025-10-30T17:53:06.005673] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-30T17:53:06.105791] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-30T17:53:06.377928] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-30T17:53:06.378006] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-30T17:53:06.378345] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-30T17:53:06.378386] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-30T17:53:06.378951] [DEBUG] [LOCAL ] CDLR: Trimmed 14536 records to 10285 (keeping 200 days of data) [2025-10-30T17:53:06.443031] [DEBUG] [LOCAL ] CDLR: Primary data saved (10285 records). [2025-10-30T17:53:06.443169] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-30T17:53:06.443248] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CDLR took 33.9s. Estimated remaining: 4h 3m 3s. Rate: 8.0 symbols/min [2025-10-30T17:53:06.616711] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:06.616909] [DEBUG] [LOCAL ] CEPU: No existing data file found in primary storage. [2025-10-30T17:53:06.616947] [WARN ] [MAIN ] CEPU: No existing data found, performing full refresh instead. [2025-10-30T17:53:06.617057] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-30T17:53:06.617101] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-30T17:53:06.617142] [DEBUG] [LOCAL ] CEPU: No primary data file found to delete. [2025-10-30T17:53:06.617217] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-30T17:53:06.902719] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-30T17:53:06.971797] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:07.515954] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T17:53:07.697508] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-30T17:53:08.339745] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T17:53:08.497499] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-30T17:53:08.934599] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-30T17:53:09.170610] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-30T17:53:09.297514] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-30T17:53:10.097506] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-30T17:53:10.691214] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T17:53:10.897509] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-30T17:53:11.148232] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T17:53:11.697506] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-30T17:53:12.257506] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T17:53:12.403059] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-30T17:53:12.497513] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-30T17:53:13.297553] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-30T17:53:13.935968] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-30T17:53:14.097586] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-30T17:53:14.139399] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-30T17:53:14.592790] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T17:53:14.897573] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-30T17:53:15.697749] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-30T17:53:15.700745] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T17:53:16.056624] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-30T17:53:16.497511] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-30T17:53:16.899955] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T17:53:17.297591] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-30T17:53:18.097472] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-30T17:53:18.131960] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T17:53:18.897533] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-30T17:53:19.236848] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T17:53:19.548469] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T17:53:19.697587] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-30T17:53:20.497538] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-30T17:53:20.892210] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T17:53:21.297541] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-30T17:53:22.097597] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-30T17:53:22.643154] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T17:53:22.901398] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-30T17:53:22.921492] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-30T17:53:22.934575] [INFO ] [REMOTE ] CDE: Full fetch complete (77801 records). [2025-10-30T17:53:22.934841] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-30T17:53:23.174216] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T17:53:23.401381] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-30T17:53:23.401515] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-30T17:53:23.402922] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-30T17:53:23.403050] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-30T17:53:23.405384] [DEBUG] [LOCAL ] CDE: Trimmed 77801 records to 54034 (keeping 200 days of data) [2025-10-30T17:53:23.700968] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-30T17:53:23.752229] [DEBUG] [LOCAL ] CDE: Primary data saved (54034 records). [2025-10-30T17:53:23.752446] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-30T17:53:23.753536] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CDE took 53.1s. Estimated remaining: 4h 3m 40s. Rate: 8.0 symbols/min [2025-10-30T17:53:23.977267] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:24.033291] [DEBUG] [LOCAL ] CF: Loaded 52010 existing records from primary storage. [2025-10-30T17:53:24.033773] [INFO ] [MAIN ] CF: Loaded 52010 existing records. [2025-10-30T17:53:24.248274] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:53:24.249580] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-30T17:53:24.253445] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-30T17:53:24.254157] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-30T17:53:24.255431] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-30T17:53:24.255567] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-30T17:53:24.516731] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-30T17:53:24.624254] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-30T17:53:24.741663] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:25.297540] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-30T17:53:25.560362] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T17:53:26.097526] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-30T17:53:26.852495] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:53:26.897525] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-30T17:53:27.584681] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T17:53:27.695376] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T17:53:27.706168] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-30T17:53:27.708541] [INFO ] [REMOTE ] CE: Full fetch complete (74722 records). [2025-10-30T17:53:27.708758] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-30T17:53:28.195544] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-30T17:53:28.195841] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-30T17:53:28.197157] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-30T17:53:28.197235] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-30T17:53:28.199378] [DEBUG] [LOCAL ] CE: Trimmed 74722 records to 51505 (keeping 200 days of data) [2025-10-30T17:53:28.501957] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-30T17:53:28.553961] [DEBUG] [LOCAL ] CE: Primary data saved (51505 records). [2025-10-30T17:53:28.554276] [INFO ] [MAIN ] CE: Full history saved. [2025-10-30T17:53:28.554423] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CE took 30.6s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-10-30T17:53:28.671450] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T17:53:28.769774] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:28.824874] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-30T17:53:28.825369] [INFO ] [MAIN ] CFG: Loaded 53622 existing records. [2025-10-30T17:53:28.942519] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-30T17:53:29.027012] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:53:29.027303] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-30T17:53:29.027358] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-30T17:53:29.027943] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-30T17:53:29.028003] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-30T17:53:29.302744] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-30T17:53:29.462936] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:30.097541] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-30T17:53:30.663585] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T17:53:30.905011] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-30T17:53:30.910052] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-30T17:53:31.697580] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-30T17:53:32.464195] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T17:53:32.497543] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-30T17:53:32.690106] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T17:53:33.297508] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-30T17:53:33.925355] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T17:53:33.942381] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-30T17:53:33.944294] [INFO ] [REMOTE ] CEE: Full fetch complete (9883 records). [2025-10-30T17:53:33.944408] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-30T17:53:34.102735] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-30T17:53:34.343497] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-30T17:53:34.343620] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-30T17:53:34.344092] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-30T17:53:34.344157] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-30T17:53:34.344685] [DEBUG] [LOCAL ] CEE: Trimmed 9883 records to 4835 (keeping 200 days of data) [2025-10-30T17:53:34.374302] [DEBUG] [LOCAL ] CEE: Primary data saved (4835 records). [2025-10-30T17:53:34.374471] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-30T17:53:34.374573] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CEE took 31.1s. Estimated remaining: 4h 3m 5s. Rate: 8.0 symbols/min [2025-10-30T17:53:34.551338] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:34.551603] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-30T17:53:34.551722] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-30T17:53:34.551818] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-30T17:53:34.551859] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-30T17:53:34.551903] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-30T17:53:34.551940] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-30T17:53:34.898301] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-30T17:53:34.925201] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:35.367132] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T17:53:35.375728] [INFO ] [REMOTE ] CEPU: Full fetch complete (39936 records). [2025-10-30T17:53:35.375908] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-30T17:53:35.702769] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-30T17:53:35.781825] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-30T17:53:35.781927] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-30T17:53:35.782776] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-30T17:53:35.782842] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-30T17:53:35.784021] [DEBUG] [LOCAL ] CEPU: Trimmed 39936 records to 27692 (keeping 200 days of data) [2025-10-30T17:53:35.894690] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:53:35.896917] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-30T17:53:35.897905] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:53:35.898585] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-30T17:53:35.899568] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:53:35.899707] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-30T17:53:35.900695] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-30T17:53:35.901564] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-30T17:53:35.901926] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-30T17:53:35.902603] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CFND took 1.5s. Estimated remaining: 4h 2m 30s. Rate: 8.0 symbols/min [2025-10-30T17:53:36.141241] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:36.148453] [DEBUG] [LOCAL ] CEPU: Primary data saved (27692 records). [2025-10-30T17:53:36.148717] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-30T17:53:36.148868] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CEPU took 29.7s. Estimated remaining: 4h 1m 50s. Rate: 8.0 symbols/min [2025-10-30T17:53:36.347079] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:36.347425] [DEBUG] [LOCAL ] CGAU: No existing data file found in primary storage. [2025-10-30T17:53:36.347492] [WARN ] [MAIN ] CGAU: No existing data found, performing full refresh instead. [2025-10-30T17:53:36.347760] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-30T17:53:36.347825] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-30T17:53:36.347969] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-30T17:53:36.348053] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-30T17:53:36.478502] [DEBUG] [LOCAL ] CFR: Loaded 32147 existing records from primary storage. [2025-10-30T17:53:36.512271] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-30T17:53:36.534440] [INFO ] [MAIN ] CFR: Loaded 32147 existing records. [2025-10-30T17:53:36.628109] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-30T17:53:37.035423] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:53:37.043754] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:37.044191] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-30T17:53:37.044570] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-30T17:53:37.045370] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-30T17:53:37.045448] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-30T17:53:37.302742] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-30T17:53:37.429217] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:37.973588] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T17:53:38.097524] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-30T17:53:38.567856] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T17:53:38.897533] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-30T17:53:39.260679] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T17:53:39.697509] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-30T17:53:40.346624] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-30T17:53:40.497490] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-30T17:53:40.731015] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:53:41.297516] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-30T17:53:41.758686] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T17:53:42.097523] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-30T17:53:42.331042] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T17:53:42.897556] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-30T17:53:43.346739] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T17:53:43.697466] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-30T17:53:43.780067] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-30T17:53:44.497495] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-30T17:53:45.006271] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T17:53:45.297577] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-30T17:53:45.884619] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:53:46.097546] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-30T17:53:46.556306] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:53:46.897515] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-30T17:53:47.474394] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T17:53:47.697522] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-30T17:53:48.497533] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-30T17:53:48.857105] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T17:53:49.297514] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-30T17:53:49.748782] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T17:53:50.097513] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-30T17:53:50.375944] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (3.48 seconds). [2025-10-30T17:53:50.390020] [INFO ] [REMOTE ] CF: Full fetch complete (75163 records). [2025-10-30T17:53:50.390186] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-30T17:53:50.391229] [FATAL] [VALIDATOR ] CF: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:53:50.391316] [FATAL] [MAIN ] CF: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:53:50.391359] [WARN ] [MAIN ] CF: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:53:50.391398] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-30T17:53:50.391454] [DEBUG] [LOCAL ] CF: No primary data file found to delete. [2025-10-30T17:53:50.391488] [INFO ] [LOCAL ] CF: Starting deletion of derivative data. [2025-10-30T17:53:50.391707] [DEBUG] [LOCAL ] CF: Deleted derivative data file. [2025-10-30T17:53:50.392377] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CF took 26.6s. Estimated remaining: 4h 2m 13s. Rate: 8.0 symbols/min [2025-10-30T17:53:50.568349] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:53:50.598067] [DEBUG] [LOCAL ] CGV: Loaded 1298 existing records from primary storage. [2025-10-30T17:53:50.598476] [INFO ] [MAIN ] CGV: Loaded 1298 existing records. [2025-10-30T17:53:50.631936] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T17:53:50.786980] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:53:50.787174] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-30T17:53:50.787220] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-30T17:53:50.787543] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-30T17:53:50.787580] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-30T17:53:50.898579] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-30T17:53:51.169635] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:53:51.192847] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T17:53:51.697473] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-30T17:53:51.734048] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T17:53:52.497485] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-30T17:53:53.105082] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-30T17:53:53.297539] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-30T17:53:53.475392] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T17:53:53.721067] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-30T17:53:54.097499] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-30T17:53:54.897537] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-30T17:53:55.664172] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T17:53:55.697464] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-30T17:53:55.890557] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T17:53:56.497494] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-30T17:53:57.144748] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T17:53:57.297463] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-30T17:53:57.505549] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T17:53:58.097493] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-30T17:53:58.370751] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-30T17:53:58.609792] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-30T17:53:58.897486] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-30T17:53:59.697499] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-30T17:54:00.143364] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T17:54:00.497482] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-30T17:54:01.297500] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-30T17:54:01.747154] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T17:54:02.078178] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-30T17:54:02.090982] [INFO ] [REMOTE ] CFG: Full fetch complete (77392 records). [2025-10-30T17:54:02.091291] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-30T17:54:02.092462] [FATAL] [VALIDATOR ] CFG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:54:02.092952] [FATAL] [MAIN ] CFG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:54:02.093065] [WARN ] [MAIN ] CFG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:54:02.093157] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-30T17:54:02.093238] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-10-30T17:54:02.093303] [INFO ] [LOCAL ] CFG: Starting deletion of derivative data. [2025-10-30T17:54:02.093524] [DEBUG] [LOCAL ] CFG: Deleted derivative data file. [2025-10-30T17:54:02.093683] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFG took 33.5s. Estimated remaining: 4h 2m 24s. Rate: 8.0 symbols/min [2025-10-30T17:54:02.099272] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-30T17:54:02.134271] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T17:54:02.294011] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:54:02.316187] [DEBUG] [LOCAL ] CHCT: Loaded 23944 existing records from primary storage. [2025-10-30T17:54:02.316506] [INFO ] [MAIN ] CHCT: Loaded 23944 existing records. [2025-10-30T17:54:02.504889] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:54:02.505092] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-30T17:54:02.505142] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-30T17:54:02.505383] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-30T17:54:02.505440] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-30T17:54:02.873449] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:54:02.897454] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-30T17:54:03.380579] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T17:54:03.697511] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-30T17:54:03.884383] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T17:54:04.066858] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-30T17:54:04.497512] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-30T17:54:05.297503] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-30T17:54:05.551366] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-30T17:54:05.570960] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T17:54:05.578003] [INFO ] [REMOTE ] CFR: Full fetch complete (48506 records). [2025-10-30T17:54:05.578118] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-30T17:54:05.578751] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:54:05.578838] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:54:05.578880] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:54:05.578919] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-30T17:54:05.578975] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-30T17:54:05.579051] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-10-30T17:54:05.579542] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-10-30T17:54:05.579940] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CFR took 29.7s. Estimated remaining: 4h 1m 59s. Rate: 8.0 symbols/min [2025-10-30T17:54:05.798633] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:54:05.858180] [DEBUG] [LOCAL ] CHD: Loaded 52320 existing records from primary storage. [2025-10-30T17:54:05.858673] [INFO ] [MAIN ] CHD: Loaded 52320 existing records. [2025-10-30T17:54:06.044235] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:54:06.044533] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-30T17:54:06.044588] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-30T17:54:06.045164] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-30T17:54:06.045224] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-30T17:54:06.103342] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-30T17:54:06.435241] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:54:06.897558] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-30T17:54:07.055675] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T17:54:07.697519] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-30T17:54:08.127368] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-30T17:54:08.131906] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T17:54:08.497500] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-30T17:54:08.802556] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-30T17:54:09.297510] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-30T17:54:10.097544] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-30T17:54:10.683027] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-30T17:54:10.897467] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-30T17:54:10.937226] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T17:54:11.214697] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-30T17:54:11.697499] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-30T17:54:11.968941] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-30T17:54:12.497542] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-30T17:54:13.297478] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-30T17:54:13.348028] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-30T17:54:14.097497] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-30T17:54:14.559420] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T17:54:14.860788] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T17:54:14.897451] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-30T17:54:15.686462] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-30T17:54:15.697475] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-30T17:54:16.497497] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-30T17:54:16.658221] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T17:54:17.176248] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T17:54:17.177269] [INFO ] [REMOTE ] CGV: Full fetch complete (2208 records). [2025-10-30T17:54:17.177339] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-30T17:54:17.302712] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-30T17:54:17.557609] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-30T17:54:17.557727] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-30T17:54:17.557843] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-30T17:54:17.557884] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-30T17:54:17.558206] [DEBUG] [LOCAL ] CGV: Trimmed 2208 records to 1359 (keeping 200 days of data) [2025-10-30T17:54:17.566569] [DEBUG] [LOCAL ] CGV: Primary data saved (1359 records). [2025-10-30T17:54:17.566626] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-30T17:54:17.566724] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CGV took 27.2s. Estimated remaining: 4h 2m 11s. Rate: 8.0 symbols/min [2025-10-30T17:54:17.732446] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:54:17.748040] [DEBUG] [LOCAL ] CHE: Loaded 15502 existing records from primary storage. [2025-10-30T17:54:17.748260] [INFO ] [MAIN ] CHE: Loaded 15502 existing records. [2025-10-30T17:54:17.923270] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:54:17.923464] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-30T17:54:17.923511] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-30T17:54:17.923766] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-30T17:54:17.923821] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-30T17:54:18.106912] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-30T17:54:18.279692] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:54:18.311358] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T17:54:18.897529] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-30T17:54:19.551107] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T17:54:19.659755] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T17:54:19.697480] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-30T17:54:20.192217] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T17:54:20.497501] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-30T17:54:21.297505] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-30T17:54:22.097475] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-30T17:54:22.196052] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T17:54:22.207150] [INFO ] [REMOTE ] CGAU: Full fetch complete (62595 records). [2025-10-30T17:54:22.207293] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-30T17:54:22.593305] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-30T17:54:22.593401] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-30T17:54:22.594146] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-30T17:54:22.594223] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-30T17:54:22.595523] [DEBUG] [LOCAL ] CGAU: Trimmed 62595 records to 44272 (keeping 200 days of data) [2025-10-30T17:54:22.840352] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-30T17:54:22.867197] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-30T17:54:22.902989] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-30T17:54:22.919294] [DEBUG] [LOCAL ] CGAU: Primary data saved (44272 records). [2025-10-30T17:54:22.919381] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-30T17:54:22.919452] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CGAU took 46.8s. Estimated remaining: 4h 1m 54s. Rate: 8.0 symbols/min [2025-10-30T17:54:23.087339] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:54:23.127432] [DEBUG] [LOCAL ] CHGG: Loaded 47417 existing records from primary storage. [2025-10-30T17:54:23.127749] [INFO ] [MAIN ] CHGG: Loaded 47417 existing records. [2025-10-30T17:54:23.299753] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:54:23.299922] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-30T17:54:23.299967] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-30T17:54:23.300342] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-30T17:54:23.300379] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-30T17:54:23.651465] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:54:23.673381] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-30T17:54:23.697451] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-30T17:54:24.497495] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-30T17:54:25.246975] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T17:54:25.273994] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T17:54:25.297451] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-30T17:54:26.097466] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-30T17:54:26.218438] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-30T17:54:26.223975] [INFO ] [REMOTE ] CHCT: Full fetch complete (34779 records). [2025-10-30T17:54:26.224050] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-30T17:54:26.587871] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-30T17:54:26.587949] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-30T17:54:26.588415] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-30T17:54:26.588473] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-30T17:54:26.589209] [DEBUG] [LOCAL ] CHCT: Trimmed 34779 records to 24144 (keeping 200 days of data) [2025-10-30T17:54:26.727679] [DEBUG] [LOCAL ] CHCT: Primary data saved (24144 records). [2025-10-30T17:54:26.727807] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-30T17:54:26.727884] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CHCT took 24.6s. Estimated remaining: 4h 1m 30s. Rate: 8.0 symbols/min [2025-10-30T17:54:26.853024] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T17:54:26.911030] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-30T17:54:26.913787] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:54:26.946861] [DEBUG] [LOCAL ] CHH: Loaded 32025 existing records from primary storage. [2025-10-30T17:54:26.947136] [INFO ] [MAIN ] CHH: Loaded 32025 existing records. [2025-10-30T17:54:27.121426] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:54:27.121634] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-30T17:54:27.121717] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-30T17:54:27.122115] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-30T17:54:27.122172] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-30T17:54:27.481623] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:54:27.697504] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-30T17:54:28.110868] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T17:54:28.497517] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-30T17:54:28.905161] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T17:54:29.297536] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-30T17:54:29.737808] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T17:54:30.097569] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-30T17:54:30.557954] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-30T17:54:30.897471] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-30T17:54:30.954295] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T17:54:31.697510] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-30T17:54:32.137310] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T17:54:32.497534] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-30T17:54:33.083248] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T17:54:33.297473] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-30T17:54:33.370240] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T17:54:34.097535] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-30T17:54:34.754798] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T17:54:34.897532] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-30T17:54:35.620378] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T17:54:35.704882] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-30T17:54:35.710018] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-30T17:54:36.475336] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-30T17:54:36.497502] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-30T17:54:37.284328] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-30T17:54:37.297443] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-30T17:54:38.097487] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-30T17:54:38.302377] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-30T17:54:38.307687] [INFO ] [REMOTE ] CHE: Full fetch complete (20965 records). [2025-10-30T17:54:38.307773] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-30T17:54:38.716050] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-30T17:54:38.716137] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-30T17:54:38.716719] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-30T17:54:38.716827] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-30T17:54:38.717611] [DEBUG] [LOCAL ] CHE: Trimmed 20965 records to 15701 (keeping 200 days of data) [2025-10-30T17:54:38.837421] [DEBUG] [LOCAL ] CHE: Primary data saved (15701 records). [2025-10-30T17:54:38.837561] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-30T17:54:38.837668] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHE took 21.3s. Estimated remaining: 4h 1m 43s. Rate: 8.0 symbols/min [2025-10-30T17:54:38.902622] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-30T17:54:39.005959] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:54:39.025955] [DEBUG] [LOCAL ] CHMI: Loaded 20560 existing records from primary storage. [2025-10-30T17:54:39.026230] [INFO ] [MAIN ] CHMI: Loaded 20560 existing records. [2025-10-30T17:54:39.207879] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:54:39.208203] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-30T17:54:39.208291] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-30T17:54:39.208706] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-30T17:54:39.208830] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-30T17:54:39.498130] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T17:54:39.609099] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:54:39.697464] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-30T17:54:40.143467] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-30T17:54:40.497500] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-30T17:54:40.802143] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T17:54:41.297500] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-30T17:54:41.928072] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T17:54:42.027707] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T17:54:42.097483] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-30T17:54:42.897501] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-30T17:54:43.122550] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T17:54:43.616507] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T17:54:43.697461] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-30T17:54:44.497468] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-30T17:54:44.605099] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T17:54:45.297540] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-30T17:54:46.107343] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-30T17:54:46.113115] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-30T17:54:46.636353] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T17:54:46.897499] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-30T17:54:47.261987] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T17:54:47.697534] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-30T17:54:48.424789] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T17:54:48.497467] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-30T17:54:48.594151] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T17:54:49.297495] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-30T17:54:49.760616] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:54:50.097471] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-30T17:54:50.576227] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T17:54:50.897495] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-30T17:54:51.625192] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-30T17:54:51.636553] [INFO ] [REMOTE ] CHD: Full fetch complete (75024 records). [2025-10-30T17:54:51.636721] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-30T17:54:51.702727] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-30T17:54:52.046067] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-30T17:54:52.046145] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-30T17:54:52.047035] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-30T17:54:52.047098] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-30T17:54:52.048534] [DEBUG] [LOCAL ] CHD: Trimmed 75024 records to 52709 (keeping 200 days of data) [2025-10-30T17:54:52.287941] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T17:54:52.403079] [DEBUG] [LOCAL ] CHD: Primary data saved (52709 records). [2025-10-30T17:54:52.403224] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-30T17:54:52.403965] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHD took 46.8s. Estimated remaining: 4h 2m 2s. Rate: 8.0 symbols/min [2025-10-30T17:54:52.497509] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-30T17:54:52.853930] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T17:54:53.297461] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-30T17:54:53.387495] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T17:54:54.097537] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-30T17:54:54.150805] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-30T17:54:54.841439] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-30T17:54:54.897463] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-30T17:54:55.652290] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-30T17:54:55.697529] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-30T17:54:56.450977] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T17:54:56.497450] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-30T17:54:57.149850] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-30T17:54:57.297505] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-30T17:54:58.097470] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-30T17:54:58.211778] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-30T17:54:58.897500] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-30T17:54:59.572244] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T17:54:59.582612] [INFO ] [REMOTE ] CHGG: Full fetch complete (69729 records). [2025-10-30T17:54:59.582772] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-30T17:54:59.702577] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-30T17:54:59.968780] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-30T17:54:59.968968] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-30T17:54:59.969810] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-30T17:54:59.969874] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-30T17:54:59.971208] [DEBUG] [LOCAL ] CHGG: Trimmed 69729 records to 47759 (keeping 200 days of data) [2025-10-30T17:55:00.103007] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T17:55:00.116574] [INFO ] [REMOTE ] CHH: Full fetch complete (47698 records). [2025-10-30T17:55:00.116779] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-30T17:55:00.672519] [DEBUG] [LOCAL ] CHGG: Primary data saved (47759 records). [2025-10-30T17:55:00.672638] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-30T17:55:00.672790] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-30T17:55:00.673337] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHGG took 37.8s. Estimated remaining: 4h 1m 58s. Rate: 8.0 symbols/min [2025-10-30T17:55:00.673419] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-30T17:55:00.674257] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-30T17:55:00.674322] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-30T17:55:00.675479] [DEBUG] [LOCAL ] CHH: Trimmed 47698 records to 32268 (keeping 200 days of data) [2025-10-30T17:55:00.898718] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T17:55:00.923257] [DEBUG] [LOCAL ] CHH: Primary data saved (32268 records). [2025-10-30T17:55:00.923690] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-30T17:55:00.923795] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHH took 34.2s. Estimated remaining: 4h 1m 19s. Rate: 8.0 symbols/min [2025-10-30T17:55:00.924155] [INFO ] [REMOTE ] CHMI: Full fetch complete (31243 records). [2025-10-30T17:55:00.924253] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-30T17:55:01.296805] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-30T17:55:01.296886] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-30T17:55:01.297386] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-30T17:55:01.297425] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-30T17:55:01.298169] [DEBUG] [LOCAL ] CHMI: Trimmed 31243 records to 20774 (keeping 200 days of data) [2025-10-30T17:55:01.419323] [DEBUG] [LOCAL ] CHMI: Primary data saved (20774 records). [2025-10-30T17:55:01.419441] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-30T17:55:01.419516] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHMI took 22.6s. Estimated remaining: 4h 0m 40s. Rate: 8.0 symbols/min [2025-10-30T17:55:02.088477] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:02.165494] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:02.187030] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:02.169840] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:02.211951] [DEBUG] [LOCAL ] CHT: Loaded 18904 existing records from primary storage. [2025-10-30T17:55:02.212512] [INFO ] [MAIN ] CHT: Loaded 18904 existing records. [2025-10-30T17:55:02.484514] [DEBUG] [LOCAL ] CI: Loaded 49408 existing records from primary storage. [2025-10-30T17:55:02.488330] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:02.489076] [DEBUG] [LOCAL ] CHPT: Loaded 46126 existing records from primary storage. [2025-10-30T17:55:02.490452] [INFO ] [MAIN ] CHPT: Loaded 46126 existing records. [2025-10-30T17:55:02.489920] [DEBUG] [LOCAL ] CHWY: Loaded 53653 existing records from primary storage. [2025-10-30T17:55:02.490197] [INFO ] [MAIN ] CI: Loaded 49408 existing records. [2025-10-30T17:55:02.490383] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-30T17:55:02.507038] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-30T17:55:02.563241] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-30T17:55:02.563387] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-30T17:55:02.615032] [INFO ] [MAIN ] CHWY: Loaded 53653 existing records. [2025-10-30T17:55:03.143609] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:03.140775] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:03.171194] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-30T17:55:03.195622] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-30T17:55:03.207413] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-30T17:55:03.283367] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-30T17:55:03.293710] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-30T17:55:03.356350] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-30T17:55:03.365850] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:03.366443] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-30T17:55:03.362603] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-30T17:55:03.393221] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-30T17:55:03.398413] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-30T17:55:03.532452] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-30T17:55:03.537986] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:03.551993] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-30T17:55:03.589584] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-30T17:55:04.318945] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:04.359079] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-30T17:55:04.516413] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:04.534272] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-30T17:55:04.570318] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:04.570638] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-30T17:55:04.734014] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T17:55:04.737812] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-30T17:55:05.409762] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T17:55:05.413973] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-30T17:55:05.744975] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-30T17:55:05.754863] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-30T17:55:06.132238] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T17:55:06.142856] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-30T17:55:06.178319] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T17:55:06.310406] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-30T17:55:06.897477] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-30T17:55:06.981777] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T17:55:07.442101] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T17:55:07.687104] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T17:55:07.697443] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-30T17:55:08.336197] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T17:55:08.497525] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-30T17:55:09.297498] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-30T17:55:10.090525] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-30T17:55:10.100068] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-30T17:55:10.662031] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T17:55:10.682795] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-30T17:55:10.897482] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-30T17:55:11.611915] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T17:55:11.697500] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-30T17:55:12.497528] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-30T17:55:13.112025] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T17:55:13.297521] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-30T17:55:13.978826] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T17:55:14.104478] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-30T17:55:14.126511] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-30T17:55:14.897459] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-30T17:55:14.945996] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-30T17:55:15.697503] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-30T17:55:16.227955] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T17:55:16.497525] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-30T17:55:17.289178] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T17:55:17.300524] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-30T17:55:17.623712] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T17:55:18.097535] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-30T17:55:18.902623] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-30T17:55:18.917506] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T17:55:18.922502] [INFO ] [REMOTE ] CHT: Full fetch complete (27481 records). [2025-10-30T17:55:18.922727] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-30T17:55:19.075131] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-30T17:55:19.349482] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-30T17:55:19.349555] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-30T17:55:19.349999] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-30T17:55:19.350059] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-30T17:55:19.350728] [DEBUG] [LOCAL ] CHT: Trimmed 27481 records to 19010 (keeping 200 days of data) [2025-10-30T17:55:19.458292] [DEBUG] [LOCAL ] CHT: Primary data saved (19010 records). [2025-10-30T17:55:19.458419] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-30T17:55:19.458496] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CHT took 18.0s. Estimated remaining: 4h 1m 19s. Rate: 8.0 symbols/min [2025-10-30T17:55:19.623078] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:19.637773] [DEBUG] [LOCAL ] CIA: Loaded 16200 existing records from primary storage. [2025-10-30T17:55:19.637985] [INFO ] [MAIN ] CIA: Loaded 16200 existing records. [2025-10-30T17:55:19.702732] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-30T17:55:19.822133] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:19.822429] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-30T17:55:19.822490] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-30T17:55:19.823332] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-30T17:55:19.823393] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-30T17:55:20.169852] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:20.386286] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-30T17:55:20.497485] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-30T17:55:21.174124] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T17:55:21.297504] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-30T17:55:22.024109] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-30T17:55:22.097470] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-30T17:55:22.635530] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:55:22.897530] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-30T17:55:23.606160] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-30T17:55:23.697553] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-30T17:55:24.326334] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T17:55:24.384426] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T17:55:24.497538] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-30T17:55:25.297513] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-30T17:55:25.969726] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T17:55:25.998153] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T17:55:26.097535] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-30T17:55:26.897551] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-30T17:55:27.614620] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T17:55:27.697513] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-30T17:55:28.412310] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-30T17:55:28.497479] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-30T17:55:29.283851] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-30T17:55:29.298683] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-30T17:55:29.755063] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:55:29.788293] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T17:55:30.097495] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-30T17:55:30.897504] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-30T17:55:31.697479] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-30T17:55:31.783173] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-30T17:55:32.320854] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T17:55:32.331728] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-30T17:55:32.335740] [INFO ] [REMOTE ] CI: Full fetch complete (72026 records). [2025-10-30T17:55:32.336429] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-30T17:55:32.497591] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-30T17:55:32.736143] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-30T17:55:32.736238] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-30T17:55:32.737173] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-30T17:55:32.737238] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-30T17:55:32.738663] [DEBUG] [LOCAL ] CI: Trimmed 72026 records to 49798 (keeping 200 days of data) [2025-10-30T17:55:33.047609] [DEBUG] [LOCAL ] CI: Primary data saved (49798 records). [2025-10-30T17:55:33.047786] [INFO ] [MAIN ] CI: Full history saved. [2025-10-30T17:55:33.047898] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CI took 31.6s. Estimated remaining: 4h 1m 38s. Rate: 8.0 symbols/min [2025-10-30T17:55:33.229328] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:33.230877] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T17:55:33.261080] [DEBUG] [LOCAL ] CIB: Loaded 29496 existing records from primary storage. [2025-10-30T17:55:33.261359] [INFO ] [MAIN ] CIB: Loaded 29496 existing records. [2025-10-30T17:55:33.302797] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-30T17:55:33.444393] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:33.444604] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-30T17:55:33.444677] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-30T17:55:33.444996] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-30T17:55:33.445053] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-30T17:55:33.797202] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:34.097538] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-30T17:55:34.587882] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T17:55:34.897558] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-30T17:55:35.119470] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T17:55:35.697580] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-30T17:55:36.497364] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-30T17:55:36.497505] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-30T17:55:37.297466] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-30T17:55:37.596581] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-30T17:55:37.609206] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-10-30T17:55:37.609396] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-30T17:55:37.800630] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T17:55:38.068482] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-30T17:55:38.079512] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-30T17:55:38.081349] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T17:55:38.080947] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-30T17:55:38.086004] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-30T17:55:38.087693] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 54043 (keeping 200 days of data) [2025-10-30T17:55:38.138716] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-30T17:55:38.410205] [DEBUG] [LOCAL ] CHWY: Primary data saved (54043 records). [2025-10-30T17:55:38.410356] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-30T17:55:38.410467] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 37.0s. Estimated remaining: 4h 1m 21s. Rate: 8.0 symbols/min [2025-10-30T17:55:38.576832] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:38.576948] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-30T17:55:38.576984] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-30T17:55:38.577090] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-30T17:55:38.577130] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-30T17:55:38.577170] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-30T17:55:38.577212] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-30T17:55:38.920190] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-30T17:55:38.925617] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:39.405633] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T17:55:39.413596] [INFO ] [REMOTE ] CHPT: Full fetch complete (70009 records). [2025-10-30T17:55:39.413771] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-30T17:55:39.706676] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-30T17:55:39.801702] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-30T17:55:39.801912] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-30T17:55:39.808116] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-30T17:55:39.815144] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-30T17:55:39.817059] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T17:55:39.823009] [DEBUG] [LOCAL ] CHPT: Trimmed 70009 records to 46297 (keeping 200 days of data) [2025-10-30T17:55:40.086457] [DEBUG] [LOCAL ] CHPT: Primary data saved (46297 records). [2025-10-30T17:55:40.089563] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-30T17:55:40.089448] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T17:55:40.089757] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CHPT took 38.7s. Estimated remaining: 4h 0m 48s. Rate: 8.0 symbols/min [2025-10-30T17:55:40.255765] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:40.302297] [DEBUG] [LOCAL ] CIEN: Loaded 52064 existing records from primary storage. [2025-10-30T17:55:40.302589] [INFO ] [MAIN ] CIEN: Loaded 52064 existing records. [2025-10-30T17:55:40.478079] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:40.478282] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-30T17:55:40.478329] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-30T17:55:40.478787] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-30T17:55:40.478851] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-30T17:55:40.507218] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-30T17:55:40.824953] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:41.246238] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T17:55:41.297522] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-30T17:55:42.097469] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-30T17:55:42.181553] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T17:55:42.897500] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-30T17:55:43.476464] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-30T17:55:43.697514] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-30T17:55:43.968808] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T17:55:44.497492] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-30T17:55:45.144828] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T17:55:45.297494] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-30T17:55:45.807322] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T17:55:46.097460] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-30T17:55:46.109094] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T17:55:46.112185] [INFO ] [REMOTE ] CIA: Full fetch complete (23091 records). [2025-10-30T17:55:46.112258] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-30T17:55:46.399112] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T17:55:46.479795] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-30T17:55:46.479868] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-30T17:55:46.480286] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-30T17:55:46.480328] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-30T17:55:46.480981] [DEBUG] [LOCAL ] CIA: Trimmed 23091 records to 16251 (keeping 200 days of data) [2025-10-30T17:55:46.566411] [DEBUG] [LOCAL ] CIA: Primary data saved (16251 records). [2025-10-30T17:55:46.566540] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-30T17:55:46.566618] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CIA took 27.1s. Estimated remaining: 4h 0m 36s. Rate: 8.0 symbols/min [2025-10-30T17:55:46.737489] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:46.742672] [DEBUG] [LOCAL ] CIF: Loaded 3816 existing records from primary storage. [2025-10-30T17:55:46.742835] [INFO ] [MAIN ] CIF: Loaded 3816 existing records. [2025-10-30T17:55:46.898355] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-30T17:55:46.920114] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:46.920370] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-30T17:55:46.920439] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-30T17:55:46.920588] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-30T17:55:46.920666] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-30T17:55:47.210940] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-30T17:55:47.287161] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:47.697492] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-30T17:55:47.993384] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-30T17:55:48.497499] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-30T17:55:48.845454] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-30T17:55:49.297499] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-30T17:55:49.597261] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-30T17:55:50.097527] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-30T17:55:50.412300] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-30T17:55:50.897556] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-30T17:55:51.697514] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-30T17:55:51.740402] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-30T17:55:52.497550] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-30T17:55:53.019516] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T17:55:53.055094] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T17:55:53.297491] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-30T17:55:53.770434] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T17:55:54.097496] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-30T17:55:54.897479] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-30T17:55:54.939465] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T17:55:55.115748] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-30T17:55:55.697502] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-30T17:55:56.497472] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-30T17:55:56.648416] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-30T17:55:56.724864] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-30T17:55:57.297504] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-30T17:55:57.669527] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-30T17:55:57.670666] [INFO ] [REMOTE ] CICB: Full fetch complete (1912 records). [2025-10-30T17:55:57.670745] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-30T17:55:57.887566] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-30T17:55:57.887776] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:55:57.887843] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:55:57.887915] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-30T17:55:57.888024] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-30T17:55:57.888084] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-30T17:55:57.888126] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-30T17:55:57.888182] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CICB took 19.5s. Estimated remaining: 4h 0m 45s. Rate: 8.0 symbols/min [2025-10-30T17:55:58.056762] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:55:58.094508] [DEBUG] [LOCAL ] CIG: Loaded 44650 existing records from primary storage. [2025-10-30T17:55:58.094841] [INFO ] [MAIN ] CIG: Loaded 44650 existing records. [2025-10-30T17:55:58.105598] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-30T17:55:58.275505] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:55:58.275749] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-30T17:55:58.275800] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-30T17:55:58.276260] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-30T17:55:58.276336] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-30T17:55:58.629133] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:55:58.897496] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-30T17:55:59.703686] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-30T17:55:59.723093] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-30T17:56:00.126050] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T17:56:00.497501] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-30T17:56:00.739504] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T17:56:01.061097] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T17:56:01.297501] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-30T17:56:01.771887] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T17:56:02.097491] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-30T17:56:02.551112] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T17:56:02.897489] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-30T17:56:03.697508] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-30T17:56:03.769461] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T17:56:04.084769] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-30T17:56:04.497519] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-30T17:56:04.952587] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T17:56:05.297510] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-30T17:56:05.705157] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-30T17:56:06.097715] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-30T17:56:06.897510] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-30T17:56:07.359505] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-30T17:56:07.434873] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T17:56:07.697517] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-30T17:56:08.497549] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-30T17:56:08.894714] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T17:56:09.287006] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T17:56:09.297448] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-30T17:56:10.097581] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-30T17:56:10.549627] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T17:56:10.897568] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-30T17:56:11.471172] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T17:56:11.697542] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-30T17:56:11.896555] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T17:56:12.497524] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-30T17:56:13.037293] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T17:56:13.038135] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-30T17:56:13.047553] [INFO ] [REMOTE ] CIF: Full fetch complete (6545 records). [2025-10-30T17:56:13.047727] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-30T17:56:13.048085] [INFO ] [REMOTE ] CIB: Full fetch complete (45359 records). [2025-10-30T17:56:13.083687] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-30T17:56:13.305794] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-30T17:56:13.809469] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-30T17:56:13.809863] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-30T17:56:13.810182] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-30T17:56:13.820813] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-30T17:56:13.874636] [DEBUG] [LOCAL ] CIF: Trimmed 6545 records to 3857 (keeping 200 days of data) [2025-10-30T17:56:13.909546] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-30T17:56:13.918332] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-30T17:56:13.921370] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-30T17:56:13.921476] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-30T17:56:13.934945] [DEBUG] [LOCAL ] CIF: Primary data saved (3857 records). [2025-10-30T17:56:13.935311] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-30T17:56:13.935563] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CIF took 27.4s. Estimated remaining: 4h 1m 14s. Rate: 8.0 symbols/min [2025-10-30T17:56:13.948145] [DEBUG] [LOCAL ] CIB: Trimmed 45359 records to 29671 (keeping 200 days of data) [2025-10-30T17:56:14.101770] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-30T17:56:14.245204] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:14.315138] [DEBUG] [LOCAL ] CIB: Primary data saved (29671 records). [2025-10-30T17:56:14.315626] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-30T17:56:14.315773] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CIB took 41.3s. Estimated remaining: 4h 0m 36s. Rate: 8.0 symbols/min [2025-10-30T17:56:14.315538] [DEBUG] [LOCAL ] CII: Loaded 14581 existing records from primary storage. [2025-10-30T17:56:14.337213] [INFO ] [MAIN ] CII: Loaded 14581 existing records. [2025-10-30T17:56:14.700435] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:56:14.677330] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:14.700756] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-30T17:56:14.701219] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-30T17:56:14.701451] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-30T17:56:14.701587] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-30T17:56:14.980490] [DEBUG] [LOCAL ] CIM: Loaded 36841 existing records from primary storage. [2025-10-30T17:56:15.053788] [INFO ] [MAIN ] CIM: Loaded 36841 existing records. [2025-10-30T17:56:15.078046] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-30T17:56:15.205549] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-30T17:56:15.346444] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:15.343592] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:56:15.347267] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-30T17:56:15.347416] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-30T17:56:15.357870] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-30T17:56:15.372573] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-30T17:56:15.450182] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T17:56:15.702733] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-30T17:56:15.762038] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:16.497529] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-30T17:56:16.834995] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-30T17:56:17.277085] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-30T17:56:17.297485] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-30T17:56:17.381905] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T17:56:18.097527] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-30T17:56:18.412149] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T17:56:18.897498] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-30T17:56:19.220995] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T17:56:19.697497] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-30T17:56:20.008500] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T17:56:20.497534] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-30T17:56:20.685385] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T17:56:21.297514] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-30T17:56:21.690564] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T17:56:21.812477] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T17:56:22.097504] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-30T17:56:22.724214] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T17:56:22.897535] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-30T17:56:23.697540] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-30T17:56:23.947638] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-30T17:56:24.497519] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-30T17:56:25.297508] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-30T17:56:25.368243] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T17:56:25.383379] [INFO ] [REMOTE ] CIEN: Full fetch complete (75840 records). [2025-10-30T17:56:25.383688] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-30T17:56:25.769299] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-30T17:56:25.769523] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-30T17:56:25.770429] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-30T17:56:25.770492] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-30T17:56:25.771913] [DEBUG] [LOCAL ] CIEN: Trimmed 75840 records to 52438 (keeping 200 days of data) [2025-10-30T17:56:26.009168] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T17:56:26.049478] [INFO ] [REMOTE ] CIG: Full fetch complete (62676 records). [2025-10-30T17:56:26.049721] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-30T17:56:26.081474] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T17:56:26.087797] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:56:26.103891] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:56:26.103770] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-30T17:56:26.104286] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-30T17:56:26.126634] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-30T17:56:26.126493] [DEBUG] [LOCAL ] CIEN: Primary data saved (52438 records). [2025-10-30T17:56:26.126878] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-30T17:56:26.126813] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-30T17:56:26.127841] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CIEN took 46.0s. Estimated remaining: 4h 0m 46s. Rate: 8.0 symbols/min [2025-10-30T17:56:26.148787] [DEBUG] [LOCAL ] CIG: Deleted derivative data file. [2025-10-30T17:56:26.160817] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIG took 28.3s. Estimated remaining: 4h 0m 7s. Rate: 8.0 symbols/min [2025-10-30T17:56:26.439831] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:26.486072] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:26.486682] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-30T17:56:26.486993] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-30T17:56:26.487243] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-30T17:56:26.487427] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-30T17:56:26.487573] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-30T17:56:26.487817] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-30T17:56:26.566766] [DEBUG] [LOCAL ] CIMN: Loaded 2641 existing records from primary storage. [2025-10-30T17:56:26.583154] [INFO ] [MAIN ] CIMN: Loaded 2641 existing records. [2025-10-30T17:56:26.838281] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T17:56:26.948347] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-30T17:56:27.068422] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:56:27.099465] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-30T17:56:27.099314] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:27.099710] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-30T17:56:27.100190] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-30T17:56:27.100279] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-30T17:56:27.219896] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-30T17:56:27.520776] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:27.697507] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-30T17:56:28.071360] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T17:56:28.101878] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-30T17:56:28.497542] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-30T17:56:29.297555] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-30T17:56:29.651326] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T17:56:30.097483] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-30T17:56:30.201962] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T17:56:30.532635] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-30T17:56:30.897539] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-30T17:56:31.482146] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-30T17:56:31.697504] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-30T17:56:32.019145] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-30T17:56:32.497506] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-30T17:56:33.129948] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T17:56:33.297492] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-30T17:56:33.720723] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T17:56:34.097529] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-30T17:56:34.897463] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-30T17:56:35.095107] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T17:56:35.131432] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-30T17:56:35.697533] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-30T17:56:35.978739] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-30T17:56:36.497503] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-30T17:56:37.297509] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-30T17:56:37.600349] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T17:56:37.713260] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-30T17:56:38.097500] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-30T17:56:38.897513] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-30T17:56:39.081715] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T17:56:39.433162] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T17:56:39.697574] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-30T17:56:40.497527] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-30T17:56:40.853472] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-30T17:56:41.053144] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T17:56:41.062392] [INFO ] [REMOTE ] CIM: Full fetch complete (54821 records). [2025-10-30T17:56:41.062541] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-30T17:56:41.302776] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-30T17:56:41.471214] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-30T17:56:41.471327] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-30T17:56:41.472246] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-30T17:56:41.472316] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-30T17:56:41.474177] [DEBUG] [LOCAL ] CIM: Trimmed 54821 records to 37228 (keeping 200 days of data) [2025-10-30T17:56:41.716082] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-30T17:56:41.729193] [DEBUG] [LOCAL ] CIM: Primary data saved (37228 records). [2025-10-30T17:56:41.729423] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-30T17:56:41.729533] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIM took 27.4s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min [2025-10-30T17:56:41.928536] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:41.928800] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-30T17:56:41.928856] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-30T17:56:41.928970] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-30T17:56:41.929012] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-30T17:56:41.929053] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-30T17:56:41.929087] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-30T17:56:42.102295] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-30T17:56:42.282994] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:42.507392] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-30T17:56:42.897538] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-30T17:56:43.042213] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:56:43.042686] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-30T17:56:43.042813] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:56:43.042863] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-30T17:56:43.042899] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:56:43.042942] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-30T17:56:43.043008] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-30T17:56:43.043044] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-30T17:56:43.043085] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-30T17:56:43.043142] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CIMP took 1.3s. Estimated remaining: 3h 59m 60s. Rate: 8.0 symbols/min [2025-10-30T17:56:43.215600] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:43.237385] [DEBUG] [LOCAL ] CINT: Loaded 20414 existing records from primary storage. [2025-10-30T17:56:43.237741] [INFO ] [MAIN ] CINT: Loaded 20414 existing records. [2025-10-30T17:56:43.444529] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:56:43.444847] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-30T17:56:43.444903] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-30T17:56:43.445156] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-30T17:56:43.445224] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-30T17:56:43.702768] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-30T17:56:43.874045] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:43.958698] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-30T17:56:44.497502] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-30T17:56:45.237889] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T17:56:45.297547] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-30T17:56:45.954006] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-30T17:56:46.097518] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-30T17:56:46.845853] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-30T17:56:46.850272] [INFO ] [REMOTE ] CII: Full fetch complete (22803 records). [2025-10-30T17:56:46.850375] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-30T17:56:46.905567] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-30T17:56:47.240460] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-30T17:56:47.240534] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-30T17:56:47.240965] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-30T17:56:47.241027] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-30T17:56:47.241598] [DEBUG] [LOCAL ] CII: Trimmed 22803 records to 14701 (keeping 200 days of data) [2025-10-30T17:56:47.332462] [DEBUG] [LOCAL ] CII: Primary data saved (14701 records). [2025-10-30T17:56:47.332602] [INFO ] [MAIN ] CII: Full history saved. [2025-10-30T17:56:47.332708] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CII took 33.4s. Estimated remaining: 3h 59m 39s. Rate: 8.0 symbols/min [2025-10-30T17:56:47.519706] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:47.519901] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-10-30T17:56:47.519940] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-10-30T17:56:47.520054] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-30T17:56:47.520095] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-30T17:56:47.520137] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-30T17:56:47.520169] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-30T17:56:47.707090] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-30T17:56:47.836800] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T17:56:47.919617] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:48.109915] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-30T17:56:48.497542] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-30T17:56:49.302605] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-30T17:56:49.315540] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T17:56:49.670446] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-30T17:56:50.097552] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-30T17:56:50.721244] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-30T17:56:50.897521] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-30T17:56:51.461106] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T17:56:51.697539] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-30T17:56:52.180465] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T17:56:52.497535] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-30T17:56:52.926206] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-30T17:56:52.927730] [INFO ] [REMOTE ] CIMO: Full fetch complete (4534 records). [2025-10-30T17:56:52.927802] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-30T17:56:53.114952] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T17:56:53.115239] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T17:56:53.115309] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T17:56:53.115385] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-30T17:56:53.115458] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-30T17:56:53.115495] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-30T17:56:53.115536] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-30T17:56:53.115599] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIMO took 26.9s. Estimated remaining: 3h 59m 24s. Rate: 8.0 symbols/min [2025-10-30T17:56:53.292226] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:56:53.292475] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-30T17:56:53.292514] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-30T17:56:53.292636] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-30T17:56:53.292715] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-30T17:56:53.292764] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-30T17:56:53.292798] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-30T17:56:53.303936] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-30T17:56:53.668006] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:56:53.798194] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-30T17:56:54.097513] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-30T17:56:54.897567] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-30T17:56:55.058333] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-30T17:56:55.646178] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-30T17:56:55.697480] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-30T17:56:56.489335] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-30T17:56:56.497522] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-30T17:56:57.237047] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T17:56:57.297509] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-30T17:56:58.080317] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T17:56:58.097476] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-30T17:56:58.710539] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T17:56:58.897509] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-30T17:56:59.512613] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T17:56:59.697486] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-30T17:56:59.971893] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-30T17:57:00.497488] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-30T17:57:01.191010] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T17:57:01.297482] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-30T17:57:01.928943] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T17:57:02.097554] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-30T17:57:02.897784] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T17:57:02.897985] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-30T17:57:03.574461] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T17:57:03.697471] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-30T17:57:04.456048] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T17:57:04.497518] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-30T17:57:04.874016] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T17:57:05.297515] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-30T17:57:06.034143] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T17:57:06.097478] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-30T17:57:06.897501] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-30T17:57:07.239516] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T17:57:07.246107] [INFO ] [REMOTE ] CINT: Full fetch complete (28874 records). [2025-10-30T17:57:07.246196] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-30T17:57:07.616391] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-30T17:57:07.616476] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-30T17:57:07.617021] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-30T17:57:07.617083] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-30T17:57:07.617784] [DEBUG] [LOCAL ] CINT: Trimmed 28874 records to 20550 (keeping 200 days of data) [2025-10-30T17:57:07.705160] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-30T17:57:07.733342] [DEBUG] [LOCAL ] CINT: Primary data saved (20550 records). [2025-10-30T17:57:07.734464] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-30T17:57:07.734681] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CINT took 24.7s. Estimated remaining: 3h 59m 46s. Rate: 8.0 symbols/min [2025-10-30T17:57:07.858983] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T17:57:07.934077] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:07.979784] [DEBUG] [LOCAL ] CIVI: Loaded 52636 existing records from primary storage. [2025-10-30T17:57:07.980078] [INFO ] [MAIN ] CIVI: Loaded 52636 existing records. [2025-10-30T17:57:08.155209] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T17:57:08.161040] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:08.163007] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-30T17:57:08.163071] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-30T17:57:08.164145] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-30T17:57:08.164213] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-30T17:57:08.519681] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-30T17:57:08.524314] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:09.297471] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-30T17:57:09.610689] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T17:57:10.097538] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-30T17:57:10.690311] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-30T17:57:10.888721] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-30T17:57:10.897454] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-30T17:57:11.697511] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-30T17:57:12.160850] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T17:57:12.497526] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-30T17:57:12.559140] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-30T17:57:12.565934] [INFO ] [REMOTE ] CIO: Full fetch complete (30181 records). [2025-10-30T17:57:12.566024] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-30T17:57:12.926793] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-30T17:57:12.964740] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-30T17:57:12.965018] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-30T17:57:12.965888] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-30T17:57:12.965977] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-30T17:57:12.964915] [INFO ] [REMOTE ] CIMN: Full fetch complete (3831 records). [2025-10-30T17:57:12.966149] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-30T17:57:13.056228] [DEBUG] [LOCAL ] CIO: Trimmed 30181 records to 21638 (keeping 200 days of data) [2025-10-30T17:57:13.342078] [DEBUG] [LOCAL ] CIO: Primary data saved (21638 records). [2025-10-30T17:57:13.307047] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-30T17:57:13.355979] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-30T17:57:13.366228] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CIO took 26.0s. Estimated remaining: 3h 59m 31s. Rate: 8.0 symbols/min [2025-10-30T17:57:13.672982] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-30T17:57:13.672827] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:13.673393] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-30T17:57:13.673563] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-30T17:57:13.673635] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-30T17:57:13.674530] [DEBUG] [LOCAL ] CIMN: Trimmed 3831 records to 2652 (keeping 200 days of data) [2025-10-30T17:57:13.690959] [DEBUG] [LOCAL ] CIMN: Primary data saved (2652 records). [2025-10-30T17:57:13.691063] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-30T17:57:13.691147] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CIMN took 47.6s. Estimated remaining: 3h 58m 53s. Rate: 8.0 symbols/min [2025-10-30T17:57:13.877464] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:13.896872] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-30T17:57:13.897234] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-30T17:57:14.095827] [DEBUG] [LOCAL ] CLB: Loaded 33447 existing records from primary storage. [2025-10-30T17:57:14.101048] [INFO ] [MAIN ] CLB: Loaded 33447 existing records. [2025-10-30T17:57:14.100585] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:14.101444] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-30T17:57:14.100798] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-30T17:57:14.137989] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-30T17:57:14.179267] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-30T17:57:14.198373] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-30T17:57:14.409753] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:14.511690] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-30T17:57:14.560945] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-30T17:57:14.591232] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-30T17:57:14.597413] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-30T17:57:14.817345] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:14.845369] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T17:57:14.902673] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-30T17:57:15.152785] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:15.697478] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-30T17:57:15.773562] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-30T17:57:16.325174] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T17:57:16.497554] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-30T17:57:16.609552] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T17:57:17.297987] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-30T17:57:17.299791] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T17:57:18.097524] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-30T17:57:18.131314] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T17:57:18.897583] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-30T17:57:19.425629] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T17:57:19.697540] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-30T17:57:20.135133] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T17:57:20.497469] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-30T17:57:20.616089] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-30T17:57:21.297469] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-30T17:57:21.479435] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T17:57:22.097531] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-30T17:57:22.687793] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T17:57:22.897487] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-30T17:57:23.101514] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T17:57:23.697499] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-30T17:57:24.262354] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T17:57:24.497478] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-30T17:57:24.984621] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T17:57:25.297478] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-30T17:57:25.331026] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-30T17:57:26.097507] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-30T17:57:26.823029] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-30T17:57:26.897462] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-30T17:57:27.389770] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T17:57:27.697497] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-30T17:57:28.210817] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T17:57:28.497533] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-30T17:57:28.576459] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T17:57:29.297610] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-30T17:57:29.298464] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-30T17:57:30.097554] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-30T17:57:30.706074] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T17:57:30.765313] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-30T17:57:30.897472] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-30T17:57:31.697475] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-30T17:57:32.256524] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T17:57:32.497474] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-30T17:57:33.074054] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T17:57:33.297520] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-30T17:57:33.373171] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T17:57:34.097503] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-30T17:57:34.490533] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T17:57:34.897504] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-30T17:57:35.128727] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T17:57:35.697539] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-30T17:57:36.460397] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T17:57:36.473183] [INFO ] [REMOTE ] CIVI: Full fetch complete (76087 records). [2025-10-30T17:57:36.473403] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-30T17:57:36.506913] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-30T17:57:36.884448] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T17:57:36.958622] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-30T17:57:36.958762] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-30T17:57:36.959898] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-30T17:57:36.959972] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-30T17:57:36.962234] [DEBUG] [LOCAL ] CIVI: Trimmed 76087 records to 53011 (keeping 200 days of data) [2025-10-30T17:57:37.304961] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-30T17:57:37.305228] [DEBUG] [LOCAL ] CIVI: Primary data saved (53011 records). [2025-10-30T17:57:37.306688] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-30T17:57:37.306843] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CIVI took 29.6s. Estimated remaining: 3h 59m 53s. Rate: 8.0 symbols/min [2025-10-30T17:57:37.485766] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:37.499401] [DEBUG] [LOCAL ] CLCO: Loaded 12830 existing records from primary storage. [2025-10-30T17:57:37.499668] [INFO ] [MAIN ] CLCO: Loaded 12830 existing records. [2025-10-30T17:57:37.675974] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:37.676265] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-30T17:57:37.676349] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-30T17:57:37.676752] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-30T17:57:37.676818] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-30T17:57:38.042553] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:38.083284] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-30T17:57:38.097462] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-30T17:57:38.358152] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T17:57:38.897505] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-30T17:57:39.501303] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T17:57:39.648586] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-30T17:57:39.697460] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-30T17:57:40.344536] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-30T17:57:40.497497] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-30T17:57:41.297546] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-30T17:57:42.036237] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-30T17:57:42.097457] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-30T17:57:42.144431] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-30T17:57:42.156190] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-30T17:57:42.156371] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-30T17:57:42.544577] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-30T17:57:42.544681] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-30T17:57:42.545505] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-30T17:57:42.545546] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-30T17:57:42.547037] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 54039 (keeping 200 days of data) [2025-10-30T17:57:42.858407] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-30T17:57:42.888613] [DEBUG] [LOCAL ] CL: Primary data saved (54039 records). [2025-10-30T17:57:42.889192] [INFO ] [MAIN ] CL: Full history saved. [2025-10-30T17:57:42.889294] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CL took 29.5s. Estimated remaining: 3h 59m 37s. Rate: 8.0 symbols/min [2025-10-30T17:57:42.902630] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-30T17:57:43.061708] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:43.083145] [DEBUG] [LOCAL ] CLDT: Loaded 24605 existing records from primary storage. [2025-10-30T17:57:43.083379] [INFO ] [MAIN ] CLDT: Loaded 24605 existing records. [2025-10-30T17:57:43.254857] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:43.255063] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-30T17:57:43.255139] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-30T17:57:43.255829] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-30T17:57:43.255890] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-30T17:57:43.604499] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:43.697494] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-30T17:57:44.151444] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T17:57:44.157406] [INFO ] [REMOTE ] CION: Full fetch complete (40424 records). [2025-10-30T17:57:44.157507] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-30T17:57:44.425720] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T17:57:44.502684] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-30T17:57:44.549339] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-30T17:57:44.549410] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-30T17:57:44.549969] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-30T17:57:44.550030] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-30T17:57:44.550967] [DEBUG] [LOCAL ] CION: Trimmed 40424 records to 27391 (keeping 200 days of data) [2025-10-30T17:57:44.705680] [DEBUG] [LOCAL ] CION: Primary data saved (27391 records). [2025-10-30T17:57:44.705808] [INFO ] [MAIN ] CION: Full history saved. [2025-10-30T17:57:44.705876] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CION took 51.6s. Estimated remaining: 3h 59m 6s. Rate: 8.0 symbols/min [2025-10-30T17:57:44.871022] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:44.918133] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-30T17:57:44.918452] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-30T17:57:45.090622] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:45.090873] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-30T17:57:45.090948] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-30T17:57:45.091912] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-30T17:57:45.091974] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-30T17:57:45.302636] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-30T17:57:45.449965] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:45.515441] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-30T17:57:45.943712] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T17:57:46.097510] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-30T17:57:46.604426] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-30T17:57:46.897551] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-30T17:57:47.643788] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T17:57:47.697453] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-30T17:57:48.497456] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-30T17:57:48.606830] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-30T17:57:49.297492] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-30T17:57:50.097475] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-30T17:57:50.155493] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-30T17:57:50.318699] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T17:57:50.897500] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-30T17:57:51.380437] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-30T17:57:51.388785] [INFO ] [REMOTE ] CLB: Full fetch complete (48086 records). [2025-10-30T17:57:51.388903] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-30T17:57:51.702697] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-30T17:57:51.769260] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-30T17:57:51.769338] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-30T17:57:51.769971] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-30T17:57:51.770032] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-30T17:57:51.771039] [DEBUG] [LOCAL ] CLB: Trimmed 48086 records to 33694 (keeping 200 days of data) [2025-10-30T17:57:51.966815] [DEBUG] [LOCAL ] CLB: Primary data saved (33694 records). [2025-10-30T17:57:51.966946] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-30T17:57:51.967023] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CLB took 38.3s. Estimated remaining: 3h 58m 57s. Rate: 8.0 symbols/min [2025-10-30T17:57:52.133824] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:52.158961] [DEBUG] [LOCAL ] CLH: Loaded 27380 existing records from primary storage. [2025-10-30T17:57:52.159245] [INFO ] [MAIN ] CLH: Loaded 27380 existing records. [2025-10-30T17:57:52.338948] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:52.339174] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-30T17:57:52.339235] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-30T17:57:52.339615] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-30T17:57:52.339708] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-30T17:57:52.504687] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-30T17:57:52.723935] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:52.757781] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-30T17:57:52.758770] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T17:57:53.206136] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-30T17:57:53.297466] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-30T17:57:54.026859] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T17:57:54.097497] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-30T17:57:54.897510] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-30T17:57:55.697526] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-30T17:57:56.237026] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:57:56.253470] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-30T17:57:56.497460] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-30T17:57:56.497533] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-30T17:57:57.297498] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-30T17:57:57.518260] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-30T17:57:57.522972] [INFO ] [REMOTE ] CLCO: Full fetch complete (22504 records). [2025-10-30T17:57:57.523073] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-30T17:57:57.899030] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-30T17:57:57.899182] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-30T17:57:57.899885] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-30T17:57:57.899950] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-30T17:57:57.900713] [DEBUG] [LOCAL ] CLCO: Trimmed 22504 records to 12904 (keeping 200 days of data) [2025-10-30T17:57:57.975892] [DEBUG] [LOCAL ] CLCO: Primary data saved (12904 records). [2025-10-30T17:57:57.976072] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-30T17:57:57.976167] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLCO took 20.7s. Estimated remaining: 3h 58m 43s. Rate: 8.0 symbols/min [2025-10-30T17:57:58.102707] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-30T17:57:58.150926] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:57:58.162524] [DEBUG] [LOCAL ] CLPR: Loaded 9543 existing records from primary storage. [2025-10-30T17:57:58.162866] [INFO ] [MAIN ] CLPR: Loaded 9543 existing records. [2025-10-30T17:57:58.345713] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:57:58.345932] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-30T17:57:58.345984] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-30T17:57:58.346565] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-30T17:57:58.346622] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-30T17:57:58.696403] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:57:58.897439] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-30T17:57:59.004239] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-30T17:57:59.057002] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T17:57:59.697525] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-30T17:57:59.715301] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T17:58:00.257324] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T17:58:00.497489] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-30T17:58:01.297556] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-30T17:58:01.752485] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T17:58:02.097570] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-30T17:58:02.815233] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-30T17:58:02.897481] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-30T17:58:03.251510] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-30T17:58:03.342510] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T17:58:03.697490] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-30T17:58:04.497505] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-30T17:58:04.737068] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-30T17:58:05.240527] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T17:58:05.297454] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-30T17:58:06.097513] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-30T17:58:06.482244] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T17:58:06.491754] [INFO ] [REMOTE ] CLDT: Full fetch complete (37748 records). [2025-10-30T17:58:06.492076] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-30T17:58:06.907088] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-30T17:58:07.034265] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-30T17:58:07.034359] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-30T17:58:07.035077] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-30T17:58:07.035142] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-30T17:58:07.036428] [DEBUG] [LOCAL ] CLDT: Trimmed 37748 records to 24767 (keeping 200 days of data) [2025-10-30T17:58:07.202095] [DEBUG] [LOCAL ] CLDT: Primary data saved (24767 records). [2025-10-30T17:58:07.202253] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-30T17:58:07.202343] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLDT took 24.3s. Estimated remaining: 3h 58m 43s. Rate: 8.0 symbols/min [2025-10-30T17:58:07.405966] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:58:07.463447] [DEBUG] [LOCAL ] CLS: Loaded 53546 existing records from primary storage. [2025-10-30T17:58:07.463818] [INFO ] [MAIN ] CLS: Loaded 53546 existing records. [2025-10-30T17:58:07.689857] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:58:07.690189] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-30T17:58:07.690390] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-30T17:58:07.690829] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-30T17:58:07.690956] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-30T17:58:07.703380] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-30T17:58:07.960688] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-30T17:58:08.180084] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:58:08.196045] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T17:58:08.389984] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T17:58:08.497510] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-30T17:58:09.297551] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-30T17:58:10.074913] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-30T17:58:10.097447] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-30T17:58:10.135840] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T17:58:10.897494] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-30T17:58:11.568027] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-30T17:58:11.602337] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T17:58:11.697470] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-30T17:58:12.210746] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T17:58:12.497479] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-30T17:58:13.297535] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-30T17:58:13.836038] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T17:58:14.097471] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-30T17:58:14.344725] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-30T17:58:14.861711] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T17:58:14.897470] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-30T17:58:15.697469] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-30T17:58:15.850134] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T17:58:16.497517] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-30T17:58:17.297527] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-30T17:58:17.702326] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-30T17:58:18.107441] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-30T17:58:18.109422] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T17:58:18.275204] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T17:58:18.287462] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-30T17:58:18.287639] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-30T17:58:18.673349] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-30T17:58:18.673434] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-30T17:58:18.674261] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-30T17:58:18.674327] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-30T17:58:18.675800] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54131 (keeping 200 days of data) [2025-10-30T17:58:18.897532] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-30T17:58:18.990166] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-30T17:58:18.990346] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-30T17:58:18.990458] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLF took 34.3s. Estimated remaining: 3h 58m 53s. Rate: 8.0 symbols/min [2025-10-30T17:58:19.157586] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:58:19.201432] [DEBUG] [LOCAL ] CLVT: Loaded 51848 existing records from primary storage. [2025-10-30T17:58:19.201819] [INFO ] [MAIN ] CLVT: Loaded 51848 existing records. [2025-10-30T17:58:19.375764] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:58:19.375975] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-30T17:58:19.376023] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-30T17:58:19.376553] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-30T17:58:19.376612] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-30T17:58:19.699439] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-30T17:58:19.701841] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-30T17:58:19.761788] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:58:19.852470] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-30T17:58:20.497533] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-30T17:58:21.044038] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T17:58:21.051128] [INFO ] [REMOTE ] CLH: Full fetch complete (42580 records). [2025-10-30T17:58:21.051221] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-30T17:58:21.305733] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-30T17:58:21.440481] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-30T17:58:21.440561] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-30T17:58:21.441169] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-30T17:58:21.441229] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-30T17:58:21.442160] [DEBUG] [LOCAL ] CLH: Trimmed 42580 records to 27735 (keeping 200 days of data) [2025-10-30T17:58:21.609467] [DEBUG] [LOCAL ] CLH: Primary data saved (27735 records). [2025-10-30T17:58:21.609882] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-30T17:58:21.610008] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLH took 29.6s. Estimated remaining: 3h 58m 25s. Rate: 8.0 symbols/min [2025-10-30T17:58:21.795535] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:58:21.795877] [DEBUG] [LOCAL ] CLW: No existing data file found in primary storage. [2025-10-30T17:58:21.795940] [WARN ] [MAIN ] CLW: No existing data found, performing full refresh instead. [2025-10-30T17:58:21.796075] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-30T17:58:21.796266] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-30T17:58:21.796395] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-10-30T17:58:21.796461] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-30T17:58:22.078105] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-30T17:58:22.101376] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-30T17:58:22.166605] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-30T17:58:22.240724] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:58:22.897530] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-30T17:58:23.697504] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-30T17:58:23.934277] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T17:58:23.973883] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-30T17:58:24.093593] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T17:58:24.497494] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-30T17:58:25.297540] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-30T17:58:25.430039] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T17:58:26.097515] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-30T17:58:26.885528] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-30T17:58:26.897444] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-30T17:58:27.092448] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-30T17:58:27.697516] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-30T17:58:27.746823] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-30T17:58:28.497581] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-30T17:58:28.744761] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T17:58:29.123324] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-30T17:58:29.125725] [INFO ] [REMOTE ] CLPR: Full fetch complete (15542 records). [2025-10-30T17:58:29.125801] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-30T17:58:29.305116] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-30T17:58:29.514375] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-30T17:58:29.514451] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-30T17:58:29.514835] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-30T17:58:29.514895] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-30T17:58:29.515365] [DEBUG] [LOCAL ] CLPR: Trimmed 15542 records to 9590 (keeping 200 days of data) [2025-10-30T17:58:29.568833] [DEBUG] [LOCAL ] CLPR: Primary data saved (9590 records). [2025-10-30T17:58:29.568968] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-30T17:58:29.569046] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLPR took 31.6s. Estimated remaining: 3h 58m 19s. Rate: 8.0 symbols/min [2025-10-30T17:58:29.735395] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:58:29.782454] [DEBUG] [LOCAL ] CLX: Loaded 51856 existing records from primary storage. [2025-10-30T17:58:29.782791] [INFO ] [MAIN ] CLX: Loaded 51856 existing records. [2025-10-30T17:58:29.960732] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:58:29.960959] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-30T17:58:29.961008] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-30T17:58:29.961565] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-30T17:58:29.961607] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-30T17:58:30.103271] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-30T17:58:30.329075] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:58:30.897513] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-30T17:58:31.175797] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-30T17:58:31.513749] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T17:58:31.697536] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-30T17:58:32.173493] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T17:58:32.497486] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-30T17:58:33.120283] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-30T17:58:33.195683] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T17:58:33.297482] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-30T17:58:34.097542] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-30T17:58:34.438902] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T17:58:34.897484] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-30T17:58:35.652982] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-30T17:58:35.697469] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-30T17:58:35.966116] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-30T17:58:36.497505] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-30T17:58:36.932550] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T17:58:37.273334] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T17:58:37.297454] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-30T17:58:37.903739] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T17:58:38.097483] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-30T17:58:38.897516] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-30T17:58:39.351694] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T17:58:39.697505] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-30T17:58:40.408175] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T17:58:40.497454] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-30T17:58:40.732666] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-30T17:58:41.297463] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-30T17:58:41.436542] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T17:58:41.441905] [INFO ] [REMOTE ] CLW: Full fetch complete (33508 records). [2025-10-30T17:58:41.442001] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-30T17:58:41.830062] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-30T17:58:41.830135] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-30T17:58:41.830603] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-30T17:58:41.830661] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-30T17:58:41.831367] [DEBUG] [LOCAL ] CLW: Trimmed 33508 records to 21364 (keeping 200 days of data) [2025-10-30T17:58:41.948214] [DEBUG] [LOCAL ] CLW: Primary data saved (21364 records). [2025-10-30T17:58:41.948329] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-30T17:58:41.948395] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLW took 20.3s. Estimated remaining: 3h 58m 31s. Rate: 8.0 symbols/min [2025-10-30T17:58:42.099570] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-30T17:58:42.119226] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:58:42.159992] [DEBUG] [LOCAL ] CM: Loaded 48010 existing records from primary storage. [2025-10-30T17:58:42.160269] [INFO ] [MAIN ] CM: Loaded 48010 existing records. [2025-10-30T17:58:42.336765] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:58:42.336984] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-30T17:58:42.337032] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-30T17:58:42.337409] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-30T17:58:42.337465] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-30T17:58:42.734430] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:58:42.765269] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T17:58:42.897468] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-30T17:58:43.251728] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T17:58:43.697534] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-30T17:58:43.942083] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T17:58:44.497529] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-30T17:58:45.129456] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T17:58:45.297507] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-30T17:58:45.791590] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T17:58:46.097491] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-30T17:58:46.375915] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T17:58:46.897506] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-30T17:58:47.384741] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T17:58:47.697493] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-30T17:58:48.166696] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T17:58:48.497512] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-30T17:58:49.297503] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-30T17:58:49.664524] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-30T17:58:50.069707] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T17:58:50.097462] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-30T17:58:50.587612] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T17:58:50.897529] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-30T17:58:51.317506] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T17:58:51.697499] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-30T17:58:51.831341] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T17:58:52.497493] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-30T17:58:52.990040] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T17:58:53.003717] [INFO ] [REMOTE ] CLVT: Full fetch complete (75390 records). [2025-10-30T17:58:53.003911] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-30T17:58:53.302577] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-30T17:58:53.391616] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-30T17:58:53.391740] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-30T17:58:53.392590] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-30T17:58:53.392633] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-30T17:58:53.394165] [DEBUG] [LOCAL ] CLVT: Trimmed 75390 records to 52232 (keeping 200 days of data) [2025-10-30T17:58:53.680488] [DEBUG] [LOCAL ] CLVT: Primary data saved (52232 records). [2025-10-30T17:58:53.680626] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-30T17:58:53.680767] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLVT took 34.7s. Estimated remaining: 3h 58m 41s. Rate: 8.0 symbols/min [2025-10-30T17:58:53.854448] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:58:53.887100] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-30T17:58:53.931697] [DEBUG] [LOCAL ] CMA: Loaded 50103 existing records from primary storage. [2025-10-30T17:58:53.932026] [INFO ] [MAIN ] CMA: Loaded 50103 existing records. [2025-10-30T17:58:54.102799] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-30T17:58:54.145994] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:58:54.146199] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-30T17:58:54.146246] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-30T17:58:54.146682] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-30T17:58:54.146738] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-30T17:58:54.499507] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:58:54.897495] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-30T17:58:55.341623] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-30T17:58:55.428492] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-30T17:58:55.440061] [INFO ] [REMOTE ] CLS: Full fetch complete (77704 records). [2025-10-30T17:58:55.440208] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-30T17:58:55.702687] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-30T17:58:55.828552] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-30T17:58:55.828626] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-30T17:58:55.829455] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-30T17:58:55.829505] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-30T17:58:55.830869] [DEBUG] [LOCAL ] CLS: Trimmed 77704 records to 53932 (keeping 200 days of data) [2025-10-30T17:58:56.090439] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T17:58:56.188081] [DEBUG] [LOCAL ] CLS: Primary data saved (53932 records). [2025-10-30T17:58:56.188201] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-30T17:58:56.188796] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLS took 49.0s. Estimated remaining: 3h 58m 13s. Rate: 8.0 symbols/min [2025-10-30T17:58:56.357014] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:58:56.383337] [DEBUG] [LOCAL ] CMBT: Loaded 28920 existing records from primary storage. [2025-10-30T17:58:56.383584] [INFO ] [MAIN ] CMBT: Loaded 28920 existing records. [2025-10-30T17:58:56.502620] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-30T17:58:56.563498] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:58:56.563697] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-30T17:58:56.563753] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-30T17:58:56.564127] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-30T17:58:56.564182] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-30T17:58:56.914738] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:58:57.215923] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T17:58:57.297488] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-30T17:58:57.871260] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T17:58:58.074800] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T17:58:58.097458] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-30T17:58:58.693098] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-30T17:58:58.897559] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-30T17:58:59.697569] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-30T17:59:00.092366] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T17:59:00.497473] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-30T17:59:00.630030] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T17:59:01.297547] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-30T17:59:02.097581] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-30T17:59:02.195023] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-30T17:59:02.718377] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T17:59:02.844160] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-30T17:59:02.897517] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-30T17:59:03.697511] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-30T17:59:04.150881] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T17:59:04.497599] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-30T17:59:05.148191] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T17:59:05.199760] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-30T17:59:05.297461] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-30T17:59:06.097515] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-30T17:59:06.776852] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T17:59:06.897550] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-30T17:59:07.355457] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T17:59:07.697532] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-30T17:59:08.293594] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T17:59:08.497488] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-30T17:59:09.072693] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T17:59:09.082689] [INFO ] [REMOTE ] CM: Full fetch complete (69621 records). [2025-10-30T17:59:09.082810] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-30T17:59:09.302893] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-30T17:59:09.463853] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-30T17:59:09.463935] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-30T17:59:09.464716] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-30T17:59:09.464779] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-30T17:59:09.466070] [DEBUG] [LOCAL ] CM: Trimmed 69621 records to 48341 (keeping 200 days of data) [2025-10-30T17:59:09.723698] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T17:59:09.793312] [DEBUG] [LOCAL ] CM: Primary data saved (48341 records). [2025-10-30T17:59:09.793436] [INFO ] [MAIN ] CM: Full history saved. [2025-10-30T17:59:09.794299] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CM took 27.8s. Estimated remaining: 3h 58m 30s. Rate: 7.9 symbols/min [2025-10-30T17:59:09.961353] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:59:10.004738] [DEBUG] [LOCAL ] CMC: Loaded 45470 existing records from primary storage. [2025-10-30T17:59:10.005069] [INFO ] [MAIN ] CMC: Loaded 45470 existing records. [2025-10-30T17:59:10.102572] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-30T17:59:10.201730] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:59:10.201919] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-30T17:59:10.201966] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-30T17:59:10.202326] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-30T17:59:10.202381] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-30T17:59:10.543882] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:59:10.897484] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-30T17:59:11.015738] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-30T17:59:11.027638] [INFO ] [REMOTE ] CLX: Full fetch complete (74087 records). [2025-10-30T17:59:11.027819] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-30T17:59:11.420536] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-30T17:59:11.420712] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-30T17:59:11.421558] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-30T17:59:11.421617] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-30T17:59:11.423019] [DEBUG] [LOCAL ] CLX: Trimmed 74087 records to 52243 (keeping 200 days of data) [2025-10-30T17:59:11.633483] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T17:59:11.700828] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-30T17:59:11.796134] [DEBUG] [LOCAL ] CLX: Primary data saved (52243 records). [2025-10-30T17:59:11.796266] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-30T17:59:11.797179] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CLX took 42.2s. Estimated remaining: 3h 58m 0s. Rate: 8.0 symbols/min [2025-10-30T17:59:11.971733] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:59:11.979001] [DEBUG] [LOCAL ] CMCM: Loaded 4789 existing records from primary storage. [2025-10-30T17:59:11.979184] [INFO ] [MAIN ] CMCM: Loaded 4789 existing records. [2025-10-30T17:59:12.169762] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:59:12.170073] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-30T17:59:12.170171] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-30T17:59:12.170736] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-30T17:59:12.170795] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-30T17:59:12.386947] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-30T17:59:12.503308] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-30T17:59:12.579621] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:59:12.992139] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T17:59:13.297517] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-30T17:59:13.765780] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T17:59:14.086363] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-30T17:59:14.097445] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-30T17:59:14.746338] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T17:59:14.897517] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-30T17:59:15.697518] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-30T17:59:16.145693] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T17:59:16.497509] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-30T17:59:16.941724] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T17:59:16.974103] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-30T17:59:17.297510] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-30T17:59:17.716985] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T17:59:18.097510] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-30T17:59:18.897513] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-30T17:59:19.697499] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-30T17:59:19.766819] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T17:59:19.778049] [INFO ] [REMOTE ] CMA: Full fetch complete (73476 records). [2025-10-30T17:59:19.778175] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-30T17:59:20.170784] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-30T17:59:20.170907] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-30T17:59:20.171897] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-30T17:59:20.172129] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-30T17:59:20.174176] [DEBUG] [LOCAL ] CMA: Trimmed 73476 records to 50479 (keeping 200 days of data) [2025-10-30T17:59:20.321766] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T17:59:20.499682] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-30T17:59:20.517383] [DEBUG] [LOCAL ] CMA: Primary data saved (50479 records). [2025-10-30T17:59:20.517776] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-30T17:59:20.517865] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CMA took 26.8s. Estimated remaining: 3h 57m 57s. Rate: 8.0 symbols/min [2025-10-30T17:59:20.693530] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:59:20.693851] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-30T17:59:20.694068] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-30T17:59:20.694368] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-30T17:59:20.694468] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-30T17:59:20.694689] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-30T17:59:20.705106] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-30T17:59:20.784882] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T17:59:21.075625] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:59:21.297502] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-30T17:59:21.472796] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T17:59:21.611853] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-30T17:59:22.097463] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-30T17:59:22.897507] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-30T17:59:23.251823] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T17:59:23.265174] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-30T17:59:23.697492] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-30T17:59:23.843078] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T17:59:23.843372] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-30T17:59:23.843461] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T17:59:23.843508] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-30T17:59:23.843568] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T17:59:23.843639] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-30T17:59:23.843743] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-30T17:59:23.843781] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-30T17:59:23.843820] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-30T17:59:23.843867] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CMDB took 3.3s. Estimated remaining: 3h 57m 33s. Rate: 8.0 symbols/min [2025-10-30T17:59:24.020150] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:59:24.068955] [DEBUG] [LOCAL ] CMG: Loaded 53723 existing records from primary storage. [2025-10-30T17:59:24.069244] [INFO ] [MAIN ] CMG: Loaded 53723 existing records. [2025-10-30T17:59:24.252291] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:59:24.252504] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-30T17:59:24.252556] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-30T17:59:24.253438] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-30T17:59:24.253529] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-30T17:59:24.503830] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-30T17:59:24.619075] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:59:25.297495] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-30T17:59:25.608230] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T17:59:26.097500] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-30T17:59:26.903220] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-30T17:59:26.916277] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-30T17:59:27.151405] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T17:59:27.364241] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-30T17:59:27.697536] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-30T17:59:28.497522] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-30T17:59:29.212490] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-30T17:59:29.297480] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-30T17:59:30.093420] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-30T17:59:30.103017] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-30T17:59:30.412153] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-30T17:59:30.713186] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-30T17:59:30.897499] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-30T17:59:31.697521] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-30T17:59:32.487230] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-30T17:59:32.497673] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-30T17:59:32.897494] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-30T17:59:33.181900] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T17:59:33.194934] [INFO ] [REMOTE ] CMBT: Full fetch complete (35512 records). [2025-10-30T17:59:33.195108] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-30T17:59:33.301781] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-30T17:59:33.572143] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-30T17:59:33.572229] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-30T17:59:33.572799] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-30T17:59:33.572861] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-30T17:59:33.573807] [DEBUG] [LOCAL ] CMBT: Trimmed 35512 records to 29308 (keeping 200 days of data) [2025-10-30T17:59:33.741895] [DEBUG] [LOCAL ] CMBT: Primary data saved (29308 records). [2025-10-30T17:59:33.742024] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-30T17:59:33.742100] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMBT took 37.6s. Estimated remaining: 3h 57m 35s. Rate: 8.0 symbols/min [2025-10-30T17:59:33.911984] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:59:33.948349] [DEBUG] [LOCAL ] CMI: Loaded 41335 existing records from primary storage. [2025-10-30T17:59:33.948616] [INFO ] [MAIN ] CMI: Loaded 41335 existing records. [2025-10-30T17:59:34.104798] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-30T17:59:34.128714] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:59:34.129067] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-30T17:59:34.129116] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-30T17:59:34.129937] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-30T17:59:34.129997] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-30T17:59:34.481117] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:59:34.775930] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T17:59:34.897475] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-30T17:59:35.697455] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-30T17:59:35.750512] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-30T17:59:36.117945] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-30T17:59:36.500047] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-30T17:59:36.502853] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T17:59:36.514301] [INFO ] [REMOTE ] CMC: Full fetch complete (67182 records). [2025-10-30T17:59:36.514404] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-30T17:59:36.910546] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-30T17:59:36.910627] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-30T17:59:36.911424] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-30T17:59:36.911473] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-30T17:59:36.912754] [DEBUG] [LOCAL ] CMC: Trimmed 67182 records to 45827 (keeping 200 days of data) [2025-10-30T17:59:37.176794] [DEBUG] [LOCAL ] CMC: Primary data saved (45827 records). [2025-10-30T17:59:37.176950] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-30T17:59:37.177967] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMC took 27.4s. Estimated remaining: 3h 57m 11s. Rate: 8.0 symbols/min [2025-10-30T17:59:37.298086] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-30T17:59:37.367446] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:59:37.400522] [DEBUG] [LOCAL ] CMP: Loaded 35109 existing records from primary storage. [2025-10-30T17:59:37.400839] [INFO ] [MAIN ] CMP: Loaded 35109 existing records. [2025-10-30T17:59:37.584077] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T17:59:37.584316] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-30T17:59:37.584382] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-30T17:59:37.584991] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-30T17:59:37.585050] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-30T17:59:37.936897] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:59:38.097471] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-30T17:59:38.234676] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-30T17:59:38.633607] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T17:59:38.724350] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T17:59:38.897621] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-30T17:59:39.376500] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-30T17:59:39.378328] [INFO ] [REMOTE ] CMCM: Full fetch complete (7036 records). [2025-10-30T17:59:39.378397] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-30T17:59:39.702591] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-30T17:59:39.761191] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-30T17:59:39.761260] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-30T17:59:39.761441] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-30T17:59:39.761479] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-30T17:59:39.761881] [DEBUG] [LOCAL ] CMCM: Trimmed 7036 records to 4801 (keeping 200 days of data) [2025-10-30T17:59:39.788230] [DEBUG] [LOCAL ] CMCM: Primary data saved (4801 records). [2025-10-30T17:59:39.788330] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-30T17:59:39.788406] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMCM took 28.0s. Estimated remaining: 3h 56m 44s. Rate: 8.0 symbols/min [2025-10-30T17:59:39.957691] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T17:59:39.957899] [DEBUG] [LOCAL ] CMPO: No existing data file found in primary storage. [2025-10-30T17:59:39.957953] [WARN ] [MAIN ] CMPO: No existing data found, performing full refresh instead. [2025-10-30T17:59:39.958065] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-30T17:59:39.958106] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-30T17:59:39.958147] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-30T17:59:39.958178] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-30T17:59:40.311574] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T17:59:40.497473] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-30T17:59:41.297514] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-30T17:59:41.365429] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-30T17:59:41.545869] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T17:59:42.097547] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-30T17:59:42.331957] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T17:59:42.897487] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-30T17:59:43.078869] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T17:59:43.697501] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-30T17:59:44.497467] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-30T17:59:44.617320] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T17:59:44.681239] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-30T17:59:45.297537] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-30T17:59:45.687888] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T17:59:46.097508] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-30T17:59:46.409432] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T17:59:46.897578] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-30T17:59:47.132693] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T17:59:47.697767] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-30T17:59:47.969769] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-30T17:59:48.497488] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-30T17:59:48.911914] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T17:59:49.297503] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-30T17:59:49.388225] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T17:59:50.097533] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-30T17:59:50.897540] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-30T17:59:51.141552] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-30T17:59:51.241119] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T17:59:51.697483] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-30T17:59:51.896805] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T17:59:52.497510] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-30T17:59:53.297505] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-30T17:59:53.748251] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-30T17:59:53.761389] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-30T17:59:53.761705] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-30T17:59:54.017757] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T17:59:54.111093] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-30T17:59:54.271149] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-30T17:59:54.271240] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-30T17:59:54.272328] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-30T17:59:54.272416] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-30T17:59:54.274112] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54113 (keeping 200 days of data) [2025-10-30T17:59:54.613457] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T17:59:54.631221] [DEBUG] [LOCAL ] CMG: Primary data saved (54113 records). [2025-10-30T17:59:54.631355] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-30T17:59:54.631435] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMG took 30.8s. Estimated remaining: 3h 57m 6s. Rate: 8.0 symbols/min [2025-10-30T17:59:54.897513] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-30T17:59:55.419500] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T17:59:55.697610] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-30T17:59:56.098309] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T17:59:56.497514] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-30T17:59:56.639045] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T17:59:57.297497] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-30T17:59:57.560199] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T17:59:58.097498] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-30T17:59:58.227976] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T17:59:58.897496] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-30T17:59:59.332476] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T17:59:59.697511] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-30T18:00:00.270665] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:00:00.497491] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-30T18:00:01.297583] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-30T18:00:01.606900] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-30T18:00:01.776701] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:00:02.097547] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-30T18:00:02.897500] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-30T18:00:03.536200] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-30T18:00:03.545790] [INFO ] [REMOTE ] CMI: Full fetch complete (61213 records). [2025-10-30T18:00:03.545906] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-30T18:00:03.909657] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-30T18:00:03.946133] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-30T18:00:03.961519] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-30T18:00:03.961572] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-30T18:00:03.962269] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-30T18:00:03.962426] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-30T18:00:03.963605] [DEBUG] [LOCAL ] CMI: Trimmed 61213 records to 41658 (keeping 200 days of data) [2025-10-30T18:00:04.214826] [DEBUG] [LOCAL ] CMI: Primary data saved (41658 records). [2025-10-30T18:00:04.214943] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-30T18:00:04.215539] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMI took 30.5s. Estimated remaining: 3h 57m 6s. Rate: 8.0 symbols/min [2025-10-30T18:00:04.435696] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-30T18:00:04.497494] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-30T18:00:05.575309] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T18:00:05.582301] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-30T18:00:05.927964] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-30T18:00:05.935945] [INFO ] [REMOTE ] CMPO: Full fetch complete (57338 records). [2025-10-30T18:00:05.936174] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-30T18:00:05.937214] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:00:05.937324] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:00:05.937379] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:00:05.937434] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-30T18:00:05.937515] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-30T18:00:05.937560] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-10-30T18:00:05.937616] [DEBUG] [LOCAL ] CMPO: No derivative data file found to delete. [2025-10-30T18:00:05.937724] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMPO took 26.1s. Estimated remaining: 3h 56m 36s. Rate: 8.0 symbols/min [2025-10-30T18:00:07.011175] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T18:00:07.018525] [INFO ] [REMOTE ] CMP: Full fetch complete (51257 records). [2025-10-30T18:00:07.018703] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-30T18:00:07.417312] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-30T18:00:07.417400] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-30T18:00:07.418048] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-30T18:00:07.418109] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-30T18:00:07.419229] [DEBUG] [LOCAL ] CMP: Trimmed 51257 records to 35290 (keeping 200 days of data) [2025-10-30T18:00:07.622007] [DEBUG] [LOCAL ] CMP: Primary data saved (35290 records). [2025-10-30T18:00:07.622136] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-30T18:00:07.622215] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMP took 30.4s. Estimated remaining: 3h 56m 5s. Rate: 8.0 symbols/min [2025-10-30T18:00:08.197773] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:08.261760] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:08.301893] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:08.315474] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-30T18:00:08.315637] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-30T18:00:08.322014] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-30T18:00:08.322295] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-30T18:00:08.332218] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-30T18:00:08.348821] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-30T18:00:08.348957] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-30T18:00:08.350581] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:08.350818] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-10-30T18:00:08.350958] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-30T18:00:08.351083] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-30T18:00:08.351236] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-10-30T18:00:08.351311] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-30T18:00:08.353994] [DEBUG] [LOCAL ] CMSC: Loaded 4555 existing records from primary storage. [2025-10-30T18:00:08.354202] [INFO ] [MAIN ] CMSC: Loaded 4555 existing records. [2025-10-30T18:00:08.414970] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-30T18:00:08.404579] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-30T18:00:08.424181] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-30T18:00:08.429546] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-30T18:00:08.627630] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-30T18:00:08.676353] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-30T18:00:09.092034] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:00:09.187024] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-30T18:00:09.234605] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-30T18:00:09.375807] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-30T18:00:09.415344] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-30T18:00:09.471039] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:09.531317] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-30T18:00:09.825783] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:09.855795] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-30T18:00:10.063508] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:10.085269] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-30T18:00:10.172764] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:10.173144] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-30T18:00:10.178279] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-30T18:00:10.180216] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-30T18:00:10.498045] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-30T18:00:10.499799] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-30T18:00:10.794445] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-30T18:00:10.825499] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T18:00:10.897504] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-30T18:00:11.068912] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T18:00:11.199775] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-30T18:00:11.319439] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T18:00:11.697561] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-30T18:00:12.497498] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-30T18:00:12.835121] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T18:00:12.926041] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T18:00:13.297503] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-30T18:00:13.724953] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T18:00:14.097506] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-30T18:00:14.897563] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-30T18:00:15.433212] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T18:00:15.697498] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-30T18:00:16.497519] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-30T18:00:16.622753] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-30T18:00:16.877243] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T18:00:17.297499] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-30T18:00:17.446793] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T18:00:18.097531] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-30T18:00:18.594192] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T18:00:18.897509] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-30T18:00:19.138803] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T18:00:19.247665] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-30T18:00:19.697491] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-30T18:00:20.497496] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-30T18:00:20.887673] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T18:00:20.973584] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-30T18:00:21.297503] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-30T18:00:22.097560] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-30T18:00:22.615055] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-30T18:00:22.727363] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T18:00:22.897525] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-30T18:00:23.697516] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-30T18:00:24.058596] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-30T18:00:24.199728] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T18:00:24.497468] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-30T18:00:25.297504] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-30T18:00:25.885733] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T18:00:26.097489] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-30T18:00:26.420993] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:00:26.549143] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-30T18:00:26.897494] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-30T18:00:27.697481] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-30T18:00:27.866339] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T18:00:28.497496] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-30T18:00:29.066103] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-30T18:00:29.297492] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-30T18:00:29.607802] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T18:00:29.692665] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T18:00:30.097513] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-30T18:00:30.897512] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-30T18:00:31.169454] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T18:00:31.215138] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-30T18:00:31.697513] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-30T18:00:32.080217] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T18:00:32.497507] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-30T18:00:33.297505] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-30T18:00:33.841725] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-30T18:00:33.842931] [INFO ] [REMOTE ] CMSA: Full fetch complete (4759 records). [2025-10-30T18:00:33.843000] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-30T18:00:34.098292] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-30T18:00:34.246558] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-30T18:00:34.246735] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-30T18:00:34.246983] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-30T18:00:34.247089] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-30T18:00:34.248999] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-30T18:00:34.260376] [DEBUG] [LOCAL ] CMSA: Trimmed 4759 records to 3413 (keeping 200 days of data) [2025-10-30T18:00:34.281329] [DEBUG] [LOCAL ] CMSA: Primary data saved (3413 records). [2025-10-30T18:00:34.281398] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-30T18:00:34.281465] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMSA took 26.7s. Estimated remaining: 3h 57m 13s. Rate: 7.9 symbols/min [2025-10-30T18:00:34.445521] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:34.453882] [DEBUG] [LOCAL ] CMSD: Loaded 7330 existing records from primary storage. [2025-10-30T18:00:34.454075] [INFO ] [MAIN ] CMSD: Loaded 7330 existing records. [2025-10-30T18:00:34.628828] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:00:34.629059] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-30T18:00:34.629105] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-30T18:00:34.629338] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-30T18:00:34.629396] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-30T18:00:34.903058] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-30T18:00:34.981772] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:35.203089] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-30T18:00:35.414803] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T18:00:35.697505] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-30T18:00:36.497513] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-30T18:00:37.165991] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T18:00:37.174823] [INFO ] [REMOTE ] CMRE: Full fetch complete (51120 records). [2025-10-30T18:00:37.174927] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-30T18:00:37.297971] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-30T18:00:37.298245] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T18:00:37.575571] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-30T18:00:37.575665] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-30T18:00:37.576279] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-30T18:00:37.576343] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-30T18:00:37.577375] [DEBUG] [LOCAL ] CMRE: Trimmed 51120 records to 35312 (keeping 200 days of data) [2025-10-30T18:00:37.784849] [DEBUG] [LOCAL ] CMRE: Primary data saved (35312 records). [2025-10-30T18:00:37.784978] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-30T18:00:37.785046] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMRE took 30.2s. Estimated remaining: 3h 56m 49s. Rate: 8.0 symbols/min [2025-10-30T18:00:37.954449] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:37.984292] [DEBUG] [LOCAL ] CMTG: Loaded 34264 existing records from primary storage. [2025-10-30T18:00:37.984558] [INFO ] [MAIN ] CMTG: Loaded 34264 existing records. [2025-10-30T18:00:38.102579] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-30T18:00:38.163139] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:00:38.163398] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-30T18:00:38.163445] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-30T18:00:38.164096] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-30T18:00:38.164151] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-30T18:00:38.506480] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:38.626287] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-30T18:00:38.627598] [INFO ] [REMOTE ] CMSC: Full fetch complete (6824 records). [2025-10-30T18:00:38.627689] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-30T18:00:38.900271] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-30T18:00:39.006988] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-30T18:00:39.007078] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-30T18:00:39.007360] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-30T18:00:39.007438] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-30T18:00:39.008060] [DEBUG] [LOCAL ] CMSC: Trimmed 6824 records to 4572 (keeping 200 days of data) [2025-10-30T18:00:39.035265] [DEBUG] [LOCAL ] CMSC: Primary data saved (4572 records). [2025-10-30T18:00:39.035385] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-30T18:00:39.035484] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMSC took 31.4s. Estimated remaining: 3h 56m 17s. Rate: 8.0 symbols/min [2025-10-30T18:00:39.208898] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-30T18:00:39.250861] [INFO ] [REMOTE ] CMS: Full fetch complete (76267 records). [2025-10-30T18:00:39.250705] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:39.250977] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-30T18:00:39.361884] [DEBUG] [LOCAL ] CMU: Loaded 5801 existing records from primary storage. [2025-10-30T18:00:39.377411] [INFO ] [MAIN ] CMU: Loaded 5801 existing records. [2025-10-30T18:00:39.731977] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:00:39.725099] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-30T18:00:39.733027] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-30T18:00:39.733686] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-30T18:00:39.749699] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-30T18:00:39.760099] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-30T18:00:39.885922] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-30T18:00:39.904871] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-30T18:00:39.912214] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-30T18:00:39.918741] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-30T18:00:39.977074] [DEBUG] [LOCAL ] CMS: Trimmed 76267 records to 52878 (keeping 200 days of data) [2025-10-30T18:00:40.285933] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T18:00:40.386122] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:40.410710] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T18:00:40.503374] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-30T18:00:40.611274] [DEBUG] [LOCAL ] CMS: Primary data saved (52878 records). [2025-10-30T18:00:40.611400] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-30T18:00:40.611469] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMS took 33.0s. Estimated remaining: 3h 55m 47s. Rate: 8.0 symbols/min [2025-10-30T18:00:40.790567] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:00:40.818952] [DEBUG] [LOCAL ] CNA: Loaded 32306 existing records from primary storage. [2025-10-30T18:00:40.819207] [INFO ] [MAIN ] CNA: Loaded 32306 existing records. [2025-10-30T18:00:40.995273] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:00:40.995539] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-30T18:00:40.995591] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-30T18:00:40.996204] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-30T18:00:40.996262] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-30T18:00:41.129226] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T18:00:41.302569] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-30T18:00:41.366183] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:00:41.929950] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T18:00:42.097489] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-30T18:00:42.897501] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-30T18:00:43.164552] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T18:00:43.401734] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T18:00:43.697475] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-30T18:00:44.182713] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T18:00:44.497512] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-30T18:00:45.297514] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-30T18:00:45.689097] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T18:00:45.694977] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:00:46.097513] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-30T18:00:46.897469] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-30T18:00:46.942755] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T18:00:47.427661] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T18:00:47.697506] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-30T18:00:48.497473] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-30T18:00:48.563778] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T18:00:49.113267] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-30T18:00:49.297471] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-30T18:00:49.681264] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-30T18:00:50.097493] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-30T18:00:50.533788] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-30T18:00:50.897509] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-30T18:00:51.697494] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-30T18:00:51.767957] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-30T18:00:52.497491] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-30T18:00:52.894029] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T18:00:53.297505] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-30T18:00:53.526638] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T18:00:54.097503] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-30T18:00:54.419343] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:00:54.887736] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-30T18:00:54.897456] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-30T18:00:55.697515] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-30T18:00:55.839409] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T18:00:56.424020] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-30T18:00:56.497607] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-30T18:00:56.954465] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-30T18:00:57.297522] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-30T18:00:57.678445] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-30T18:00:58.097515] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-30T18:00:58.897538] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-30T18:00:59.193736] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T18:00:59.697552] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-30T18:01:00.172025] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T18:01:00.384269] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-30T18:01:00.386261] [INFO ] [REMOTE ] CMSD: Full fetch complete (11268 records). [2025-10-30T18:01:00.386365] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-30T18:01:00.502610] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-30T18:01:00.745822] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-30T18:01:00.745901] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-30T18:01:00.746166] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-30T18:01:00.746204] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-30T18:01:00.746741] [DEBUG] [LOCAL ] CMSD: Trimmed 11268 records to 7366 (keeping 200 days of data) [2025-10-30T18:01:00.789801] [DEBUG] [LOCAL ] CMSD: Primary data saved (7366 records). [2025-10-30T18:01:00.789916] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-30T18:01:00.789992] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMSD took 26.5s. Estimated remaining: 3h 56m 28s. Rate: 8.0 symbols/min [2025-10-30T18:01:00.956550] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:01.010160] [DEBUG] [LOCAL ] CNC: Loaded 53780 existing records from primary storage. [2025-10-30T18:01:01.010491] [INFO ] [MAIN ] CNC: Loaded 53780 existing records. [2025-10-30T18:01:01.130833] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T18:01:01.229263] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:01:01.229499] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-30T18:01:01.229547] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-30T18:01:01.230474] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-30T18:01:01.230545] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-30T18:01:01.303792] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-30T18:01:01.599129] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:02.090288] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-30T18:01:02.097479] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-30T18:01:02.530697] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-30T18:01:02.897496] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-30T18:01:03.299982] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T18:01:03.697544] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-30T18:01:04.497483] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-30T18:01:05.206372] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T18:01:05.297517] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-30T18:01:05.911109] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T18:01:06.097508] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-30T18:01:06.552254] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T18:01:06.682421] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-30T18:01:06.684246] [INFO ] [REMOTE ] CMU: Full fetch complete (9427 records). [2025-10-30T18:01:06.684325] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-30T18:01:06.684816] [FATAL] [VALIDATOR ] CMU: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:01:06.684914] [FATAL] [MAIN ] CMU: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:01:06.684966] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:01:06.685045] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-30T18:01:06.685122] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-30T18:01:06.685169] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-10-30T18:01:06.685406] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-10-30T18:01:06.685512] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMU took 27.6s. Estimated remaining: 3h 56m 14s. Rate: 8.0 symbols/min [2025-10-30T18:01:06.879150] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:06.879492] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-30T18:01:06.879558] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-30T18:01:06.879723] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-30T18:01:06.879771] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-30T18:01:06.879813] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-30T18:01:06.879843] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-30T18:01:06.902623] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-30T18:01:07.246305] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:07.697549] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-30T18:01:08.170136] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-30T18:01:08.225581] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T18:01:08.497494] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-30T18:01:09.297480] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-30T18:01:09.409505] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T18:01:09.543384] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-30T18:01:10.097506] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-30T18:01:10.897479] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-30T18:01:11.389408] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T18:01:11.697535] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-30T18:01:11.795552] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-30T18:01:12.497511] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-30T18:01:12.983808] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T18:01:13.155315] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T18:01:13.297497] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-30T18:01:14.097514] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-30T18:01:14.472906] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T18:01:14.562035] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T18:01:14.897505] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-30T18:01:15.425278] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-30T18:01:15.697504] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-30T18:01:16.497491] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-30T18:01:16.838248] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T18:01:16.845107] [INFO ] [REMOTE ] CMTG: Full fetch complete (52179 records). [2025-10-30T18:01:16.845364] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-30T18:01:16.846548] [FATAL] [VALIDATOR ] CMTG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:01:16.846679] [FATAL] [MAIN ] CMTG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:01:16.846739] [WARN ] [MAIN ] CMTG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:01:16.846783] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-30T18:01:16.846848] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-30T18:01:16.846937] [INFO ] [LOCAL ] CMTG: Starting deletion of derivative data. [2025-10-30T18:01:16.847152] [DEBUG] [LOCAL ] CMTG: Deleted derivative data file. [2025-10-30T18:01:16.847275] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CMTG took 39.1s. Estimated remaining: 3h 56m 17s. Rate: 8.0 symbols/min [2025-10-30T18:01:17.035153] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:17.035443] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-30T18:01:17.035489] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-30T18:01:17.035602] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-30T18:01:17.035671] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-30T18:01:17.035739] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-30T18:01:17.035775] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-30T18:01:17.165044] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T18:01:17.305743] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-30T18:01:17.432174] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:18.097503] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-30T18:01:18.764517] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-30T18:01:18.897558] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-30T18:01:19.117629] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T18:01:19.697540] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-30T18:01:20.161170] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:01:20.497486] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-30T18:01:20.680858] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-30T18:01:20.687449] [INFO ] [REMOTE ] CNA: Full fetch complete (46119 records). [2025-10-30T18:01:20.687552] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-30T18:01:20.688143] [FATAL] [VALIDATOR ] CNA: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:01:20.688249] [FATAL] [MAIN ] CNA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:01:20.688292] [WARN ] [MAIN ] CNA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:01:20.688333] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-30T18:01:20.688389] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-30T18:01:20.688422] [INFO ] [LOCAL ] CNA: Starting deletion of derivative data. [2025-10-30T18:01:20.688584] [DEBUG] [LOCAL ] CNA: Deleted derivative data file. [2025-10-30T18:01:20.689134] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CNA took 40.1s. Estimated remaining: 3h 55m 55s. Rate: 8.0 symbols/min [2025-10-30T18:01:20.854663] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:20.854828] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-10-30T18:01:20.854864] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-10-30T18:01:20.854973] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-30T18:01:20.855014] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-30T18:01:20.855054] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-30T18:01:20.855086] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-30T18:01:21.149516] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T18:01:21.215995] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:21.297464] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-30T18:01:22.097499] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-30T18:01:22.613289] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T18:01:22.897602] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-30T18:01:23.499093] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T18:01:23.697540] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-30T18:01:24.125347] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-30T18:01:24.497529] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-30T18:01:24.972799] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T18:01:25.119093] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T18:01:25.297486] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-30T18:01:25.892951] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-30T18:01:25.894753] [INFO ] [REMOTE ] CNF: Full fetch complete (12924 records). [2025-10-30T18:01:25.894827] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-30T18:01:26.097462] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-30T18:01:26.270588] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-30T18:01:26.270688] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-30T18:01:26.271026] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-30T18:01:26.271089] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-30T18:01:26.271603] [DEBUG] [LOCAL ] CNF: Trimmed 12924 records to 10605 (keeping 200 days of data) [2025-10-30T18:01:26.332043] [DEBUG] [LOCAL ] CNF: Primary data saved (10605 records). [2025-10-30T18:01:26.332180] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-30T18:01:26.332251] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNF took 19.6s. Estimated remaining: 3h 55m 40s. Rate: 8.0 symbols/min [2025-10-30T18:01:26.517769] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:26.567212] [DEBUG] [LOCAL ] CNK: Loaded 52869 existing records from primary storage. [2025-10-30T18:01:26.567546] [INFO ] [MAIN ] CNK: Loaded 52869 existing records. [2025-10-30T18:01:26.755384] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:01:26.755688] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-30T18:01:26.755749] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-30T18:01:26.756805] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-30T18:01:26.756870] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-30T18:01:26.904574] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-30T18:01:27.146242] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:27.684169] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T18:01:27.697467] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-30T18:01:28.408531] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-30T18:01:28.497475] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-30T18:01:29.026489] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T18:01:29.297501] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-30T18:01:29.685125] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T18:01:30.097536] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-30T18:01:30.515523] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T18:01:30.897503] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-30T18:01:31.294014] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T18:01:31.697514] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-30T18:01:32.497518] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-30T18:01:32.783536] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-30T18:01:32.963956] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T18:01:33.297496] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-30T18:01:33.795897] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T18:01:34.097502] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-30T18:01:34.898258] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-30T18:01:34.904671] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-30T18:01:35.468312] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T18:01:35.697508] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-30T18:01:36.233986] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T18:01:36.497499] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-30T18:01:37.297517] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-30T18:01:37.647494] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T18:01:37.830812] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-30T18:01:37.843348] [INFO ] [REMOTE ] CNC: Full fetch complete (77867 records). [2025-10-30T18:01:37.843578] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-30T18:01:38.104966] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-30T18:01:38.249522] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-30T18:01:38.249675] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-30T18:01:38.250633] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-30T18:01:38.250722] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-30T18:01:38.252252] [DEBUG] [LOCAL ] CNC: Trimmed 77867 records to 54170 (keeping 200 days of data) [2025-10-30T18:01:38.577097] [DEBUG] [LOCAL ] CNC: Primary data saved (54170 records). [2025-10-30T18:01:38.577251] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-30T18:01:38.578355] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CNC took 37.8s. Estimated remaining: 3h 55m 51s. Rate: 8.0 symbols/min [2025-10-30T18:01:38.769924] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:38.820077] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-30T18:01:38.874545] [DEBUG] [LOCAL ] CNM: Loaded 50886 existing records from primary storage. [2025-10-30T18:01:38.874951] [INFO ] [MAIN ] CNM: Loaded 50886 existing records. [2025-10-30T18:01:38.907914] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-30T18:01:39.062236] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:01:39.062447] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-30T18:01:39.062495] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-30T18:01:39.063222] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-30T18:01:39.063281] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-30T18:01:39.405055] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:39.697457] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-30T18:01:39.826900] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-30T18:01:40.497473] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-30T18:01:40.578731] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-30T18:01:41.162424] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T18:01:41.297496] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-30T18:01:41.896741] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:01:42.097494] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-30T18:01:42.648987] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T18:01:42.897546] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-30T18:01:43.377425] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T18:01:43.697565] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-30T18:01:44.338381] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T18:01:44.497472] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-30T18:01:44.937871] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T18:01:45.297493] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-30T18:01:46.013324] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T18:01:46.024351] [INFO ] [REMOTE ] CNI: Full fetch complete (74410 records). [2025-10-30T18:01:46.024506] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-30T18:01:46.025339] [FATAL] [VALIDATOR ] CNI: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:01:46.025630] [FATAL] [MAIN ] CNI: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:01:46.025723] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:01:46.025817] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-30T18:01:46.025888] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-30T18:01:46.025925] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-10-30T18:01:46.025965] [DEBUG] [LOCAL ] CNI: No derivative data file found to delete. [2025-10-30T18:01:46.026025] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNI took 25.3s. Estimated remaining: 3h 55m 43s. Rate: 8.0 symbols/min [2025-10-30T18:01:46.103827] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-30T18:01:46.225911] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:46.257618] [DEBUG] [LOCAL ] CNMD: Loaded 31495 existing records from primary storage. [2025-10-30T18:01:46.257926] [INFO ] [MAIN ] CNMD: Loaded 31495 existing records. [2025-10-30T18:01:46.450121] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:01:46.450550] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-30T18:01:46.450723] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-30T18:01:46.451121] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-30T18:01:46.451289] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-30T18:01:46.742264] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-30T18:01:46.896012] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:46.897461] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-30T18:01:47.414195] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-30T18:01:47.697548] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-30T18:01:48.012190] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T18:01:48.497528] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-30T18:01:49.096207] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T18:01:49.297503] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-30T18:01:49.787924] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T18:01:50.097499] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-30T18:01:50.641463] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T18:01:50.897513] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-30T18:01:51.119568] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T18:01:51.697503] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-30T18:01:52.350801] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T18:01:52.361976] [INFO ] [REMOTE ] CNH: Full fetch complete (77315 records). [2025-10-30T18:01:52.362113] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-30T18:01:52.362801] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:01:52.362886] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:01:52.362929] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:01:52.362969] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-30T18:01:52.363024] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-30T18:01:52.363079] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-30T18:01:52.363120] [DEBUG] [LOCAL ] CNH: No derivative data file found to delete. [2025-10-30T18:01:52.363175] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNH took 35.5s. Estimated remaining: 3h 55m 31s. Rate: 8.0 symbols/min [2025-10-30T18:01:52.503262] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-30T18:01:52.539024] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:01:52.539250] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-30T18:01:52.539312] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-30T18:01:52.539435] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-30T18:01:52.539480] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-30T18:01:52.539523] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-30T18:01:52.539556] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-30T18:01:52.891982] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:01:52.913758] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:01:53.297507] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-30T18:01:53.959274] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T18:01:54.097510] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-30T18:01:54.336628] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-30T18:01:54.897477] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-30T18:01:54.991313] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-30T18:01:55.697500] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-30T18:01:55.836042] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T18:01:56.497532] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-30T18:01:57.102152] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:01:57.297533] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-30T18:01:57.564090] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T18:01:58.097522] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-30T18:01:58.251069] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T18:01:58.897517] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-30T18:01:59.320308] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:01:59.697499] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-30T18:01:59.854630] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T18:02:00.497511] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-30T18:02:00.725725] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T18:02:01.297556] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-30T18:02:02.097523] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-30T18:02:02.897572] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-30T18:02:03.329867] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:02:03.697549] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-30T18:02:03.971737] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T18:02:04.497507] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-30T18:02:04.680873] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T18:02:04.886739] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (4.39 seconds). [2025-10-30T18:02:05.297559] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-30T18:02:05.488583] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T18:02:05.597504] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (4.30 seconds). [2025-10-30T18:02:06.097548] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-30T18:02:06.794186] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T18:02:06.806274] [INFO ] [REMOTE ] CNK: Full fetch complete (76369 records). [2025-10-30T18:02:06.806462] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-30T18:02:06.902663] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-30T18:02:07.218325] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-30T18:02:07.218439] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-30T18:02:07.219304] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-30T18:02:07.219465] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-30T18:02:07.238380] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T18:02:07.245044] [DEBUG] [LOCAL ] CNK: Trimmed 76369 records to 53251 (keeping 200 days of data) [2025-10-30T18:02:07.553740] [DEBUG] [LOCAL ] CNK: Primary data saved (53251 records). [2025-10-30T18:02:07.553867] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-30T18:02:07.554738] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNK took 41.2s. Estimated remaining: 3h 55m 52s. Rate: 7.9 symbols/min [2025-10-30T18:02:07.721566] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-30T18:02:07.724679] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:02:07.768663] [DEBUG] [LOCAL ] CNO: Loaded 39787 existing records from primary storage. [2025-10-30T18:02:07.768962] [INFO ] [MAIN ] CNO: Loaded 39787 existing records. [2025-10-30T18:02:07.943622] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:02:07.943841] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-30T18:02:07.943887] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-30T18:02:07.944579] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-30T18:02:07.944635] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-30T18:02:08.301160] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:02:08.348737] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T18:02:08.497472] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-30T18:02:08.557081] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T18:02:09.297543] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-30T18:02:09.922308] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T18:02:10.097539] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-30T18:02:10.456448] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T18:02:10.897493] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-30T18:02:11.391459] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T18:02:11.399274] [INFO ] [REMOTE ] CNMD: Full fetch complete (47176 records). [2025-10-30T18:02:11.399467] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-30T18:02:11.400368] [FATAL] [VALIDATOR ] CNMD: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:02:11.400458] [FATAL] [MAIN ] CNMD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:02:11.400502] [WARN ] [MAIN ] CNMD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:02:11.400545] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-30T18:02:11.400610] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-30T18:02:11.400687] [INFO ] [LOCAL ] CNMD: Starting deletion of derivative data. [2025-10-30T18:02:11.400916] [DEBUG] [LOCAL ] CNMD: Deleted derivative data file. [2025-10-30T18:02:11.401473] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNMD took 25.4s. Estimated remaining: 3h 55m 31s. Rate: 7.9 symbols/min [2025-10-30T18:02:11.589627] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:02:11.589951] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-10-30T18:02:11.590010] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-10-30T18:02:11.590173] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-30T18:02:11.590254] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-30T18:02:11.590336] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-30T18:02:11.590386] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-30T18:02:11.702743] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-30T18:02:11.990772] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:02:12.162819] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T18:02:12.497539] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-30T18:02:13.020828] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T18:02:13.297528] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-30T18:02:14.097510] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-30T18:02:14.158184] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-30T18:02:14.744794] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T18:02:14.756495] [INFO ] [REMOTE ] CNM: Full fetch complete (73305 records). [2025-10-30T18:02:14.756682] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-30T18:02:14.757493] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:02:14.757579] [FATAL] [MAIN ] CNM: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:02:14.757623] [WARN ] [MAIN ] CNM: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:02:14.757703] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-30T18:02:14.757773] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-30T18:02:14.757810] [INFO ] [LOCAL ] CNM: Starting deletion of derivative data. [2025-10-30T18:02:14.757981] [DEBUG] [LOCAL ] CNM: Deleted derivative data file. [2025-10-30T18:02:14.758741] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNM took 36.2s. Estimated remaining: 3h 55m 7s. Rate: 8.0 symbols/min [2025-10-30T18:02:14.908926] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-30T18:02:14.941778] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:02:14.942127] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-10-30T18:02:14.942197] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-10-30T18:02:14.942308] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-30T18:02:14.942350] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-30T18:02:14.942392] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-30T18:02:14.942424] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-30T18:02:15.319821] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:02:15.511057] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T18:02:15.697524] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-30T18:02:15.940915] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T18:02:16.497506] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-30T18:02:17.122550] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T18:02:17.297491] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-30T18:02:17.988153] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T18:02:18.097500] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-30T18:02:18.623478] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T18:02:18.897570] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-30T18:02:19.319695] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:02:19.697502] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-30T18:02:20.465073] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-30T18:02:20.497465] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-30T18:02:21.052916] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T18:02:21.297533] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-30T18:02:21.773360] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T18:02:22.097504] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-30T18:02:22.593622] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T18:02:22.897490] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-30T18:02:23.061008] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T18:02:23.697507] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-30T18:02:24.287778] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-30T18:02:24.497550] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-30T18:02:25.226779] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-30T18:02:25.297465] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-30T18:02:25.940227] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-30T18:02:26.097510] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-30T18:02:26.446533] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:02:26.897501] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-30T18:02:27.201991] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-30T18:02:27.697508] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-30T18:02:28.360072] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:02:28.497705] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-30T18:02:28.871536] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-30T18:02:28.883158] [INFO ] [REMOTE ] CNNE: Full fetch complete (50424 records). [2025-10-30T18:02:28.883376] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-30T18:02:28.884254] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:02:28.884366] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:02:28.884411] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:02:28.884497] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-30T18:02:28.884592] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-30T18:02:28.884689] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-30T18:02:28.884766] [DEBUG] [LOCAL ] CNNE: No derivative data file found to delete. [2025-10-30T18:02:28.884850] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNNE took 36.5s. Estimated remaining: 3h 55m 25s. Rate: 7.9 symbols/min [2025-10-30T18:02:29.087273] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:02:29.087666] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-30T18:02:29.087725] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-30T18:02:29.087848] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-30T18:02:29.087893] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-30T18:02:29.087935] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-30T18:02:29.087969] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-30T18:02:29.304047] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-30T18:02:29.462970] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:02:29.615176] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T18:02:30.097519] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-30T18:02:30.904143] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-30T18:02:30.928740] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-30T18:02:31.092828] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T18:02:31.697558] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-30T18:02:32.132814] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T18:02:32.497485] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-30T18:02:33.144628] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T18:02:33.297572] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-30T18:02:33.752419] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:02:34.097551] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-30T18:02:34.443595] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T18:02:34.897563] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-30T18:02:35.344063] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:02:35.697598] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-30T18:02:36.468623] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:02:36.497510] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-30T18:02:36.947757] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T18:02:37.297487] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-30T18:02:38.009386] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T18:02:38.022818] [INFO ] [REMOTE ] CNP: Full fetch complete (77556 records). [2025-10-30T18:02:38.023008] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-30T18:02:38.103220] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-30T18:02:38.441109] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-30T18:02:38.441186] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-30T18:02:38.442006] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-30T18:02:38.442068] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-30T18:02:38.443575] [DEBUG] [LOCAL ] CNP: Trimmed 77556 records to 53861 (keeping 200 days of data) [2025-10-30T18:02:38.763512] [DEBUG] [LOCAL ] CNP: Primary data saved (53861 records). [2025-10-30T18:02:38.763639] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-30T18:02:38.763750] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNP took 27.4s. Estimated remaining: 3h 55m 26s. Rate: 7.9 symbols/min [2025-10-30T18:02:38.909233] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-30T18:02:38.948022] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:02:38.948453] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-30T18:02:38.948554] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-30T18:02:38.948860] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-30T18:02:38.949069] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-30T18:02:38.949290] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-30T18:02:38.949420] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-30T18:02:39.307880] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-30T18:02:39.382701] [INFO ] [REMOTE ] CNQ: Full fetch complete (77348 records). [2025-10-30T18:02:39.406882] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:02:39.407040] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-30T18:02:39.409137] [FATAL] [VALIDATOR ] CNQ: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:02:39.409332] [FATAL] [MAIN ] CNQ: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:02:39.409537] [WARN ] [MAIN ] CNQ: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:02:39.409763] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-30T18:02:39.410026] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-30T18:02:39.410136] [INFO ] [LOCAL ] CNQ: Starting deletion of derivative data. [2025-10-30T18:02:39.410342] [DEBUG] [LOCAL ] CNQ: No derivative data file found to delete. [2025-10-30T18:02:39.410464] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNQ took 24.7s. Estimated remaining: 3h 54m 52s. Rate: 8.0 symbols/min [2025-10-30T18:02:39.558814] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-30T18:02:39.663053] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:02:39.697506] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-30T18:02:39.717225] [DEBUG] [LOCAL ] CNX: Loaded 51277 existing records from primary storage. [2025-10-30T18:02:39.717983] [INFO ] [MAIN ] CNX: Loaded 51277 existing records. [2025-10-30T18:02:39.940984] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:02:39.941232] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-30T18:02:39.941279] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-30T18:02:39.942094] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-30T18:02:39.942152] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-30T18:02:40.327424] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:02:40.355016] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T18:02:40.363983] [INFO ] [REMOTE ] CNO: Full fetch complete (60548 records). [2025-10-30T18:02:40.364156] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-30T18:02:40.502713] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-30T18:02:40.721781] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T18:02:40.807476] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-30T18:02:40.807569] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-30T18:02:40.808316] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-30T18:02:40.808384] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-30T18:02:40.809639] [DEBUG] [LOCAL ] CNO: Trimmed 60548 records to 40074 (keeping 200 days of data) [2025-10-30T18:02:41.051778] [DEBUG] [LOCAL ] CNO: Primary data saved (40074 records). [2025-10-30T18:02:41.051897] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-30T18:02:41.052611] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNO took 33.5s. Estimated remaining: 3h 54m 23s. Rate: 8.0 symbols/min [2025-10-30T18:02:41.224232] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:02:41.224427] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-10-30T18:02:41.224464] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-10-30T18:02:41.224576] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-30T18:02:41.224849] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-30T18:02:41.224918] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-30T18:02:41.224953] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-30T18:02:41.302704] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-30T18:02:41.578466] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:02:41.966311] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T18:02:42.089009] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T18:02:42.098283] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-30T18:02:42.897555] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-30T18:02:43.163082] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T18:02:43.697528] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-30T18:02:43.911963] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T18:02:44.350471] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-30T18:02:44.497710] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-30T18:02:45.297496] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-30T18:02:45.383435] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T18:02:46.097495] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-30T18:02:46.153434] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T18:02:46.897507] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-30T18:02:47.172106] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-30T18:02:47.697483] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-30T18:02:47.881959] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T18:02:48.497500] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-30T18:02:49.198287] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T18:02:49.297493] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-30T18:02:49.917286] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T18:02:50.097497] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-30T18:02:50.527534] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T18:02:50.897463] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-30T18:02:50.899280] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T18:02:51.697533] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-30T18:02:52.156900] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-30T18:02:52.497521] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-30T18:02:52.924164] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T18:02:53.297566] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-30T18:02:53.868849] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T18:02:54.050989] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T18:02:54.097612] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-30T18:02:54.897528] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-30T18:02:55.461118] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T18:02:55.697546] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-30T18:02:56.457174] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-30T18:02:56.497580] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-30T18:02:56.741839] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T18:02:57.297501] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-30T18:02:57.811675] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:02:58.097480] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-30T18:02:58.185833] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T18:02:58.897498] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-30T18:02:59.255080] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T18:02:59.600460] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-30T18:02:59.697490] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-30T18:03:00.502586] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-30T18:03:00.512062] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T18:03:01.297548] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-30T18:03:01.789285] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T18:03:02.097490] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-30T18:03:02.754228] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:03:02.897510] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-30T18:03:03.697481] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-30T18:03:03.744917] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-30T18:03:04.169073] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T18:03:04.497516] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-30T18:03:04.946841] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:03:05.297491] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-30T18:03:06.032746] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-30T18:03:06.097500] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-30T18:03:06.432759] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T18:03:06.897542] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-30T18:03:07.494294] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T18:03:07.507910] [INFO ] [REMOTE ] CNX: Full fetch complete (74887 records). [2025-10-30T18:03:07.508171] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-30T18:03:07.703580] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-30T18:03:07.938830] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-30T18:03:07.938971] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-30T18:03:07.940138] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-30T18:03:07.940209] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-30T18:03:07.942283] [DEBUG] [LOCAL ] CNX: Trimmed 74887 records to 51667 (keeping 200 days of data) [2025-10-30T18:03:08.162116] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T18:03:08.207904] [INFO ] [REMOTE ] CNS: Full fetch complete (31491 records). [2025-10-30T18:03:08.215257] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-30T18:03:08.236913] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:03:08.237110] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:03:08.237370] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:03:08.237446] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-30T18:03:08.237516] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-30T18:03:08.237554] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-30T18:03:08.237594] [DEBUG] [LOCAL ] CNS: No derivative data file found to delete. [2025-10-30T18:03:08.237682] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNS took 29.5s. Estimated remaining: 3h 55m 28s. Rate: 7.9 symbols/min [2025-10-30T18:03:08.439828] [DEBUG] [LOCAL ] CNX: Primary data saved (51667 records). [2025-10-30T18:03:08.445151] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-30T18:03:08.450403] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CNX took 29.0s. Estimated remaining: 3h 54m 53s. Rate: 7.9 symbols/min [2025-10-30T18:03:08.522329] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-30T18:03:08.535600] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:08.718005] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:08.760525] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-30T18:03:08.760865] [INFO ] [MAIN ] COF: Loaded 53625 existing records. [2025-10-30T18:03:08.984877] [DEBUG] [LOCAL ] COHR: Loaded 53371 existing records from primary storage. [2025-10-30T18:03:08.983224] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:03:08.985144] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-30T18:03:08.985287] [INFO ] [MAIN ] COHR: Loaded 53371 existing records. [2025-10-30T18:03:08.985198] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-30T18:03:09.058548] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-30T18:03:09.064525] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-30T18:03:09.282529] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:03:09.283114] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-30T18:03:09.288696] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-30T18:03:09.332107] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-30T18:03:09.338817] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-30T18:03:09.720512] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:09.754119] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-30T18:03:09.921350] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-30T18:03:10.005020] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:10.006752] [INFO ] [REMOTE ] CODI: Full fetch complete (54787 records). [2025-10-30T18:03:10.006953] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-30T18:03:10.098717] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-30T18:03:10.151559] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-30T18:03:10.491375] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-30T18:03:10.491454] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-30T18:03:10.492103] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-30T18:03:10.492165] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-30T18:03:10.493258] [DEBUG] [LOCAL ] CODI: Trimmed 54787 records to 42520 (keeping 200 days of data) [2025-10-30T18:03:10.725990] [DEBUG] [LOCAL ] CODI: Primary data saved (42520 records). [2025-10-30T18:03:10.726131] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-30T18:03:10.726204] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. CODI took 29.7s. Estimated remaining: 3h 54m 26s. Rate: 8.0 symbols/min [2025-10-30T18:03:10.902598] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-30T18:03:10.903760] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:10.953834] [DEBUG] [LOCAL ] COLD: Loaded 52504 existing records from primary storage. [2025-10-30T18:03:10.954140] [INFO ] [MAIN ] COLD: Loaded 52504 existing records. [2025-10-30T18:03:11.143202] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:03:11.143572] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-30T18:03:11.143818] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-30T18:03:11.144188] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-30T18:03:11.144248] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-30T18:03:11.528953] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:11.558812] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-30T18:03:11.697488] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-30T18:03:11.837926] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-30T18:03:12.346585] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T18:03:12.356916] [INFO ] [REMOTE ] CNR: Full fetch complete (64663 records). [2025-10-30T18:03:12.357075] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-30T18:03:12.502856] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-30T18:03:12.764365] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-10-30T18:03:12.764453] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-10-30T18:03:12.765271] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-10-30T18:03:12.765334] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-10-30T18:03:12.766619] [DEBUG] [LOCAL ] CNR: Trimmed 64663 records to 43876 (keeping 200 days of data) [2025-10-30T18:03:13.041796] [DEBUG] [LOCAL ] CNR: Primary data saved (43876 records). [2025-10-30T18:03:13.041936] [INFO ] [MAIN ] CNR: Full history saved. [2025-10-30T18:03:13.042011] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. CNR took 44.2s. Estimated remaining: 3h 53m 59s. Rate: 8.0 symbols/min [2025-10-30T18:03:13.227232] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-30T18:03:13.257385] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:13.258989] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-30T18:03:13.259042] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-30T18:03:13.259151] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-30T18:03:13.259193] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-30T18:03:13.259233] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-30T18:03:13.259264] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-30T18:03:13.302766] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-30T18:03:13.617258] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:13.980482] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-30T18:03:14.097532] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-30T18:03:14.850711] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-30T18:03:14.897478] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-30T18:03:15.201227] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T18:03:15.697489] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-30T18:03:16.497515] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-30T18:03:16.689899] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-30T18:03:17.175963] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-30T18:03:17.297488] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-30T18:03:17.836614] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T18:03:18.097506] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-30T18:03:18.780386] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T18:03:18.897471] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-30T18:03:19.697499] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-30T18:03:19.944670] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-30T18:03:20.287141] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:03:20.497517] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-30T18:03:21.297517] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-30T18:03:21.492361] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-30T18:03:21.898031] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:03:22.097512] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-30T18:03:22.883033] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T18:03:22.898817] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-30T18:03:23.712038] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-30T18:03:23.746406] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-30T18:03:24.170016] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T18:03:24.497520] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-30T18:03:25.297470] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-30T18:03:25.510691] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-30T18:03:26.097496] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-30T18:03:26.290078] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-30T18:03:26.628030] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T18:03:26.897478] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-30T18:03:27.697528] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-30T18:03:27.886600] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-30T18:03:28.436004] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-30T18:03:28.497488] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-30T18:03:29.297506] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-30T18:03:29.527113] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-30T18:03:30.072901] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-30T18:03:30.097467] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-30T18:03:30.385097] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T18:03:30.897511] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-30T18:03:31.697505] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-30T18:03:32.128220] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-30T18:03:32.143098] [INFO ] [REMOTE ] COF: Full fetch complete (77719 records). [2025-10-30T18:03:32.143405] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-30T18:03:32.502600] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-30T18:03:32.621948] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-30T18:03:32.622181] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-30T18:03:32.623472] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-30T18:03:32.623634] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-30T18:03:32.626765] [DEBUG] [LOCAL ] COF: Trimmed 77719 records to 54015 (keeping 200 days of data) [2025-10-30T18:03:32.771022] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-30T18:03:33.017611] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-30T18:03:33.047319] [DEBUG] [LOCAL ] COF: Primary data saved (54015 records). [2025-10-30T18:03:33.047474] [INFO ] [MAIN ] COF: Full history saved. [2025-10-30T18:03:33.048104] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. COF took 24.8s. Estimated remaining: 3h 54m 38s. Rate: 7.9 symbols/min [2025-10-30T18:03:33.215119] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:33.215280] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-30T18:03:33.215316] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-30T18:03:33.215426] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-30T18:03:33.215468] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-30T18:03:33.215508] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-30T18:03:33.215540] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-30T18:03:33.303912] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-30T18:03:33.572273] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:34.097463] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-30T18:03:34.181944] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-30T18:03:34.897509] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-30T18:03:35.697474] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-30T18:03:35.904845] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-30T18:03:35.980229] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-30T18:03:36.497493] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-30T18:03:37.224684] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-30T18:03:37.297503] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-30T18:03:37.453170] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-30T18:03:37.765185] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T18:03:38.097505] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-30T18:03:38.897509] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-30T18:03:39.221560] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-30T18:03:39.697482] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-30T18:03:39.797459] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-30T18:03:40.032895] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T18:03:40.497518] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-30T18:03:41.297504] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-30T18:03:41.971576] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:03:42.097715] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-30T18:03:42.097789] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-30T18:03:42.897494] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-30T18:03:43.433110] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-30T18:03:43.444542] [INFO ] [REMOTE ] COMP: Full fetch complete (77028 records). [2025-10-30T18:03:43.444714] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-30T18:03:43.445424] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:03:43.445517] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:03:43.445577] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:03:43.445670] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-30T18:03:43.445759] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-30T18:03:43.445804] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-30T18:03:43.445845] [DEBUG] [LOCAL ] COMP: No derivative data file found to delete. [2025-10-30T18:03:43.445900] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. COMP took 30.4s. Estimated remaining: 3h 54m 41s. Rate: 7.9 symbols/min [2025-10-30T18:03:43.621862] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:43.647171] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-30T18:03:43.678357] [DEBUG] [LOCAL ] COOK: Loaded 24631 existing records from primary storage. [2025-10-30T18:03:43.678671] [INFO ] [MAIN ] COOK: Loaded 24631 existing records. [2025-10-30T18:03:43.702564] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-30T18:03:43.869731] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:03:43.870363] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-30T18:03:43.870422] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-30T18:03:43.871139] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-30T18:03:43.871197] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-30T18:03:44.275734] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:44.497499] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-30T18:03:45.106176] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-30T18:03:45.117914] [INFO ] [REMOTE ] COHR: Full fetch complete (77468 records). [2025-10-30T18:03:45.118040] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-30T18:03:45.311776] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-30T18:03:45.528949] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-30T18:03:45.529326] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-30T18:03:45.530351] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-30T18:03:45.530543] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-30T18:03:45.532491] [DEBUG] [LOCAL ] COHR: Trimmed 77468 records to 53758 (keeping 200 days of data) [2025-10-30T18:03:45.655049] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-30T18:03:45.805319] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T18:03:45.925665] [DEBUG] [LOCAL ] COHR: Primary data saved (53758 records). [2025-10-30T18:03:45.925797] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-30T18:03:45.925883] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COHR took 37.4s. Estimated remaining: 3h 54m 15s. Rate: 7.9 symbols/min [2025-10-30T18:03:46.090725] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:46.090889] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-30T18:03:46.090925] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-30T18:03:46.091035] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-30T18:03:46.091075] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-30T18:03:46.091115] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-30T18:03:46.091147] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-30T18:03:46.103928] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-30T18:03:46.366686] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T18:03:46.471716] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:46.897491] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-30T18:03:47.697490] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-30T18:03:47.995930] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-30T18:03:48.008152] [INFO ] [REMOTE ] COLD: Full fetch complete (75106 records). [2025-10-30T18:03:48.008306] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-30T18:03:48.325509] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T18:03:48.501100] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-30T18:03:48.501444] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-30T18:03:48.502324] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-30T18:03:48.503211] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-30T18:03:48.503378] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-30T18:03:48.497592] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-30T18:03:48.513457] [DEBUG] [LOCAL ] COLD: Trimmed 75106 records to 52894 (keeping 200 days of data) [2025-10-30T18:03:48.827429] [DEBUG] [LOCAL ] COLD: Primary data saved (52894 records). [2025-10-30T18:03:48.827567] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-30T18:03:48.828347] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. COLD took 38.1s. Estimated remaining: 3h 53m 50s. Rate: 8.0 symbols/min [2025-10-30T18:03:48.994830] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:03:49.046535] [DEBUG] [LOCAL ] COR: Loaded 45866 existing records from primary storage. [2025-10-30T18:03:49.046865] [INFO ] [MAIN ] COR: Loaded 45866 existing records. [2025-10-30T18:03:49.244607] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:03:49.245155] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-30T18:03:49.245276] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-30T18:03:49.251118] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-30T18:03:49.257516] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-30T18:03:49.258513] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T18:03:49.302595] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-30T18:03:49.661951] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:03:50.097518] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-30T18:03:50.521187] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T18:03:50.897548] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-30T18:03:51.335887] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T18:03:51.697554] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-30T18:03:52.331163] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T18:03:52.497555] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-30T18:03:52.971995] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T18:03:53.297511] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-30T18:03:54.011635] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-30T18:03:54.097476] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-30T18:03:54.608246] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T18:03:54.897570] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-30T18:03:55.257092] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T18:03:55.697508] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-30T18:03:56.139555] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T18:03:56.497540] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-30T18:03:56.924606] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T18:03:57.297500] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-30T18:03:57.839612] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:03:58.097483] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-30T18:03:58.162078] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T18:03:58.897519] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-30T18:03:59.697503] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-30T18:03:59.722227] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-30T18:03:59.902760] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-30T18:04:00.497503] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-30T18:04:01.207180] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-30T18:04:01.297483] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-30T18:04:01.979011] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-30T18:04:02.097496] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-30T18:04:02.725217] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T18:04:02.736093] [INFO ] [REMOTE ] CON: Full fetch complete (56175 records). [2025-10-30T18:04:02.736358] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-30T18:04:02.738066] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:04:02.738280] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:04:02.738351] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:04:02.738431] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-30T18:04:02.738507] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-30T18:04:02.738546] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-30T18:04:02.738588] [DEBUG] [LOCAL ] CON: No derivative data file found to delete. [2025-10-30T18:04:02.738684] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. CON took 29.7s. Estimated remaining: 3h 54m 6s. Rate: 7.9 symbols/min [2025-10-30T18:04:02.904109] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:02.902466] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-30T18:04:02.954317] [DEBUG] [LOCAL ] COTY: Loaded 53245 existing records from primary storage. [2025-10-30T18:04:02.954623] [INFO ] [MAIN ] COTY: Loaded 53245 existing records. [2025-10-30T18:04:03.132281] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:04:03.132493] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-30T18:04:03.132561] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-30T18:04:03.133249] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-30T18:04:03.133306] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-30T18:04:03.499723] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:04:03.615369] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-30T18:04:03.697468] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-30T18:04:04.497507] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-30T18:04:04.643973] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-30T18:04:04.781416] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T18:04:05.297466] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-30T18:04:05.463742] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T18:04:06.097499] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-30T18:04:06.759240] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-30T18:04:06.897545] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-30T18:04:07.253744] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-30T18:04:07.678206] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T18:04:07.697453] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-30T18:04:08.497484] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-30T18:04:08.666917] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T18:04:09.297499] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-30T18:04:09.848290] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T18:04:10.097523] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-30T18:04:10.572256] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T18:04:10.897569] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-30T18:04:11.702678] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-30T18:04:11.734091] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-30T18:04:12.021994] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T18:04:12.497549] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-30T18:04:12.726144] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-30T18:04:12.731663] [INFO ] [REMOTE ] COOK: Full fetch complete (33032 records). [2025-10-30T18:04:12.731770] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-30T18:04:12.732252] [FATAL] [VALIDATOR ] COOK: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:04:12.732333] [FATAL] [MAIN ] COOK: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:04:12.732375] [WARN ] [MAIN ] COOK: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:04:12.732444] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-30T18:04:12.732505] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-30T18:04:12.732542] [INFO ] [LOCAL ] COOK: Starting deletion of derivative data. [2025-10-30T18:04:12.732721] [DEBUG] [LOCAL ] COOK: Deleted derivative data file. [2025-10-30T18:04:12.732806] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. COOK took 29.3s. Estimated remaining: 3h 54m 7s. Rate: 7.9 symbols/min [2025-10-30T18:04:12.896265] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:12.896482] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-10-30T18:04:12.896524] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-10-30T18:04:12.896634] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-30T18:04:12.896848] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-30T18:04:12.896897] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-30T18:04:12.896930] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-30T18:04:13.297980] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:04:13.298085] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-30T18:04:14.090968] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-30T18:04:14.102170] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-30T18:04:14.735876] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T18:04:14.745077] [INFO ] [REMOTE ] COR: Full fetch complete (67848 records). [2025-10-30T18:04:14.745196] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-30T18:04:14.745951] [FATAL] [VALIDATOR ] COR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:04:14.746056] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:04:14.746098] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:04:14.746162] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-30T18:04:14.746224] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-30T18:04:14.746259] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-10-30T18:04:14.746430] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-10-30T18:04:14.747186] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COR took 25.9s. Estimated remaining: 3h 53m 39s. Rate: 7.9 symbols/min [2025-10-30T18:04:14.910944] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-30T18:04:14.913536] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:14.963764] [DEBUG] [LOCAL ] CP: Loaded 53201 existing records from primary storage. [2025-10-30T18:04:14.964074] [INFO ] [MAIN ] CP: Loaded 53201 existing records. [2025-10-30T18:04:15.152978] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:04:15.153187] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-30T18:04:15.153235] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-30T18:04:15.153753] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-30T18:04:15.153811] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-30T18:04:15.530104] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:04:15.558593] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-30T18:04:15.697474] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-30T18:04:16.497505] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-30T18:04:17.038022] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-30T18:04:17.049935] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-30T18:04:17.050122] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-30T18:04:17.306112] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-30T18:04:17.480732] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-30T18:04:17.481432] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-30T18:04:17.482373] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-30T18:04:17.483880] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-30T18:04:17.483798] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-30T18:04:17.496070] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54117 (keeping 200 days of data) [2025-10-30T18:04:17.816508] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-30T18:04:17.816663] [INFO ] [MAIN ] COP: Full history saved. [2025-10-30T18:04:17.816756] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COP took 31.9s. Estimated remaining: 3h 53m 15s. Rate: 8.0 symbols/min [2025-10-30T18:04:17.984513] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:18.017587] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-30T18:04:18.050790] [DEBUG] [LOCAL ] CPA: Loaded 27196 existing records from primary storage. [2025-10-30T18:04:18.051051] [INFO ] [MAIN ] CPA: Loaded 27196 existing records. [2025-10-30T18:04:18.103698] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-30T18:04:18.229423] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:04:18.229693] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-30T18:04:18.229756] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-30T18:04:18.230404] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-30T18:04:18.230461] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-30T18:04:18.580021] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:04:18.608883] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T18:04:18.897518] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-30T18:04:19.531818] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T18:04:19.697524] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-30T18:04:20.091114] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T18:04:20.497503] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-30T18:04:21.175715] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T18:04:21.297470] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-30T18:04:21.414801] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T18:04:22.097503] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-30T18:04:22.630008] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T18:04:22.897486] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-30T18:04:23.251340] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T18:04:23.697528] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-30T18:04:23.879765] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T18:04:24.497551] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-30T18:04:25.048392] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T18:04:25.297491] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-30T18:04:25.911050] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T18:04:26.097500] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-30T18:04:26.762210] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:04:26.897499] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-30T18:04:27.291376] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:04:27.697497] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-30T18:04:28.370769] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-30T18:04:28.497496] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-30T18:04:29.035490] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T18:04:29.297528] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-30T18:04:29.909607] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T18:04:30.097465] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-30T18:04:30.275576] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T18:04:30.897513] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-30T18:04:31.697466] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-30T18:04:31.814434] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T18:04:31.928996] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-30T18:04:31.940738] [INFO ] [REMOTE ] COTY: Full fetch complete (77288 records). [2025-10-30T18:04:31.940870] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-30T18:04:32.332381] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-30T18:04:32.332460] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-30T18:04:32.333302] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-30T18:04:32.333365] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-30T18:04:32.334772] [DEBUG] [LOCAL ] COTY: Trimmed 77288 records to 53633 (keeping 200 days of data) [2025-10-30T18:04:32.527764] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-30T18:04:32.648748] [DEBUG] [LOCAL ] COTY: Primary data saved (53633 records). [2025-10-30T18:04:32.648932] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-30T18:04:32.649622] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. COTY took 29.9s. Estimated remaining: 3h 53m 34s. Rate: 7.9 symbols/min [2025-10-30T18:04:32.828456] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:32.828672] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-30T18:04:32.828729] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-30T18:04:32.828842] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-30T18:04:32.828901] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-30T18:04:32.828946] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-30T18:04:32.828980] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-30T18:04:33.306439] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-30T18:04:33.332283] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:04:33.385489] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-30T18:04:33.625183] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T18:04:34.097584] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-30T18:04:34.563987] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-30T18:04:34.809669] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T18:04:34.897527] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-30T18:04:35.697515] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-30T18:04:36.309977] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T18:04:36.497472] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-30T18:04:36.678299] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T18:04:36.780853] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-30T18:04:37.297498] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-30T18:04:38.097534] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-30T18:04:38.369056] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-30T18:04:38.523262] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T18:04:38.897494] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-30T18:04:39.697503] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-30T18:04:39.758042] [DEBUG] [REMOTE ] CPA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-30T18:04:39.758350] [WARN ] [REMOTE ] CPA: No data returned for month 2025-07 [2025-10-30T18:04:39.758430] [FATAL] [REMOTE ] CPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:04:39.758503] [FATAL] [MAIN ] CPA: Failed to fetch primary data. [2025-10-30T18:04:39.758564] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:04:39.758636] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-30T18:04:39.758738] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-30T18:04:39.758776] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-30T18:04:39.758969] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-10-30T18:04:39.759052] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. CPA took 21.9s. Estimated remaining: 3h 53m 25s. Rate: 7.9 symbols/min [2025-10-30T18:04:39.924097] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:39.924264] [DEBUG] [LOCAL ] CPAY: No existing data file found in primary storage. [2025-10-30T18:04:39.924301] [WARN ] [MAIN ] CPAY: No existing data found, performing full refresh instead. [2025-10-30T18:04:39.924409] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-30T18:04:39.924449] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-30T18:04:39.924489] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-10-30T18:04:39.924521] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-30T18:04:40.294468] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:04:40.497494] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-30T18:04:40.733223] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-30T18:04:40.744571] [INFO ] [REMOTE ] COUR: Full fetch complete (71445 records). [2025-10-30T18:04:40.744745] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-30T18:04:41.125190] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-30T18:04:41.125276] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-30T18:04:41.126067] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-30T18:04:41.126129] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-30T18:04:41.127502] [DEBUG] [LOCAL ] COUR: Trimmed 71445 records to 49834 (keeping 200 days of data) [2025-10-30T18:04:41.315354] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-30T18:04:41.443236] [DEBUG] [LOCAL ] COUR: Primary data saved (49834 records). [2025-10-30T18:04:41.443497] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-30T18:04:41.443668] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. COUR took 28.7s. Estimated remaining: 3h 52m 56s. Rate: 8.0 symbols/min [2025-10-30T18:04:41.628105] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:41.628358] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-30T18:04:41.628480] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-30T18:04:41.628615] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-30T18:04:41.628860] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-30T18:04:41.628945] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-30T18:04:41.629000] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-30T18:04:41.774742] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T18:04:42.046919] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:04:42.097450] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-30T18:04:42.838193] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-30T18:04:42.897476] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-30T18:04:43.070066] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T18:04:43.697468] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-30T18:04:43.867532] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T18:04:44.349153] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-30T18:04:44.497495] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-30T18:04:44.827234] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-30T18:04:45.297498] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-30T18:04:45.556754] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-30T18:04:46.097495] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-30T18:04:46.897502] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-30T18:04:47.450788] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T18:04:47.697485] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-30T18:04:47.995312] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T18:04:48.497496] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-30T18:04:48.968079] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T18:04:49.297501] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-30T18:04:49.525621] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T18:04:50.039067] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-30T18:04:50.097522] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-30T18:04:50.854439] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-30T18:04:50.897513] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-30T18:04:51.563216] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T18:04:51.697490] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-30T18:04:52.497521] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-30T18:04:52.989515] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T18:04:53.297499] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-30T18:04:53.583939] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-30T18:04:53.960542] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:04:54.097497] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-30T18:04:54.897495] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-30T18:04:55.368585] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T18:04:55.599598] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T18:04:55.697517] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-30T18:04:56.497568] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-30T18:04:57.205524] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T18:04:57.297471] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-30T18:04:57.526984] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T18:04:58.097499] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-30T18:04:58.566812] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-30T18:04:58.791894] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T18:04:58.805349] [INFO ] [REMOTE ] CP: Full fetch complete (77288 records). [2025-10-30T18:04:58.805494] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-30T18:04:58.902704] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-30T18:04:59.207845] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-30T18:04:59.207936] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-30T18:04:59.208784] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-30T18:04:59.208847] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-30T18:04:59.210562] [DEBUG] [LOCAL ] CP: Trimmed 77288 records to 53590 (keeping 200 days of data) [2025-10-30T18:04:59.530861] [DEBUG] [LOCAL ] CP: Primary data saved (53590 records). [2025-10-30T18:04:59.530984] [INFO ] [MAIN ] CP: Full history saved. [2025-10-30T18:04:59.531755] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. CP took 44.8s. Estimated remaining: 3h 53m 27s. Rate: 7.9 symbols/min [2025-10-30T18:04:59.697504] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-30T18:04:59.714979] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:04:59.716569] [DEBUG] [LOCAL ] CPK: No existing data file found in primary storage. [2025-10-30T18:04:59.716737] [WARN ] [MAIN ] CPK: No existing data found, performing full refresh instead. [2025-10-30T18:04:59.716491] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T18:04:59.717021] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-30T18:04:59.721040] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-30T18:04:59.721433] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-30T18:04:59.721487] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-30T18:04:59.995563] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T18:05:00.076710] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:00.497504] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-30T18:05:01.297511] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-30T18:05:01.687672] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T18:05:01.783348] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T18:05:02.097508] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-30T18:05:02.897539] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-30T18:05:03.185437] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T18:05:03.697458] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-30T18:05:03.727422] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-30T18:05:04.247380] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T18:05:04.248722] [INFO ] [REMOTE ] CPAC: Full fetch complete (1795 records). [2025-10-30T18:05:04.248837] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-30T18:05:04.442190] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T18:05:04.442551] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:05:04.442626] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:05:04.442729] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-30T18:05:04.443067] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-30T18:05:04.443325] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-30T18:05:04.443416] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-30T18:05:04.443559] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CPAC took 31.8s. Estimated remaining: 3h 53m 10s. Rate: 7.9 symbols/min [2025-10-30T18:05:04.505973] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-30T18:05:04.617573] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:04.667480] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-30T18:05:04.667843] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-30T18:05:04.847965] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:05:04.848204] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-30T18:05:04.848257] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-30T18:05:04.848750] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-30T18:05:04.848811] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-30T18:05:05.216098] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:05.297468] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-30T18:05:05.746253] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T18:05:06.097506] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-30T18:05:06.882689] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-30T18:05:06.898059] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-30T18:05:06.971157] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T18:05:07.697492] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-30T18:05:07.919944] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T18:05:08.497493] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-30T18:05:09.058278] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T18:05:09.297501] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-30T18:05:09.458403] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-30T18:05:10.056144] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T18:05:10.061463] [INFO ] [REMOTE ] CPF: Full fetch complete (23143 records). [2025-10-30T18:05:10.061605] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-30T18:05:10.102710] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-30T18:05:10.473501] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-30T18:05:10.473603] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-30T18:05:10.474308] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-30T18:05:10.474376] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-30T18:05:10.475349] [DEBUG] [LOCAL ] CPF: Trimmed 23143 records to 14985 (keeping 200 days of data) [2025-10-30T18:05:10.571144] [DEBUG] [LOCAL ] CPF: Primary data saved (14985 records). [2025-10-30T18:05:10.571333] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-30T18:05:10.571420] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPF took 29.1s. Estimated remaining: 3h 52m 57s. Rate: 7.9 symbols/min [2025-10-30T18:05:10.897556] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-30T18:05:11.191478] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T18:05:11.198437] [INFO ] [REMOTE ] CPAY: Full fetch complete (44534 records). [2025-10-30T18:05:11.198580] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-30T18:05:11.607506] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-30T18:05:11.607886] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-30T18:05:11.608774] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-30T18:05:11.608846] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-30T18:05:11.610228] [DEBUG] [LOCAL ] CPAY: Trimmed 44534 records to 29838 (keeping 200 days of data) [2025-10-30T18:05:11.698708] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-30T18:05:11.794575] [DEBUG] [LOCAL ] CPAY: Primary data saved (29838 records). [2025-10-30T18:05:11.794742] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-30T18:05:11.794825] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPAY took 32.0s. Estimated remaining: 3h 52m 27s. Rate: 8.0 symbols/min [2025-10-30T18:05:12.361790] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-30T18:05:12.497554] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-30T18:05:12.610896] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-30T18:05:13.271245] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-30T18:05:13.297501] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-30T18:05:13.800363] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-30T18:05:14.097542] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-30T18:05:14.722443] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-30T18:05:14.897491] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-30T18:05:15.697568] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-30T18:05:16.824357] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-30T18:05:16.825341] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T18:05:16.837023] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-30T18:05:17.297506] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-30T18:05:17.757555] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T18:05:18.097613] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-30T18:05:18.786871] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-30T18:05:18.897512] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-30T18:05:19.186992] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-30T18:05:19.697745] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-30T18:05:19.762767] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-30T18:05:19.766607] [INFO ] [REMOTE ] CPK: Full fetch complete (18862 records). [2025-10-30T18:05:19.766713] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-30T18:05:19.767135] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:05:19.767215] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:05:19.767257] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:05:19.767326] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-30T18:05:19.767388] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-30T18:05:19.767423] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-10-30T18:05:19.767463] [DEBUG] [LOCAL ] CPK: No derivative data file found to delete. [2025-10-30T18:05:19.767513] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPK took 20.2s. Estimated remaining: 3h 52m 21s. Rate: 7.9 symbols/min [2025-10-30T18:05:21.374266] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-30T18:05:21.387036] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-30T18:05:23.421703] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-30T18:05:23.434786] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-30T18:05:25.387056] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-30T18:05:25.399731] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-30T18:05:27.003399] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-30T18:05:27.016126] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-30T18:05:28.958197] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-30T18:05:28.970613] [INFO ] [REMOTE ] CPNG: Full fetch complete (77793 records). [2025-10-30T18:05:28.970801] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-30T18:05:29.382071] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-30T18:05:29.382164] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-30T18:05:29.383005] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-30T18:05:29.383110] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-30T18:05:29.384545] [DEBUG] [LOCAL ] CPNG: Trimmed 77793 records to 54069 (keeping 200 days of data) [2025-10-30T18:05:29.720367] [DEBUG] [LOCAL ] CPNG: Primary data saved (54069 records). [2025-10-30T18:05:29.720561] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-30T18:05:29.721155] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPNG took 25.3s. Estimated remaining: 3h 52m 22s. Rate: 7.9 symbols/min [2025-10-30T18:05:30.327132] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:30.406267] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:30.444708] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:30.507333] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:30.525747] [DEBUG] [LOCAL ] CQP: Loaded 18643 existing records from primary storage. [2025-10-30T18:05:30.526425] [INFO ] [MAIN ] CQP: Loaded 18643 existing records. [2025-10-30T18:05:30.651713] [DEBUG] [LOCAL ] CPS: Loaded 24123 existing records from primary storage. [2025-10-30T18:05:30.684732] [INFO ] [MAIN ] CPS: Loaded 24123 existing records. [2025-10-30T18:05:30.695502] [DEBUG] [LOCAL ] CPRI: Loaded 52314 existing records from primary storage. [2025-10-30T18:05:30.713069] [INFO ] [MAIN ] CPRI: Loaded 52314 existing records. [2025-10-30T18:05:30.891137] [DEBUG] [LOCAL ] CPT: Loaded 44270 existing records from primary storage. [2025-10-30T18:05:30.902672] [INFO ] [MAIN ] CPT: Loaded 44270 existing records. [2025-10-30T18:05:30.978020] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:05:31.089460] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-30T18:05:31.111477] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-30T18:05:31.152900] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-30T18:05:31.183521] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-30T18:05:31.395750] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:05:31.453199] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-30T18:05:31.462439] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:05:31.510690] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-30T18:05:31.547064] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:05:31.543036] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-30T18:05:31.553000] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-30T18:05:31.568864] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-30T18:05:31.563635] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-30T18:05:31.574383] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-30T18:05:31.569102] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-30T18:05:31.579817] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-30T18:05:31.585045] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-30T18:05:31.734111] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-30T18:05:31.739485] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-30T18:05:32.632508] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:32.657232] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-30T18:05:32.875022] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:32.878356] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:32.878623] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-30T18:05:32.879081] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-30T18:05:32.958258] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:32.958523] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-30T18:05:33.687050] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-30T18:05:33.691804] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-30T18:05:33.786501] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T18:05:33.792162] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-30T18:05:34.141949] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T18:05:34.151443] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-30T18:05:34.450849] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-30T18:05:34.461496] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-30T18:05:34.492245] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T18:05:34.497869] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-30T18:05:34.627833] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T18:05:34.633427] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-30T18:05:35.122192] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T18:05:35.131369] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-30T18:05:35.225068] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-30T18:05:35.232348] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-30T18:05:35.483564] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T18:05:35.492875] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-30T18:05:35.574434] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T18:05:35.586527] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-30T18:05:35.982694] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-30T18:05:35.987172] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-30T18:05:36.454286] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T18:05:36.462039] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-30T18:05:36.492607] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T18:05:36.502892] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-30T18:05:36.607169] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-30T18:05:36.878267] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T18:05:37.297510] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-30T18:05:37.500154] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T18:05:37.841850] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:05:38.097480] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-30T18:05:38.124824] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T18:05:38.897515] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-30T18:05:39.326703] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T18:05:39.691810] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-30T18:05:39.697728] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-30T18:05:40.478804] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T18:05:40.497534] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-30T18:05:40.558496] [DEBUG] [REMOTE ] CPRI: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-30T18:05:40.558873] [WARN ] [REMOTE ] CPRI: No data returned for month 2025-04 [2025-10-30T18:05:40.559019] [FATAL] [REMOTE ] CPRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:05:40.559122] [FATAL] [MAIN ] CPRI: Failed to fetch primary data. [2025-10-30T18:05:40.559189] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:05:40.559258] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-30T18:05:40.559336] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-30T18:05:40.559390] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-10-30T18:05:40.559854] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-10-30T18:05:40.559949] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CPRI took 10.8s. Estimated remaining: 3h 52m 26s. Rate: 7.9 symbols/min [2025-10-30T18:05:40.728099] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:40.728271] [DEBUG] [LOCAL ] CR: No existing data file found in primary storage. [2025-10-30T18:05:40.728314] [WARN ] [MAIN ] CR: No existing data found, performing full refresh instead. [2025-10-30T18:05:40.728422] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-30T18:05:40.728462] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-30T18:05:40.728501] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-10-30T18:05:40.728533] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-30T18:05:41.084537] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:41.297499] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-30T18:05:42.097497] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-30T18:05:42.503324] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T18:05:42.897468] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-30T18:05:43.032166] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T18:05:43.697505] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-30T18:05:43.732888] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-30T18:05:44.451747] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T18:05:44.497508] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-30T18:05:45.088335] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-30T18:05:45.297513] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-30T18:05:46.097468] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-30T18:05:46.135735] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:05:46.139836] [INFO ] [REMOTE ] CQP: Full fetch complete (29273 records). [2025-10-30T18:05:46.139971] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-30T18:05:46.519785] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-30T18:05:46.519869] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-30T18:05:46.520371] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-30T18:05:46.520413] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-30T18:05:46.521245] [DEBUG] [LOCAL ] CQP: Trimmed 29273 records to 18800 (keeping 200 days of data) [2025-10-30T18:05:46.633497] [DEBUG] [LOCAL ] CQP: Primary data saved (18800 records). [2025-10-30T18:05:46.633637] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-30T18:05:46.633759] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CQP took 16.9s. Estimated remaining: 3h 52m 13s. Rate: 7.9 symbols/min [2025-10-30T18:05:46.800638] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:46.800846] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-10-30T18:05:46.800883] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-10-30T18:05:46.800991] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-30T18:05:46.801032] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-30T18:05:46.801074] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-30T18:05:46.801104] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-30T18:05:46.900317] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-30T18:05:47.165904] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:47.180525] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T18:05:47.697467] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-30T18:05:47.732003] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T18:05:48.497480] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-30T18:05:48.601280] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-30T18:05:48.606388] [INFO ] [REMOTE ] CPS: Full fetch complete (36511 records). [2025-10-30T18:05:48.606491] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-30T18:05:48.984402] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-30T18:05:48.984481] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-30T18:05:48.985010] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-30T18:05:48.985072] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-30T18:05:48.985915] [DEBUG] [LOCAL ] CPS: Trimmed 36511 records to 24325 (keeping 200 days of data) [2025-10-30T18:05:49.127629] [DEBUG] [LOCAL ] CPS: Primary data saved (24325 records). [2025-10-30T18:05:49.127804] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-30T18:05:49.127918] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CPS took 19.4s. Estimated remaining: 3h 51m 48s. Rate: 8.0 symbols/min [2025-10-30T18:05:49.296443] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:05:49.297580] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-30T18:05:49.344480] [DEBUG] [LOCAL ] CRBG: Loaded 52558 existing records from primary storage. [2025-10-30T18:05:49.344842] [INFO ] [MAIN ] CRBG: Loaded 52558 existing records. [2025-10-30T18:05:49.527083] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:05:49.527288] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-30T18:05:49.527336] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-30T18:05:49.528192] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-30T18:05:49.528249] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-30T18:05:49.930070] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:05:49.956420] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-30T18:05:50.097469] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-30T18:05:50.184741] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T18:05:50.897513] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-30T18:05:51.429473] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T18:05:51.697491] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-30T18:05:52.163788] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T18:05:52.357613] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-30T18:05:52.497529] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-30T18:05:53.297529] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-30T18:05:53.599173] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-30T18:05:54.097514] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-30T18:05:54.625317] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T18:05:54.897478] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-30T18:05:55.000775] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T18:05:55.697506] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-30T18:05:56.081637] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T18:05:56.497495] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-30T18:05:56.908685] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T18:05:56.969869] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T18:05:57.297505] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-30T18:05:58.097485] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-30T18:05:58.769110] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T18:05:58.897480] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-30T18:05:58.938123] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T18:05:59.697503] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-30T18:06:00.498246] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-30T18:06:00.500965] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-30T18:06:00.743737] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-30T18:06:01.297499] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-30T18:06:02.075686] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T18:06:02.097457] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-30T18:06:02.897469] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-30T18:06:03.121188] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-30T18:06:03.131174] [INFO ] [REMOTE ] CPT: Full fetch complete (64931 records). [2025-10-30T18:06:03.131308] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-30T18:06:03.524385] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-30T18:06:03.524481] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-30T18:06:03.525298] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-30T18:06:03.525379] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-30T18:06:03.526827] [DEBUG] [LOCAL ] CPT: Trimmed 64931 records to 44659 (keeping 200 days of data) [2025-10-30T18:06:03.643693] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-30T18:06:03.741367] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-30T18:06:03.841686] [DEBUG] [LOCAL ] CPT: Primary data saved (44659 records). [2025-10-30T18:06:03.841831] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-30T18:06:03.841912] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CPT took 34.1s. Estimated remaining: 3h 52m 5s. Rate: 7.9 symbols/min [2025-10-30T18:06:04.017070] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:04.062112] [DEBUG] [LOCAL ] CRC: Loaded 43661 existing records from primary storage. [2025-10-30T18:06:04.062689] [INFO ] [MAIN ] CRC: Loaded 43661 existing records. [2025-10-30T18:06:04.180855] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:06:04.264081] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:06:04.264291] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-30T18:06:04.264339] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-30T18:06:04.265150] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-30T18:06:04.265207] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-30T18:06:04.502667] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-30T18:06:04.616484] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:05.138412] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-30T18:06:05.297469] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-30T18:06:05.336476] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-30T18:06:05.907986] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T18:06:06.097498] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-30T18:06:06.897518] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-30T18:06:07.479513] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T18:06:07.697566] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-30T18:06:08.110678] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T18:06:08.497559] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-30T18:06:08.857404] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T18:06:09.297535] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-30T18:06:09.550279] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T18:06:09.557963] [INFO ] [REMOTE ] CR: Full fetch complete (35162 records). [2025-10-30T18:06:09.558136] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-30T18:06:09.962939] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-30T18:06:09.963044] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-30T18:06:09.963551] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-30T18:06:09.963594] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-30T18:06:09.964410] [DEBUG] [LOCAL ] CR: Trimmed 35162 records to 24110 (keeping 200 days of data) [2025-10-30T18:06:10.101266] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-30T18:06:10.115799] [DEBUG] [LOCAL ] CR: Primary data saved (24110 records). [2025-10-30T18:06:10.115935] [INFO ] [MAIN ] CR: Full history saved. [2025-10-30T18:06:10.116010] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CR took 29.6s. Estimated remaining: 3h 51m 53s. Rate: 7.9 symbols/min [2025-10-30T18:06:10.301519] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:10.301702] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-30T18:06:10.301751] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-30T18:06:10.301859] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-30T18:06:10.301917] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-30T18:06:10.301991] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-30T18:06:10.302055] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-30T18:06:10.673472] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:10.674375] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-30T18:06:10.831844] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-30T18:06:10.843090] [INFO ] [REMOTE ] CRBG: Full fetch complete (75649 records). [2025-10-30T18:06:10.843217] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-30T18:06:10.844006] [FATAL] [VALIDATOR ] CRBG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:06:10.844270] [FATAL] [MAIN ] CRBG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:06:10.844355] [WARN ] [MAIN ] CRBG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:06:10.844449] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-30T18:06:10.844541] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-10-30T18:06:10.844591] [INFO ] [LOCAL ] CRBG: Starting deletion of derivative data. [2025-10-30T18:06:10.844813] [DEBUG] [LOCAL ] CRBG: Deleted derivative data file. [2025-10-30T18:06:10.845852] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBG took 21.7s. Estimated remaining: 3h 51m 22s. Rate: 8.0 symbols/min [2025-10-30T18:06:10.906975] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-30T18:06:11.022251] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:11.071119] [DEBUG] [LOCAL ] CRGY: Loaded 52483 existing records from primary storage. [2025-10-30T18:06:11.071426] [INFO ] [MAIN ] CRGY: Loaded 52483 existing records. [2025-10-30T18:06:11.245210] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:06:11.245427] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-30T18:06:11.245472] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-30T18:06:11.246283] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-30T18:06:11.246450] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-30T18:06:11.606201] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:11.697480] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-30T18:06:11.916114] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T18:06:12.037420] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-30T18:06:12.497492] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-30T18:06:12.648354] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T18:06:12.648696] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-30T18:06:12.648784] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:06:12.648836] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-30T18:06:12.648895] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:06:12.648965] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-30T18:06:12.649026] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-30T18:06:12.649062] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-30T18:06:12.649142] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-30T18:06:12.649231] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CRCL took 2.5s. Estimated remaining: 3h 50m 54s. Rate: 8.0 symbols/min [2025-10-30T18:06:12.839098] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:12.887798] [DEBUG] [LOCAL ] CRH: Loaded 53382 existing records from primary storage. [2025-10-30T18:06:12.888117] [INFO ] [MAIN ] CRH: Loaded 53382 existing records. [2025-10-30T18:06:13.073085] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:06:13.073325] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-30T18:06:13.073392] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-30T18:06:13.074443] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-30T18:06:13.074503] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-30T18:06:13.302782] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-30T18:06:13.631164] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:14.097505] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-30T18:06:14.627006] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T18:06:14.897502] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-30T18:06:15.547799] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T18:06:15.697565] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-30T18:06:15.838603] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T18:06:16.497501] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-30T18:06:17.104553] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-30T18:06:17.297561] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-30T18:06:17.768904] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:06:18.097503] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-30T18:06:18.795177] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T18:06:18.897504] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-30T18:06:19.255569] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T18:06:19.697615] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-30T18:06:20.170032] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T18:06:20.398991] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T18:06:20.497524] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-30T18:06:20.956394] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T18:06:21.297505] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-30T18:06:21.755396] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T18:06:22.097533] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-30T18:06:22.897491] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-30T18:06:23.689445] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-30T18:06:23.700094] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-30T18:06:24.213961] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T18:06:24.497508] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-30T18:06:24.890011] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T18:06:25.297473] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-30T18:06:25.737072] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-30T18:06:25.920249] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T18:06:26.097545] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-30T18:06:26.897495] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-30T18:06:27.312400] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T18:06:27.451942] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T18:06:27.453907] [INFO ] [REMOTE ] CRBD: Full fetch complete (12614 records). [2025-10-30T18:06:27.453983] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-30T18:06:27.702608] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-30T18:06:27.829617] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-30T18:06:27.829726] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-30T18:06:27.830043] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-30T18:06:27.830084] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-30T18:06:27.830531] [DEBUG] [LOCAL ] CRBD: Trimmed 12614 records to 8580 (keeping 200 days of data) [2025-10-30T18:06:27.885445] [DEBUG] [LOCAL ] CRBD: Primary data saved (8580 records). [2025-10-30T18:06:27.885565] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-30T18:06:27.885664] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRBD took 41.3s. Estimated remaining: 3h 51m 13s. Rate: 7.9 symbols/min [2025-10-30T18:06:28.082598] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:28.128876] [DEBUG] [LOCAL ] CRI: Loaded 49443 existing records from primary storage. [2025-10-30T18:06:28.129211] [INFO ] [MAIN ] CRI: Loaded 49443 existing records. [2025-10-30T18:06:28.329110] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:06:28.329324] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-30T18:06:28.329374] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-30T18:06:28.330381] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-30T18:06:28.330438] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-30T18:06:28.507930] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-30T18:06:28.679788] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:28.971101] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T18:06:29.297520] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-30T18:06:29.901874] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:06:30.097495] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-30T18:06:30.687209] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-30T18:06:30.897529] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-30T18:06:31.506751] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T18:06:31.697536] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-30T18:06:32.353985] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T18:06:32.497504] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-30T18:06:33.102684] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-30T18:06:33.112079] [INFO ] [REMOTE ] CRC: Full fetch complete (62629 records). [2025-10-30T18:06:33.112205] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-30T18:06:33.302628] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-30T18:06:33.488449] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-30T18:06:33.488531] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-30T18:06:33.489294] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-30T18:06:33.489359] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-30T18:06:33.490550] [DEBUG] [LOCAL ] CRC: Trimmed 62629 records to 43887 (keeping 200 days of data) [2025-10-30T18:06:33.750237] [DEBUG] [LOCAL ] CRC: Primary data saved (43887 records). [2025-10-30T18:06:33.750409] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-30T18:06:33.751271] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CRC took 29.9s. Estimated remaining: 3h 51m 0s. Rate: 8.0 symbols/min [2025-10-30T18:06:33.925175] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:33.955018] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-30T18:06:34.009919] [DEBUG] [LOCAL ] CRK: Loaded 52141 existing records from primary storage. [2025-10-30T18:06:34.010229] [INFO ] [MAIN ] CRK: Loaded 52141 existing records. [2025-10-30T18:06:34.105025] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-30T18:06:34.185816] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:06:34.186021] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-30T18:06:34.186068] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-30T18:06:34.186922] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-30T18:06:34.186978] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-30T18:06:34.537087] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:34.603449] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T18:06:34.897514] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-30T18:06:35.448393] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T18:06:35.697510] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-30T18:06:36.136268] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T18:06:36.497548] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-30T18:06:37.297503] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-30T18:06:37.413976] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-30T18:06:37.694318] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:06:38.097510] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-30T18:06:38.545775] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:06:38.897499] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-30T18:06:39.466836] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T18:06:39.697539] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-30T18:06:40.497481] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-30T18:06:40.547668] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-30T18:06:41.297533] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-30T18:06:41.302440] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-30T18:06:42.061663] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T18:06:42.097473] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-30T18:06:42.905828] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-30T18:06:42.911717] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T18:06:42.923720] [INFO ] [REMOTE ] CRGY: Full fetch complete (76165 records). [2025-10-30T18:06:42.923857] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-30T18:06:43.308341] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-30T18:06:43.308429] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-30T18:06:43.309267] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-30T18:06:43.309332] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-30T18:06:43.310747] [DEBUG] [LOCAL ] CRGY: Trimmed 76165 records to 52865 (keeping 200 days of data) [2025-10-30T18:06:43.638611] [DEBUG] [LOCAL ] CRGY: Primary data saved (52865 records). [2025-10-30T18:06:43.638888] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-30T18:06:43.639774] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRGY took 32.8s. Estimated remaining: 3h 51m 1s. Rate: 7.9 symbols/min [2025-10-30T18:06:43.711092] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-30T18:06:43.818088] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:43.851213] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-30T18:06:43.902369] [DEBUG] [LOCAL ] CRL: Loaded 42415 existing records from primary storage. [2025-10-30T18:06:43.902709] [INFO ] [MAIN ] CRL: Loaded 42415 existing records. [2025-10-30T18:06:44.077409] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:06:44.077776] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-30T18:06:44.077916] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-30T18:06:44.078737] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-30T18:06:44.078797] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-30T18:06:44.460967] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:44.490693] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T18:06:44.500768] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-30T18:06:44.757907] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:06:45.297525] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-30T18:06:45.765262] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:06:46.097510] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-30T18:06:46.849540] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T18:06:46.861291] [INFO ] [REMOTE ] CRH: Full fetch complete (77512 records). [2025-10-30T18:06:46.861439] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-30T18:06:46.904231] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-30T18:06:47.267268] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-30T18:06:47.267440] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-30T18:06:47.268315] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-30T18:06:47.268479] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-30T18:06:47.270045] [DEBUG] [LOCAL ] CRH: Trimmed 77512 records to 53772 (keeping 200 days of data) [2025-10-30T18:06:47.393351] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:06:47.638083] [DEBUG] [LOCAL ] CRH: Primary data saved (53772 records). [2025-10-30T18:06:47.638228] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-30T18:06:47.638309] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRH took 35.0s. Estimated remaining: 3h 50m 41s. Rate: 8.0 symbols/min [2025-10-30T18:06:47.706098] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-30T18:06:47.821764] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:06:47.894222] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-30T18:06:47.894677] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-30T18:06:48.074103] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:06:48.074297] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-30T18:06:48.074347] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-30T18:06:48.075260] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-30T18:06:48.075318] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-30T18:06:48.426616] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:06:48.465826] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-30T18:06:48.497485] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-30T18:06:49.208862] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T18:06:49.297515] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-30T18:06:50.097561] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-30T18:06:50.574382] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-30T18:06:50.778512] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T18:06:50.897507] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-30T18:06:51.299020] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:06:51.697510] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-30T18:06:52.161429] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T18:06:52.497480] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-30T18:06:53.003347] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T18:06:53.297470] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-30T18:06:53.933321] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T18:06:54.097490] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-30T18:06:54.674216] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T18:06:54.897544] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-30T18:06:55.261461] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T18:06:55.697560] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-30T18:06:56.497510] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-30T18:06:57.060092] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T18:06:57.099930] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-30T18:06:57.297507] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-30T18:06:57.775426] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:06:58.097551] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-30T18:06:58.897506] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-30T18:06:59.254293] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-30T18:06:59.426910] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T18:06:59.697533] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-30T18:07:00.144114] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T18:07:00.497588] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-30T18:07:01.211686] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-30T18:07:01.297581] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-30T18:07:02.097511] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-30T18:07:02.182441] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T18:07:02.193862] [INFO ] [REMOTE ] CRI: Full fetch complete (70704 records). [2025-10-30T18:07:02.194073] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-30T18:07:02.195001] [FATAL] [VALIDATOR ] CRI: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:07:02.195091] [FATAL] [MAIN ] CRI: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:07:02.195134] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:07:02.195203] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-30T18:07:02.195271] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-10-30T18:07:02.195308] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-10-30T18:07:02.195535] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-10-30T18:07:02.196157] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRI took 34.3s. Estimated remaining: 3h 50m 57s. Rate: 7.9 symbols/min [2025-10-30T18:07:02.370339] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:02.370586] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-10-30T18:07:02.370625] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-10-30T18:07:02.370764] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-30T18:07:02.370806] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-30T18:07:02.370846] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-30T18:07:02.370877] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-30T18:07:02.733997] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:02.897512] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-30T18:07:03.173034] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-30T18:07:03.697542] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-30T18:07:03.934482] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-30T18:07:04.110120] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T18:07:04.497475] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-30T18:07:04.909634] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T18:07:05.297546] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-30T18:07:05.828215] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T18:07:06.097570] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-30T18:07:06.897523] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-30T18:07:07.371045] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T18:07:07.506622] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-30T18:07:07.697527] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-30T18:07:08.508229] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-30T18:07:08.534736] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T18:07:08.549049] [INFO ] [REMOTE ] CRK: Full fetch complete (75728 records). [2025-10-30T18:07:08.549303] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-30T18:07:09.026977] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-30T18:07:09.027194] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-30T18:07:09.028491] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-30T18:07:09.028571] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-30T18:07:09.030908] [DEBUG] [LOCAL ] CRK: Trimmed 75728 records to 52527 (keeping 200 days of data) [2025-10-30T18:07:09.286400] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T18:07:09.298173] [INFO ] [REMOTE ] CRL: Full fetch complete (63769 records). [2025-10-30T18:07:09.298523] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-30T18:07:09.303570] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-30T18:07:09.833976] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-30T18:07:09.833837] [DEBUG] [LOCAL ] CRK: Primary data saved (52527 records). [2025-10-30T18:07:09.834254] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-30T18:07:09.835188] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRK took 36.1s. Estimated remaining: 3h 50m 50s. Rate: 7.9 symbols/min [2025-10-30T18:07:09.835295] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-30T18:07:09.848898] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-30T18:07:09.876752] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-30T18:07:09.954132] [DEBUG] [LOCAL ] CRL: Trimmed 63769 records to 42711 (keeping 200 days of data) [2025-10-30T18:07:10.081024] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:10.134387] [DEBUG] [LOCAL ] CRT: Loaded 4804 existing records from primary storage. [2025-10-30T18:07:10.138344] [INFO ] [MAIN ] CRT: Loaded 4804 existing records. [2025-10-30T18:07:10.268234] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-30T18:07:10.309727] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-30T18:07:10.432997] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:07:10.434255] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-30T18:07:10.438186] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-30T18:07:10.438511] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-30T18:07:10.438615] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-30T18:07:10.921908] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:10.923684] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-30T18:07:10.946814] [DEBUG] [LOCAL ] CRL: Primary data saved (42711 records). [2025-10-30T18:07:10.947069] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-30T18:07:10.947173] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRL took 27.3s. Estimated remaining: 3h 50m 21s. Rate: 8.0 symbols/min [2025-10-30T18:07:11.141446] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:11.177794] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-30T18:07:11.219466] [DEBUG] [LOCAL ] CSAN: Loaded 41986 existing records from primary storage. [2025-10-30T18:07:11.219791] [INFO ] [MAIN ] CSAN: Loaded 41986 existing records. [2025-10-30T18:07:11.394345] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:07:11.394590] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-30T18:07:11.394688] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-30T18:07:11.395363] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-30T18:07:11.395422] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-30T18:07:11.510002] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-30T18:07:11.702493] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-30T18:07:11.781857] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:11.809830] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T18:07:12.180849] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-30T18:07:12.497572] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-30T18:07:13.297512] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-30T18:07:13.700328] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T18:07:14.097495] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-30T18:07:14.409192] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T18:07:14.897507] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-30T18:07:15.697542] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-30T18:07:16.138333] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T18:07:16.271974] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-30T18:07:16.307817] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-30T18:07:16.497553] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-30T18:07:16.977566] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T18:07:17.297497] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-30T18:07:18.097513] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-30T18:07:18.438605] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T18:07:18.897544] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-30T18:07:19.285326] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-30T18:07:19.697491] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-30T18:07:20.401691] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-30T18:07:20.497536] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-30T18:07:21.134046] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-30T18:07:21.297504] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-30T18:07:21.889623] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-30T18:07:22.097483] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-30T18:07:22.493205] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-30T18:07:22.830331] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-30T18:07:22.897484] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-30T18:07:23.697517] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-30T18:07:23.964195] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T18:07:24.096944] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T18:07:24.497493] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-30T18:07:25.297489] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-30T18:07:25.792468] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T18:07:26.097504] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-30T18:07:26.685537] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T18:07:26.897500] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-30T18:07:27.130504] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T18:07:27.697506] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-30T18:07:27.941013] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T18:07:28.149706] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T18:07:28.497504] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-30T18:07:29.297498] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-30T18:07:29.704596] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T18:07:29.943074] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T18:07:29.944860] [INFO ] [REMOTE ] CRT: Full fetch complete (7420 records). [2025-10-30T18:07:29.944941] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-30T18:07:30.102631] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-30T18:07:30.317018] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-30T18:07:30.317095] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-30T18:07:30.317295] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-30T18:07:30.317334] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-30T18:07:30.317736] [DEBUG] [LOCAL ] CRT: Trimmed 7420 records to 4837 (keeping 200 days of data) [2025-10-30T18:07:30.345809] [DEBUG] [LOCAL ] CRT: Primary data saved (4837 records). [2025-10-30T18:07:30.345900] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-30T18:07:30.345974] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRT took 20.5s. Estimated remaining: 3h 50m 54s. Rate: 7.9 symbols/min [2025-10-30T18:07:30.518538] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:30.550417] [DEBUG] [LOCAL ] CSL: Loaded 30811 existing records from primary storage. [2025-10-30T18:07:30.550705] [INFO ] [MAIN ] CSL: Loaded 30811 existing records. [2025-10-30T18:07:30.734525] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:07:30.734796] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-30T18:07:30.734847] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-30T18:07:30.735452] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-30T18:07:30.735510] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-30T18:07:30.915048] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-30T18:07:31.097958] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:31.697480] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-30T18:07:31.800959] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T18:07:31.812111] [INFO ] [REMOTE ] CRS: Full fetch complete (62803 records). [2025-10-30T18:07:31.812758] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-30T18:07:32.218435] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-30T18:07:32.218552] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-30T18:07:32.219333] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-30T18:07:32.219399] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-30T18:07:32.220947] [DEBUG] [LOCAL ] CRS: Trimmed 62803 records to 43436 (keeping 200 days of data) [2025-10-30T18:07:32.489285] [DEBUG] [LOCAL ] CRS: Primary data saved (43436 records). [2025-10-30T18:07:32.489408] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-30T18:07:32.489477] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRS took 30.3s. Estimated remaining: 3h 50m 27s. Rate: 7.9 symbols/min [2025-10-30T18:07:32.520717] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-30T18:07:32.662266] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:32.675032] [DEBUG] [LOCAL ] CSR: Loaded 13271 existing records from primary storage. [2025-10-30T18:07:32.675224] [INFO ] [MAIN ] CSR: Loaded 13271 existing records. [2025-10-30T18:07:32.821441] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T18:07:32.892371] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:07:32.892758] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-30T18:07:32.892818] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-30T18:07:32.893772] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-30T18:07:32.893840] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-30T18:07:33.268492] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:33.301539] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-30T18:07:33.307511] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-30T18:07:33.319911] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-30T18:07:33.320057] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-30T18:07:33.706404] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-30T18:07:33.706566] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-30T18:07:33.707628] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-30T18:07:33.707734] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-30T18:07:33.733041] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 54160 (keeping 200 days of data) [2025-10-30T18:07:33.734379] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T18:07:33.874090] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-30T18:07:34.090516] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-30T18:07:34.090670] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-30T18:07:34.091772] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CRM took 46.5s. Estimated remaining: 3h 49m 60s. Rate: 8.0 symbols/min [2025-10-30T18:07:34.103564] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-30T18:07:34.272024] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:34.315905] [DEBUG] [LOCAL ] CSTM: Loaded 47329 existing records from primary storage. [2025-10-30T18:07:34.316202] [INFO ] [MAIN ] CSTM: Loaded 47329 existing records. [2025-10-30T18:07:34.494724] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:07:34.494957] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-30T18:07:34.495029] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-30T18:07:34.495832] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-30T18:07:34.495891] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-30T18:07:34.845067] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:34.897461] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-30T18:07:35.422525] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T18:07:35.697493] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-30T18:07:36.123113] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T18:07:36.497497] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-30T18:07:36.785448] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T18:07:37.297503] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-30T18:07:37.567041] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T18:07:37.809917] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T18:07:38.097496] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-30T18:07:38.897500] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-30T18:07:39.422618] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T18:07:39.697497] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-30T18:07:39.924198] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T18:07:40.497498] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-30T18:07:40.757476] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T18:07:41.297507] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-30T18:07:41.754848] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T18:07:41.868096] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-30T18:07:42.097433] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-30T18:07:42.897560] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-30T18:07:43.169695] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-30T18:07:43.512585] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T18:07:43.697489] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-30T18:07:44.497513] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-30T18:07:45.125714] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T18:07:45.141719] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T18:07:45.145698] [INFO ] [REMOTE ] CSAN: Full fetch complete (60385 records). [2025-10-30T18:07:45.145828] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-30T18:07:45.300922] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-30T18:07:45.578669] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-30T18:07:45.578787] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-30T18:07:45.579727] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-30T18:07:45.579815] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-30T18:07:45.581349] [DEBUG] [LOCAL ] CSAN: Trimmed 60385 records to 42325 (keeping 200 days of data) [2025-10-30T18:07:45.821160] [DEBUG] [LOCAL ] CSAN: Primary data saved (42325 records). [2025-10-30T18:07:45.821437] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-30T18:07:45.829743] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CSAN took 34.9s. Estimated remaining: 3h 50m 6s. Rate: 7.9 symbols/min [2025-10-30T18:07:45.862538] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T18:07:46.004057] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:46.016438] [DEBUG] [LOCAL ] CSV: Loaded 11835 existing records from primary storage. [2025-10-30T18:07:46.016695] [INFO ] [MAIN ] CSV: Loaded 11835 existing records. [2025-10-30T18:07:46.102818] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-30T18:07:46.193685] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:07:46.193880] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-30T18:07:46.193927] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-30T18:07:46.194238] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-30T18:07:46.194304] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-30T18:07:46.536240] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:46.897546] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-30T18:07:47.463313] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T18:07:47.701334] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-30T18:07:47.704747] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-30T18:07:48.497502] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-30T18:07:48.978118] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T18:07:49.133101] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-30T18:07:49.297519] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-30T18:07:50.097468] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-30T18:07:50.209355] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T18:07:50.740712] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-30T18:07:50.897539] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-30T18:07:51.697490] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-30T18:07:52.162978] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T18:07:52.399097] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-30T18:07:52.497490] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-30T18:07:53.226126] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T18:07:53.297471] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-30T18:07:54.097468] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-30T18:07:54.134518] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:07:54.138245] [INFO ] [REMOTE ] CSR: Full fetch complete (18013 records). [2025-10-30T18:07:54.138323] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-30T18:07:54.495897] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-30T18:07:54.495972] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-30T18:07:54.496354] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-30T18:07:54.496413] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-30T18:07:54.497031] [DEBUG] [LOCAL ] CSR: Trimmed 18013 records to 13422 (keeping 200 days of data) [2025-10-30T18:07:54.575173] [DEBUG] [LOCAL ] CSR: Primary data saved (13422 records). [2025-10-30T18:07:54.575295] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-30T18:07:54.575368] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSR took 22.1s. Estimated remaining: 3h 50m 3s. Rate: 7.9 symbols/min [2025-10-30T18:07:54.746358] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:54.746541] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-30T18:07:54.746577] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-30T18:07:54.746735] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-30T18:07:54.746787] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-30T18:07:54.746829] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-30T18:07:54.746861] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-30T18:07:54.904881] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-30T18:07:55.136789] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:55.307168] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T18:07:55.600436] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T18:07:55.697467] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-30T18:07:55.872602] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T18:07:55.872913] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-30T18:07:55.873028] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:07:55.873114] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-30T18:07:55.873224] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:07:55.873316] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-30T18:07:55.873390] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-30T18:07:55.873439] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-30T18:07:55.873494] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-30T18:07:55.873559] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSW took 1.3s. Estimated remaining: 3h 49m 34s. Rate: 8.0 symbols/min [2025-10-30T18:07:56.050209] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:07:56.057401] [DEBUG] [LOCAL ] CTBB: Loaded 6134 existing records from primary storage. [2025-10-30T18:07:56.057603] [INFO ] [MAIN ] CTBB: Loaded 6134 existing records. [2025-10-30T18:07:56.237751] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:07:56.237971] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-30T18:07:56.238024] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-30T18:07:56.238272] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-30T18:07:56.238329] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-30T18:07:56.502698] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-30T18:07:56.601001] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:07:57.297498] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-30T18:07:57.788920] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T18:07:58.098687] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-30T18:07:58.100669] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T18:07:58.618634] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-30T18:07:58.897468] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-30T18:07:59.677063] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T18:07:59.697522] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-30T18:08:00.497496] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-30T18:08:00.970716] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T18:08:00.986786] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T18:08:01.297542] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-30T18:08:02.097561] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-30T18:08:02.764396] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T18:08:02.777235] [INFO ] [REMOTE ] CSTM: Full fetch complete (69574 records). [2025-10-30T18:08:02.777414] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-30T18:08:02.901475] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-30T18:08:03.205404] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-30T18:08:03.206078] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-30T18:08:03.207117] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-30T18:08:03.207961] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-30T18:08:03.207835] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T18:08:03.216352] [DEBUG] [LOCAL ] CSTM: Trimmed 69574 records to 47705 (keeping 200 days of data) [2025-10-30T18:08:03.501480] [DEBUG] [LOCAL ] CSTM: Primary data saved (47705 records). [2025-10-30T18:08:03.501699] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-30T18:08:03.501899] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSTM took 29.4s. Estimated remaining: 3h 49m 27s. Rate: 8.0 symbols/min [2025-10-30T18:08:03.616593] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T18:08:03.698447] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-30T18:08:03.699517] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:08:03.707543] [DEBUG] [LOCAL ] CTDD: Loaded 4885 existing records from primary storage. [2025-10-30T18:08:03.707803] [INFO ] [MAIN ] CTDD: Loaded 4885 existing records. [2025-10-30T18:08:03.894458] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:08:03.894747] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-30T18:08:03.894804] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-30T18:08:03.894980] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-30T18:08:03.895036] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-30T18:08:04.256787] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:08:04.267902] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-30T18:08:04.497558] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-30T18:08:04.900083] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-30T18:08:05.297522] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-30T18:08:05.800398] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T18:08:06.097560] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-30T18:08:06.498564] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-30T18:08:06.897515] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-30T18:08:07.697498] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-30T18:08:07.876886] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-30T18:08:07.983314] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T18:08:08.497550] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-30T18:08:09.100446] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T18:08:09.297542] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-30T18:08:09.802609] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T18:08:10.097570] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-30T18:08:10.897353] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T18:08:10.900076] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-30T18:08:11.299824] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-30T18:08:11.697533] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-30T18:08:12.258624] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T18:08:12.497583] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-30T18:08:13.297524] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-30T18:08:13.591565] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T18:08:13.699524] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T18:08:14.097492] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-30T18:08:14.897503] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-30T18:08:15.294337] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T18:08:15.301546] [INFO ] [REMOTE ] CSL: Full fetch complete (45884 records). [2025-10-30T18:08:15.301671] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-30T18:08:15.625766] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T18:08:15.702626] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-30T18:08:15.719442] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-30T18:08:15.719557] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-30T18:08:15.721190] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-30T18:08:15.721268] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-30T18:08:15.722480] [DEBUG] [LOCAL ] CSL: Trimmed 45884 records to 31136 (keeping 200 days of data) [2025-10-30T18:08:15.912021] [DEBUG] [LOCAL ] CSL: Primary data saved (31136 records). [2025-10-30T18:08:15.912153] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-30T18:08:15.912232] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSL took 45.6s. Estimated remaining: 3h 49m 36s. Rate: 7.9 symbols/min [2025-10-30T18:08:16.094923] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:08:16.095110] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-30T18:08:16.095148] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-30T18:08:16.095259] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-30T18:08:16.095301] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-30T18:08:16.095363] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-30T18:08:16.095395] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-30T18:08:16.286192] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-30T18:08:16.459419] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:08:16.497491] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-30T18:08:16.646112] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T18:08:16.646371] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-30T18:08:16.646475] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:08:16.646522] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-30T18:08:16.646555] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:08:16.646591] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-30T18:08:16.646665] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-30T18:08:16.646723] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-30T18:08:16.646767] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-30T18:08:16.646813] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CTEV took 0.7s. Estimated remaining: 3h 49m 5s. Rate: 8.0 symbols/min [2025-10-30T18:08:16.812320] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:08:16.812487] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-10-30T18:08:16.812524] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-10-30T18:08:16.812628] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-30T18:08:16.812704] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-30T18:08:16.812755] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-30T18:08:16.812787] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-30T18:08:17.175230] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:08:17.297486] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-30T18:08:18.097498] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-30T18:08:18.453458] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T18:08:18.626827] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-30T18:08:18.897581] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-30T18:08:19.371698] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-30T18:08:19.697577] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-30T18:08:20.395934] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T18:08:20.497516] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-30T18:08:21.297476] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-30T18:08:21.390546] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-30T18:08:21.836458] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T18:08:22.097499] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-30T18:08:22.809677] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T18:08:22.812275] [INFO ] [REMOTE ] CSV: Full fetch complete (18810 records). [2025-10-30T18:08:22.812360] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-30T18:08:22.902723] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-30T18:08:23.171340] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-30T18:08:23.171417] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-30T18:08:23.171816] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-30T18:08:23.171876] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-30T18:08:23.172368] [DEBUG] [LOCAL ] CSV: Trimmed 18810 records to 11910 (keeping 200 days of data) [2025-10-30T18:08:23.243206] [DEBUG] [LOCAL ] CSV: Primary data saved (11910 records). [2025-10-30T18:08:23.243333] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-30T18:08:23.243445] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CSV took 37.4s. Estimated remaining: 3h 48m 55s. Rate: 8.0 symbols/min [2025-10-30T18:08:23.414299] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:08:23.449200] [DEBUG] [LOCAL ] CTOS: Loaded 37123 existing records from primary storage. [2025-10-30T18:08:23.449494] [INFO ] [MAIN ] CTOS: Loaded 37123 existing records. [2025-10-30T18:08:23.646890] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:08:23.647117] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-30T18:08:23.647167] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-30T18:08:23.647507] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-30T18:08:23.647549] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-30T18:08:23.709393] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-30T18:08:24.072194] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:08:24.094323] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T18:08:24.155692] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T18:08:24.497518] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-30T18:08:25.297537] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-30T18:08:25.684107] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T18:08:25.759400] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:08:26.097473] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-30T18:08:26.610865] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-30T18:08:26.612330] [INFO ] [REMOTE ] CTDD: Full fetch complete (7887 records). [2025-10-30T18:08:26.612401] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-30T18:08:26.902754] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-30T18:08:26.997924] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-30T18:08:26.998004] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-30T18:08:26.998223] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-30T18:08:26.998262] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-30T18:08:26.998670] [DEBUG] [LOCAL ] CTDD: Trimmed 7887 records to 4939 (keeping 200 days of data) [2025-10-30T18:08:27.027545] [DEBUG] [LOCAL ] CTDD: Primary data saved (4939 records). [2025-10-30T18:08:27.027681] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-30T18:08:27.027779] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTDD took 23.5s. Estimated remaining: 3h 48m 34s. Rate: 8.0 symbols/min [2025-10-30T18:08:27.191935] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:08:27.238956] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-30T18:08:27.239263] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-30T18:08:27.411169] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:08:27.411396] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-30T18:08:27.411443] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-30T18:08:27.412319] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-30T18:08:27.412376] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-30T18:08:27.702616] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-30T18:08:27.766526] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:08:27.898161] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T18:08:28.232225] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T18:08:28.497541] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-30T18:08:29.297497] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-30T18:08:29.522446] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T18:08:30.097536] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-30T18:08:30.174040] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T18:08:30.745351] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T18:08:30.746991] [INFO ] [REMOTE ] CTBB: Full fetch complete (9883 records). [2025-10-30T18:08:30.747058] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-30T18:08:30.747420] [FATAL] [VALIDATOR ] CTBB: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:08:30.747500] [FATAL] [MAIN ] CTBB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:08:30.747548] [WARN ] [MAIN ] CTBB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:08:30.747624] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-30T18:08:30.747737] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-30T18:08:30.747780] [INFO ] [LOCAL ] CTBB: Starting deletion of derivative data. [2025-10-30T18:08:30.747920] [DEBUG] [LOCAL ] CTBB: Deleted derivative data file. [2025-10-30T18:08:30.748082] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CTBB took 34.9s. Estimated remaining: 3h 48m 14s. Rate: 8.0 symbols/min [2025-10-30T18:08:30.897493] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-30T18:08:30.920515] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:08:30.963988] [DEBUG] [LOCAL ] CTRE: Loaded 49403 existing records from primary storage. [2025-10-30T18:08:30.964279] [INFO ] [MAIN ] CTRE: Loaded 49403 existing records. [2025-10-30T18:08:31.141602] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:08:31.141845] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-30T18:08:31.141892] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-30T18:08:31.142805] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-30T18:08:31.142861] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-30T18:08:31.491124] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:08:31.697487] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-30T18:08:31.881105] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T18:08:32.497527] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-30T18:08:33.297475] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-30T18:08:33.434432] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-30T18:08:33.532381] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T18:08:34.097497] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-30T18:08:34.681418] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-30T18:08:34.897491] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-30T18:08:35.358454] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T18:08:35.697488] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-30T18:08:36.041536] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T18:08:36.497504] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-30T18:08:36.762071] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T18:08:37.297496] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-30T18:08:37.868585] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T18:08:38.097472] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-30T18:08:38.294571] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T18:08:38.897485] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-30T18:08:39.503560] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T18:08:39.697481] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-30T18:08:39.852352] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T18:08:40.497495] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-30T18:08:40.901985] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:08:41.297555] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-30T18:08:41.812705] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-30T18:08:41.819893] [INFO ] [REMOTE ] CTO: Full fetch complete (41480 records). [2025-10-30T18:08:41.819989] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-30T18:08:42.105119] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-30T18:08:42.196253] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-30T18:08:42.196360] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-30T18:08:42.197059] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-30T18:08:42.197125] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-30T18:08:42.198098] [DEBUG] [LOCAL ] CTO: Trimmed 41480 records to 27282 (keeping 200 days of data) [2025-10-30T18:08:42.359271] [DEBUG] [LOCAL ] CTO: Primary data saved (27282 records). [2025-10-30T18:08:42.359402] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-30T18:08:42.359472] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTO took 25.7s. Estimated remaining: 3h 48m 20s. Rate: 8.0 symbols/min [2025-10-30T18:08:42.527474] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:08:42.563892] [DEBUG] [LOCAL ] CTRI: Loaded 41288 existing records from primary storage. [2025-10-30T18:08:42.564172] [INFO ] [MAIN ] CTRI: Loaded 41288 existing records. [2025-10-30T18:08:42.745188] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:08:42.745637] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-30T18:08:42.745745] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-30T18:08:42.755215] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-30T18:08:42.769900] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-30T18:08:42.847588] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-30T18:08:42.902553] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-30T18:08:43.139695] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:08:43.697479] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-30T18:08:43.736753] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-30T18:08:43.879511] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-30T18:08:44.497478] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-30T18:08:44.631726] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-30T18:08:45.297556] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-30T18:08:45.541528] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T18:08:46.097501] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-30T18:08:46.894040] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-30T18:08:46.897898] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-30T18:08:47.239892] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T18:08:47.524115] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T18:08:47.697486] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-30T18:08:48.497522] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-30T18:08:48.741079] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T18:08:49.297549] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-30T18:08:49.835242] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T18:08:50.097551] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-30T18:08:50.558078] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T18:08:50.897495] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-30T18:08:51.703337] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-30T18:08:51.725858] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-30T18:08:52.141260] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T18:08:52.497544] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-30T18:08:52.598249] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-30T18:08:53.297492] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-30T18:08:53.780111] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T18:08:54.097478] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-30T18:08:54.218285] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T18:08:54.897577] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-30T18:08:55.479522] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T18:08:55.697501] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-30T18:08:56.041119] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T18:08:56.497727] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-30T18:08:57.297498] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-30T18:08:57.366029] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-30T18:08:57.525903] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T18:08:58.097569] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-30T18:08:58.462153] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T18:08:58.897498] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-30T18:08:59.697465] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-30T18:08:59.844355] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-30T18:08:59.857229] [INFO ] [REMOTE ] CTRA: Full fetch complete (77819 records). [2025-10-30T18:08:59.870210] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-30T18:08:59.879634] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T18:09:00.325402] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-30T18:09:00.325534] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-30T18:09:00.326808] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-30T18:09:00.326897] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-30T18:09:00.329059] [DEBUG] [LOCAL ] CTRA: Trimmed 77819 records to 54036 (keeping 200 days of data) [2025-10-30T18:09:00.521580] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-30T18:09:00.691361] [DEBUG] [LOCAL ] CTRA: Primary data saved (54036 records). [2025-10-30T18:09:00.691573] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-30T18:09:00.691700] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTRA took 33.7s. Estimated remaining: 3h 48m 49s. Rate: 7.9 symbols/min [2025-10-30T18:09:00.884248] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:09:00.905585] [DEBUG] [LOCAL ] CTS: Loaded 19342 existing records from primary storage. [2025-10-30T18:09:00.905977] [INFO ] [MAIN ] CTS: Loaded 19342 existing records. [2025-10-30T18:09:01.106041] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:09:01.106559] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-30T18:09:01.106726] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-30T18:09:01.107391] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-30T18:09:01.107464] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-30T18:09:01.220283] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T18:09:01.302684] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-30T18:09:01.555246] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:09:02.097491] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-30T18:09:02.204285] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-30T18:09:02.653043] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T18:09:02.662942] [INFO ] [REMOTE ] CTOS: Full fetch complete (54207 records). [2025-10-30T18:09:02.663095] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-30T18:09:02.902818] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-30T18:09:03.054737] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-30T18:09:03.054869] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-30T18:09:03.055582] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-30T18:09:03.055672] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-30T18:09:03.057135] [DEBUG] [LOCAL ] CTOS: Trimmed 54207 records to 37426 (keeping 200 days of data) [2025-10-30T18:09:03.263729] [DEBUG] [LOCAL ] CTOS: Primary data saved (37426 records). [2025-10-30T18:09:03.263879] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-30T18:09:03.263968] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTOS took 40.0s. Estimated remaining: 3h 48m 25s. Rate: 8.0 symbols/min [2025-10-30T18:09:03.435788] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:09:03.500444] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T18:09:03.528765] [DEBUG] [LOCAL ] CTVA: Loaded 53297 existing records from primary storage. [2025-10-30T18:09:03.529435] [INFO ] [MAIN ] CTVA: Loaded 53297 existing records. [2025-10-30T18:09:03.707335] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-30T18:09:03.714237] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:09:03.715662] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-30T18:09:03.715779] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-30T18:09:03.721235] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-30T18:09:03.726092] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-30T18:09:03.742774] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T18:09:04.110241] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:09:04.497520] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-30T18:09:05.163525] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T18:09:05.174204] [INFO ] [REMOTE ] CTRI: Full fetch complete (55473 records). [2025-10-30T18:09:05.174308] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-30T18:09:05.299502] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-30T18:09:05.410215] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T18:09:05.599765] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-30T18:09:05.599850] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-30T18:09:05.600580] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-30T18:09:05.600621] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-30T18:09:05.601825] [DEBUG] [LOCAL ] CTRI: Trimmed 55473 records to 41628 (keeping 200 days of data) [2025-10-30T18:09:05.832491] [DEBUG] [LOCAL ] CTRI: Primary data saved (41628 records). [2025-10-30T18:09:05.832609] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-30T18:09:05.833418] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTRI took 23.5s. Estimated remaining: 3h 48m 1s. Rate: 8.0 symbols/min [2025-10-30T18:09:05.999369] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:09:05.999547] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-30T18:09:05.999585] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-30T18:09:05.999720] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-30T18:09:05.999767] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-30T18:09:05.999808] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-30T18:09:05.999839] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-30T18:09:06.100437] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-30T18:09:06.370222] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:09:06.868565] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-30T18:09:06.897510] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-30T18:09:06.926583] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T18:09:07.697564] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-30T18:09:08.271059] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T18:09:08.497515] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-30T18:09:08.629181] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T18:09:08.888612] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-30T18:09:09.297516] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-30T18:09:09.527079] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-30T18:09:10.097509] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-30T18:09:10.761860] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T18:09:10.897478] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-30T18:09:11.122415] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-30T18:09:11.697502] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-30T18:09:12.408896] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-30T18:09:12.497538] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-30T18:09:12.747598] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-30T18:09:13.297543] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-30T18:09:14.097488] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-30T18:09:14.868373] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:09:14.897511] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-30T18:09:15.440761] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T18:09:15.697476] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-30T18:09:15.835622] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-30T18:09:15.895887] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-30T18:09:16.497492] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-30T18:09:17.297536] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-30T18:09:17.487930] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-10-30T18:09:17.936216] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T18:09:18.097530] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-30T18:09:18.897515] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-30T18:09:19.579590] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-30T18:09:19.697477] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-30T18:09:20.441396] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-30T18:09:20.454002] [INFO ] [REMOTE ] CTRE: Full fetch complete (71421 records). [2025-10-30T18:09:20.454160] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-30T18:09:20.502590] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-30T18:09:20.851053] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-30T18:09:20.850952] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-30T18:09:20.851196] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-30T18:09:20.852861] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-30T18:09:20.852925] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-30T18:09:20.854123] [DEBUG] [LOCAL ] CTRE: Trimmed 71421 records to 49771 (keeping 200 days of data) [2025-10-30T18:09:21.093129] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T18:09:21.192488] [DEBUG] [LOCAL ] CTRE: Primary data saved (49771 records). [2025-10-30T18:09:21.192683] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-30T18:09:21.193242] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CTRE took 50.4s. Estimated remaining: 3h 48m 19s. Rate: 7.9 symbols/min [2025-10-30T18:09:21.302610] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-30T18:09:21.364070] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:09:21.409924] [DEBUG] [LOCAL ] CUBE: Loaded 50834 existing records from primary storage. [2025-10-30T18:09:21.410213] [INFO ] [MAIN ] CUBE: Loaded 50834 existing records. [2025-10-30T18:09:21.585173] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:09:21.585366] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-30T18:09:21.585415] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-30T18:09:21.586411] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-30T18:09:21.586469] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-30T18:09:21.947162] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:09:22.066525] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-30T18:09:22.097457] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-30T18:09:22.774167] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-30T18:09:22.897459] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-30T18:09:23.108043] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-10-30T18:09:23.697509] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-30T18:09:24.497486] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-30T18:09:24.629949] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T18:09:24.634908] [INFO ] [REMOTE ] CTS: Full fetch complete (27625 records). [2025-10-30T18:09:24.634983] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-30T18:09:25.008712] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-30T18:09:25.008812] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-30T18:09:25.009328] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-30T18:09:25.009404] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-30T18:09:25.010114] [DEBUG] [LOCAL ] CTS: Trimmed 27625 records to 19504 (keeping 200 days of data) [2025-10-30T18:09:25.129476] [DEBUG] [LOCAL ] CTS: Primary data saved (19504 records). [2025-10-30T18:09:25.129610] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-30T18:09:25.129720] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CTS took 24.4s. Estimated remaining: 3h 47m 59s. Rate: 8.0 symbols/min [2025-10-30T18:09:25.305603] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:09:25.302951] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-30T18:09:25.305798] [DEBUG] [LOCAL ] CUBI: No existing data file found in primary storage. [2025-10-30T18:09:25.306053] [WARN ] [MAIN ] CUBI: No existing data found, performing full refresh instead. [2025-10-30T18:09:25.306925] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-30T18:09:25.307005] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-30T18:09:25.307075] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-30T18:09:25.307120] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-30T18:09:25.639445] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-30T18:09:25.668901] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:09:25.698304] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T18:09:26.097527] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-30T18:09:26.497826] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-30T18:09:26.498550] [INFO ] [REMOTE ] CUBB: Full fetch complete (967 records). [2025-10-30T18:09:26.498617] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-30T18:09:26.674515] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-30T18:09:26.674711] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:09:26.674784] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:09:26.674854] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-30T18:09:26.674916] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-30T18:09:26.674953] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-30T18:09:26.674994] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-30T18:09:26.675050] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CUBB took 20.8s. Estimated remaining: 3h 47m 32s. Rate: 8.0 symbols/min [2025-10-30T18:09:26.844444] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:09:26.893549] [DEBUG] [LOCAL ] CUK: Loaded 51035 existing records from primary storage. [2025-10-30T18:09:26.894104] [INFO ] [MAIN ] CUK: Loaded 51035 existing records. [2025-10-30T18:09:26.905161] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-30T18:09:27.075181] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:09:27.075442] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-30T18:09:27.075499] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-30T18:09:27.076723] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-30T18:09:27.076783] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-30T18:09:27.444784] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:09:27.697488] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-30T18:09:27.988112] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T18:09:28.497503] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-30T18:09:29.125452] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T18:09:29.297490] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-30T18:09:29.666438] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T18:09:30.097494] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-30T18:09:30.448388] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T18:09:30.897483] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-30T18:09:31.290588] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T18:09:31.697486] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-30T18:09:32.045560] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T18:09:32.497477] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-30T18:09:32.939447] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T18:09:33.297511] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-30T18:09:33.911822] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-30T18:09:33.923597] [INFO ] [REMOTE ] CTVA: Full fetch complete (77240 records). [2025-10-30T18:09:33.923778] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-30T18:09:34.112340] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-30T18:09:34.320249] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-30T18:09:34.320332] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-30T18:09:34.321292] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-30T18:09:34.321360] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-30T18:09:34.322832] [DEBUG] [LOCAL ] CTVA: Trimmed 77240 records to 53687 (keeping 200 days of data) [2025-10-30T18:09:34.682768] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T18:09:34.681864] [DEBUG] [LOCAL ] CTVA: Primary data saved (53687 records). [2025-10-30T18:09:34.692866] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-30T18:09:34.694089] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CTVA took 31.4s. Estimated remaining: 3h 47m 26s. Rate: 8.0 symbols/min [2025-10-30T18:09:34.861830] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:09:34.866125] [DEBUG] [LOCAL ] CULP: Loaded 2721 existing records from primary storage. [2025-10-30T18:09:34.866322] [INFO ] [MAIN ] CULP: Loaded 2721 existing records. [2025-10-30T18:09:34.899412] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-30T18:09:35.066874] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:09:35.068204] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T18:09:35.072831] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-30T18:09:35.073559] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-30T18:09:35.073782] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-30T18:09:35.073842] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-30T18:09:35.441963] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:09:35.697470] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-30T18:09:36.191746] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T18:09:36.293633] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:09:36.497482] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-30T18:09:36.888865] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T18:09:37.297505] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-30T18:09:38.097471] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-30T18:09:38.155150] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T18:09:38.897493] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-30T18:09:39.492493] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:09:39.697460] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-30T18:09:39.886152] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T18:09:40.497514] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-30T18:09:41.082011] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T18:09:41.242532] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T18:09:41.297554] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-30T18:09:41.713176] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-30T18:09:42.097531] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-30T18:09:42.897507] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-30T18:09:43.548997] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-30T18:09:43.697476] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-30T18:09:44.190179] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T18:09:44.497475] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-30T18:09:44.894894] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T18:09:45.297514] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-30T18:09:45.634191] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-30T18:09:45.829795] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T18:09:46.097490] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-30T18:09:46.897526] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-30T18:09:46.981712] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T18:09:47.325828] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-30T18:09:47.697526] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-30T18:09:47.985884] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-30T18:09:48.497573] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-30T18:09:48.845384] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-30T18:09:49.297523] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-30T18:09:50.097579] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-30T18:09:50.895017] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-30T18:09:50.905474] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-30T18:09:51.411661] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T18:09:51.697489] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-30T18:09:52.049833] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T18:09:52.497505] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-30T18:09:52.975175] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:09:53.297546] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-30T18:09:54.032470] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-30T18:09:54.066686] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-30T18:09:54.097531] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-30T18:09:54.897482] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-30T18:09:54.956800] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T18:09:55.697517] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-30T18:09:55.991017] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-30T18:09:56.060882] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T18:09:56.497573] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-30T18:09:56.873196] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T18:09:57.297560] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-30T18:09:58.097788] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-30T18:09:58.777948] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T18:09:58.790964] [INFO ] [REMOTE ] CUBE: Full fetch complete (73354 records). [2025-10-30T18:09:58.791104] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-30T18:09:58.902683] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-30T18:09:59.232713] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-30T18:09:59.232818] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-30T18:09:59.233701] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-30T18:09:59.233838] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-30T18:09:59.250416] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-30T18:09:59.256898] [DEBUG] [LOCAL ] CUBE: Trimmed 73354 records to 51222 (keeping 200 days of data) [2025-10-30T18:09:59.257471] [INFO ] [REMOTE ] CUBI: Full fetch complete (39117 records). [2025-10-30T18:09:59.257871] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-30T18:09:59.465374] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-30T18:09:59.473205] [INFO ] [REMOTE ] CULP: Full fetch complete (4356 records). [2025-10-30T18:09:59.507729] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-30T18:09:59.609922] [FATAL] [VALIDATOR ] CULP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:09:59.676935] [FATAL] [MAIN ] CULP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:09:59.687375] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:09:59.699570] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-30T18:09:59.690065] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-30T18:09:59.740011] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-30T18:09:59.748229] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-30T18:09:59.754725] [DEBUG] [LOCAL ] CULP: Deleted derivative data file. [2025-10-30T18:09:59.754936] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CULP took 25.1s. Estimated remaining: 3h 48m 16s. Rate: 7.9 symbols/min [2025-10-30T18:09:59.990492] [DEBUG] [LOCAL ] CUBE: Primary data saved (51222 records). [2025-10-30T18:10:00.046623] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-30T18:10:00.086890] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-30T18:10:00.098039] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CUBE took 38.9s. Estimated remaining: 3h 47m 45s. Rate: 7.9 symbols/min [2025-10-30T18:10:00.092211] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-30T18:10:00.132088] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-30T18:10:00.192440] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-30T18:10:00.195851] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:00.269958] [DEBUG] [LOCAL ] CUBI: Trimmed 39117 records to 26914 (keeping 200 days of data) [2025-10-30T18:10:00.431816] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:00.467168] [DEBUG] [LOCAL ] CURB: Loaded 32622 existing records from primary storage. [2025-10-30T18:10:00.475025] [INFO ] [MAIN ] CURB: Loaded 32622 existing records. [2025-10-30T18:10:00.604543] [DEBUG] [LOCAL ] CUBI: Primary data saved (26914 records). [2025-10-30T18:10:00.626472] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-30T18:10:00.634324] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CUBI took 35.5s. Estimated remaining: 3h 47m 15s. Rate: 8.0 symbols/min [2025-10-30T18:10:00.636383] [DEBUG] [LOCAL ] CURV: Loaded 27572 existing records from primary storage. [2025-10-30T18:10:00.652415] [INFO ] [MAIN ] CURV: Loaded 27572 existing records. [2025-10-30T18:10:00.816758] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:00.819525] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-30T18:10:00.819591] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-30T18:10:00.825458] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-30T18:10:00.830720] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-30T18:10:01.001901] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:01.002500] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-30T18:10:01.002581] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-30T18:10:01.008322] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-30T18:10:01.008427] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-30T18:10:01.571191] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:01.597900] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-30T18:10:01.657577] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:01.658568] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-30T18:10:01.695013] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-30T18:10:02.097581] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-30T18:10:02.642799] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T18:10:02.784783] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T18:10:02.897510] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-30T18:10:03.684245] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T18:10:03.697458] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-30T18:10:03.951042] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-30T18:10:03.962621] [INFO ] [REMOTE ] CUK: Full fetch complete (74422 records). [2025-10-30T18:10:03.962800] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-30T18:10:04.356548] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-30T18:10:04.356639] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-30T18:10:04.357526] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-30T18:10:04.357572] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-30T18:10:04.359059] [DEBUG] [LOCAL ] CUK: Trimmed 74422 records to 51422 (keeping 200 days of data) [2025-10-30T18:10:04.516727] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-30T18:10:04.656432] [DEBUG] [LOCAL ] CUK: Primary data saved (51422 records). [2025-10-30T18:10:04.656797] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-30T18:10:04.657633] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CUK took 38.0s. Estimated remaining: 3h 46m 56s. Rate: 8.0 symbols/min [2025-10-30T18:10:04.676551] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T18:10:05.249174] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T18:10:05.297455] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-30T18:10:06.097519] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-30T18:10:06.237396] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T18:10:06.897512] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-30T18:10:07.039013] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T18:10:07.707143] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-30T18:10:07.708885] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T18:10:08.497524] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-30T18:10:08.582609] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T18:10:09.159698] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T18:10:09.297500] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-30T18:10:10.095789] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-30T18:10:10.100707] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-30T18:10:10.897530] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-30T18:10:10.965428] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T18:10:11.697471] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-30T18:10:12.090316] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T18:10:12.497490] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-30T18:10:12.677821] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T18:10:13.297503] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-30T18:10:13.582370] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T18:10:14.097533] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-30T18:10:14.349324] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T18:10:14.897758] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-30T18:10:15.085931] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T18:10:15.697500] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-30T18:10:15.829328] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T18:10:16.497510] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-30T18:10:16.940601] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T18:10:16.948013] [INFO ] [REMOTE ] CURV: Full fetch complete (39092 records). [2025-10-30T18:10:16.948114] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-30T18:10:17.334423] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-30T18:10:17.334511] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-30T18:10:17.335114] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-30T18:10:17.335179] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-30T18:10:17.336055] [DEBUG] [LOCAL ] CURV: Trimmed 39092 records to 27730 (keeping 200 days of data) [2025-10-30T18:10:17.483124] [DEBUG] [LOCAL ] CURV: Primary data saved (27730 records). [2025-10-30T18:10:17.483244] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-30T18:10:17.483323] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CURV took 17.4s. Estimated remaining: 3h 47m 5s. Rate: 8.0 symbols/min [2025-10-30T18:10:17.886148] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T18:10:17.894885] [INFO ] [REMOTE ] CURB: Full fetch complete (47716 records). [2025-10-30T18:10:17.894984] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-30T18:10:18.264371] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-30T18:10:18.264456] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-30T18:10:18.265079] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-30T18:10:18.265144] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-30T18:10:18.266387] [DEBUG] [LOCAL ] CURB: Trimmed 47716 records to 32896 (keeping 200 days of data) [2025-10-30T18:10:18.461768] [DEBUG] [LOCAL ] CURB: Primary data saved (32896 records). [2025-10-30T18:10:18.461898] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-30T18:10:18.461976] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CURB took 18.7s. Estimated remaining: 3h 46m 37s. Rate: 8.0 symbols/min [2025-10-30T18:10:19.088258] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:19.176096] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:19.174940] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:19.210556] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:19.244689] [DEBUG] [LOCAL ] CVEO: Loaded 15070 existing records from primary storage. [2025-10-30T18:10:19.245067] [INFO ] [MAIN ] CVEO: Loaded 15070 existing records. [2025-10-30T18:10:19.407370] [DEBUG] [LOCAL ] CVI: Loaded 46432 existing records from primary storage. [2025-10-30T18:10:19.448520] [DEBUG] [LOCAL ] CUZ: Loaded 49288 existing records from primary storage. [2025-10-30T18:10:19.447552] [INFO ] [MAIN ] CVI: Loaded 46432 existing records. [2025-10-30T18:10:19.447329] [DEBUG] [LOCAL ] CVE: Loaded 53558 existing records from primary storage. [2025-10-30T18:10:19.494447] [INFO ] [MAIN ] CUZ: Loaded 49288 existing records. [2025-10-30T18:10:19.586913] [INFO ] [MAIN ] CVE: Loaded 53558 existing records. [2025-10-30T18:10:19.766362] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:19.860663] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-30T18:10:19.866013] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-30T18:10:19.910807] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-30T18:10:19.916122] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-30T18:10:20.070390] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:20.118859] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-30T18:10:20.159304] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-30T18:10:20.188634] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-30T18:10:20.171211] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:20.189187] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-30T18:10:20.221951] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-30T18:10:20.221794] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:20.225598] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-30T18:10:20.269475] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-30T18:10:20.258090] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-30T18:10:20.274873] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-30T18:10:20.275032] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-30T18:10:20.367337] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-30T18:10:20.454995] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-30T18:10:21.147120] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:21.182270] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-30T18:10:21.616935] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:21.659404] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-30T18:10:21.663933] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:21.694183] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-30T18:10:21.736452] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:21.737570] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-30T18:10:21.873278] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T18:10:21.875463] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-30T18:10:22.404508] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-30T18:10:22.412400] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-30T18:10:22.907901] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T18:10:22.917130] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-30T18:10:22.986353] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T18:10:22.996023] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-30T18:10:23.099492] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T18:10:23.389746] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-30T18:10:23.697487] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-30T18:10:24.041468] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T18:10:24.262817] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T18:10:24.497492] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-30T18:10:25.103669] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-30T18:10:25.122203] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T18:10:25.297479] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-30T18:10:26.097506] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-30T18:10:26.410631] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T18:10:26.897471] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-30T18:10:26.912468] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-30T18:10:27.697483] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-30T18:10:28.238906] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T18:10:28.497492] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-30T18:10:28.889944] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T18:10:29.297519] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-30T18:10:29.829625] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T18:10:29.850050] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T18:10:30.097485] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-30T18:10:30.897506] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-30T18:10:31.358077] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T18:10:31.533830] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-30T18:10:31.697480] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-30T18:10:32.497497] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-30T18:10:32.873070] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T18:10:33.297505] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-30T18:10:33.975236] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-30T18:10:34.097484] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-30T18:10:34.562401] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T18:10:34.897518] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-30T18:10:35.447495] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T18:10:35.521741] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T18:10:35.697540] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-30T18:10:36.497523] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-30T18:10:36.931319] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T18:10:37.297520] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-30T18:10:37.822371] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T18:10:38.097507] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-30T18:10:38.328092] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T18:10:38.897477] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-30T18:10:39.484037] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:10:39.697464] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-30T18:10:39.727726] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T18:10:39.731280] [INFO ] [REMOTE ] CVEO: Full fetch complete (21035 records). [2025-10-30T18:10:39.731354] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-30T18:10:40.108533] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-30T18:10:40.108614] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-30T18:10:40.109039] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-30T18:10:40.109097] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-30T18:10:40.109748] [DEBUG] [LOCAL ] CVEO: Trimmed 21035 records to 15133 (keeping 200 days of data) [2025-10-30T18:10:40.193853] [DEBUG] [LOCAL ] CVEO: Primary data saved (15133 records). [2025-10-30T18:10:40.193982] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-30T18:10:40.194060] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 21.7s. Estimated remaining: 3h 47m 15s. Rate: 7.9 symbols/min [2025-10-30T18:10:40.360255] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:40.374988] [DEBUG] [LOCAL ] CVLG: Loaded 15169 existing records from primary storage. [2025-10-30T18:10:40.375239] [INFO ] [MAIN ] CVLG: Loaded 15169 existing records. [2025-10-30T18:10:40.502786] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-30T18:10:40.560279] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:40.560495] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-30T18:10:40.560543] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-30T18:10:40.560914] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-30T18:10:40.560972] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-30T18:10:40.919638] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:40.993879] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T18:10:41.297502] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-30T18:10:41.671078] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T18:10:42.097485] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-30T18:10:42.897503] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-30T18:10:42.933764] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-30T18:10:43.320266] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T18:10:43.667925] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-30T18:10:43.697450] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-30T18:10:44.208312] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T18:10:44.497502] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-30T18:10:45.297485] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-30T18:10:45.343153] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-30T18:10:46.097494] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-30T18:10:46.756021] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-30T18:10:46.797090] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T18:10:46.897473] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-30T18:10:47.697504] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-30T18:10:48.467273] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T18:10:48.497449] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-30T18:10:49.184761] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T18:10:49.297464] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-30T18:10:49.919281] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T18:10:50.097527] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-30T18:10:50.407609] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T18:10:50.897484] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-30T18:10:51.697531] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-30T18:10:51.750007] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-30T18:10:51.762911] [INFO ] [REMOTE ] CVE: Full fetch complete (77711 records). [2025-10-30T18:10:51.763068] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-30T18:10:52.226723] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-30T18:10:52.226890] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-30T18:10:52.227810] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-30T18:10:52.227879] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-30T18:10:52.229475] [DEBUG] [LOCAL ] CVE: Trimmed 77711 records to 53948 (keeping 200 days of data) [2025-10-30T18:10:52.351887] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T18:10:52.499936] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-30T18:10:52.499867] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T18:10:52.516882] [INFO ] [REMOTE ] CUZ: Full fetch complete (70847 records). [2025-10-30T18:10:52.519201] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-30T18:10:52.843189] [DEBUG] [LOCAL ] CVE: Primary data saved (53948 records). [2025-10-30T18:10:52.863672] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-30T18:10:52.863787] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CVE took 34.4s. Estimated remaining: 3h 47m 24s. Rate: 7.9 symbols/min [2025-10-30T18:10:53.250677] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:53.250939] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-30T18:10:53.252016] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-30T18:10:53.252879] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-30T18:10:53.252962] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-30T18:10:53.254547] [DEBUG] [LOCAL ] CUZ: Trimmed 70847 records to 49667 (keeping 200 days of data) [2025-10-30T18:10:53.309618] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-30T18:10:53.384483] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T18:10:53.545045] [DEBUG] [LOCAL ] CVNA: Loaded 52803 existing records from primary storage. [2025-10-30T18:10:53.550686] [INFO ] [MAIN ] CVNA: Loaded 52803 existing records. [2025-10-30T18:10:53.707178] [DEBUG] [LOCAL ] CUZ: Primary data saved (49667 records). [2025-10-30T18:10:53.727075] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-30T18:10:53.744545] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CUZ took 35.3s. Estimated remaining: 3h 46m 55s. Rate: 7.9 symbols/min [2025-10-30T18:10:54.012779] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:54.028496] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-30T18:10:54.049106] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-30T18:10:54.081688] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:54.082182] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-30T18:10:54.083006] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-30T18:10:54.106281] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-30T18:10:54.471353] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-30T18:10:54.485798] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-30T18:10:54.550760] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:54.688856] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:54.689256] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-30T18:10:54.689459] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-30T18:10:54.690540] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-30T18:10:54.690599] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-30T18:10:54.915482] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-30T18:10:55.073551] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:55.075033] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T18:10:55.109374] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-30T18:10:55.120471] [INFO ] [REMOTE ] CVI: Full fetch complete (67163 records). [2025-10-30T18:10:55.120603] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-30T18:10:55.519309] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-30T18:10:55.519392] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-30T18:10:55.520363] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-30T18:10:55.520430] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-30T18:10:55.521977] [DEBUG] [LOCAL ] CVI: Trimmed 67163 records to 46799 (keeping 200 days of data) [2025-10-30T18:10:55.699909] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-30T18:10:55.798198] [DEBUG] [LOCAL ] CVI: Primary data saved (46799 records). [2025-10-30T18:10:55.798332] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-30T18:10:55.798417] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CVI took 37.3s. Estimated remaining: 3h 46m 30s. Rate: 8.0 symbols/min [2025-10-30T18:10:55.969815] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:56.021491] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-30T18:10:56.021887] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-30T18:10:56.198942] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:56.199130] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-30T18:10:56.199179] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-30T18:10:56.200283] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-30T18:10:56.200341] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-30T18:10:56.498709] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-30T18:10:56.573530] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:10:56.680385] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-30T18:10:57.076098] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T18:10:57.297538] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-30T18:10:57.442741] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-30T18:10:57.804421] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T18:10:58.097471] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-30T18:10:58.871842] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-30T18:10:58.875429] [INFO ] [REMOTE ] CVLG: Full fetch complete (21407 records). [2025-10-30T18:10:58.875526] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-30T18:10:58.904696] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-30T18:10:59.232938] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-30T18:10:59.233015] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-30T18:10:59.233433] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-30T18:10:59.233499] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-30T18:10:59.234076] [DEBUG] [LOCAL ] CVLG: Trimmed 21407 records to 15290 (keeping 200 days of data) [2025-10-30T18:10:59.322607] [DEBUG] [LOCAL ] CVLG: Primary data saved (15290 records). [2025-10-30T18:10:59.322762] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-30T18:10:59.322843] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CVLG took 19.1s. Estimated remaining: 3h 46m 9s. Rate: 8.0 symbols/min [2025-10-30T18:10:59.492026] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:10:59.512352] [DEBUG] [LOCAL ] CW: Loaded 21666 existing records from primary storage. [2025-10-30T18:10:59.512605] [INFO ] [MAIN ] CW: Loaded 21666 existing records. [2025-10-30T18:10:59.694477] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:10:59.694785] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-30T18:10:59.694864] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-30T18:10:59.695498] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-30T18:10:59.695564] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-30T18:10:59.702578] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-30T18:11:00.092302] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:11:00.497489] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-30T18:11:00.994245] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-30T18:11:01.297503] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-30T18:11:01.912513] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T18:11:02.097464] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-30T18:11:02.224804] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-30T18:11:02.726104] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T18:11:02.897496] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-30T18:11:03.010833] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T18:11:03.697479] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-30T18:11:04.497464] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-30T18:11:04.514319] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-30T18:11:04.656624] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-30T18:11:05.297515] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-30T18:11:06.097483] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-30T18:11:06.302493] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-30T18:11:06.897483] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-30T18:11:06.913125] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T18:11:07.082758] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-30T18:11:07.697537] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-30T18:11:08.497564] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-30T18:11:08.768028] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-30T18:11:09.297544] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-30T18:11:09.385231] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T18:11:09.435886] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-30T18:11:10.097505] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-30T18:11:10.897516] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-30T18:11:11.342341] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-30T18:11:11.698383] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-30T18:11:11.698513] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-30T18:11:12.497567] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-30T18:11:12.632175] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-30T18:11:13.297484] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-30T18:11:13.362350] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T18:11:13.479691] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-30T18:11:14.097502] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-30T18:11:14.897514] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-30T18:11:15.395117] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-30T18:11:15.697487] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-30T18:11:15.803564] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-30T18:11:15.827423] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T18:11:16.497524] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-30T18:11:17.297513] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-30T18:11:17.438531] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-30T18:11:18.097485] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-30T18:11:18.172663] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-30T18:11:18.812415] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T18:11:18.897531] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-30T18:11:19.459724] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-30T18:11:19.697496] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-30T18:11:20.375516] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-30T18:11:20.497496] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-30T18:11:20.800526] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-30T18:11:21.297477] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-30T18:11:21.355786] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-30T18:11:21.362489] [INFO ] [REMOTE ] CW: Full fetch complete (33050 records). [2025-10-30T18:11:21.362624] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-30T18:11:21.754877] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-30T18:11:21.754983] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-30T18:11:21.755492] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-30T18:11:21.755534] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-30T18:11:21.756493] [DEBUG] [LOCAL ] CW: Trimmed 33050 records to 21892 (keeping 200 days of data) [2025-10-30T18:11:21.902822] [DEBUG] [LOCAL ] CW: Primary data saved (21892 records). [2025-10-30T18:11:21.902950] [INFO ] [MAIN ] CW: Full history saved. [2025-10-30T18:11:21.903034] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CW took 22.6s. Estimated remaining: 3h 46m 49s. Rate: 7.9 symbols/min [2025-10-30T18:11:22.068924] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:11:22.097518] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-30T18:11:22.116766] [DEBUG] [LOCAL ] CWAN: Loaded 52667 existing records from primary storage. [2025-10-30T18:11:22.117067] [INFO ] [MAIN ] CWAN: Loaded 52667 existing records. [2025-10-30T18:11:22.289033] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:11:22.289243] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-30T18:11:22.289295] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-30T18:11:22.290166] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-30T18:11:22.290222] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-30T18:11:22.642579] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:11:22.873193] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-30T18:11:22.897464] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-30T18:11:23.697519] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-30T18:11:24.229576] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-30T18:11:24.497493] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-30T18:11:24.708921] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-30T18:11:24.720321] [INFO ] [REMOTE ] CVNA: Full fetch complete (76713 records). [2025-10-30T18:11:24.720443] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-30T18:11:25.111857] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-30T18:11:25.112030] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-30T18:11:25.112911] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-30T18:11:25.112996] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-30T18:11:25.114506] [DEBUG] [LOCAL ] CVNA: Trimmed 76713 records to 53193 (keeping 200 days of data) [2025-10-30T18:11:25.254701] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T18:11:25.323441] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-30T18:11:25.468406] [DEBUG] [LOCAL ] CVNA: Primary data saved (53193 records). [2025-10-30T18:11:25.468528] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-30T18:11:25.468604] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CVNA took 32.6s. Estimated remaining: 3h 46m 29s. Rate: 7.9 symbols/min [2025-10-30T18:11:25.638186] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:11:25.675999] [DEBUG] [LOCAL ] CWEN: Loaded 45066 existing records from primary storage. [2025-10-30T18:11:25.676274] [INFO ] [MAIN ] CWEN: Loaded 45066 existing records. [2025-10-30T18:11:25.855679] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:11:25.855943] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-30T18:11:25.856019] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-30T18:11:25.856811] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-30T18:11:25.856870] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-30T18:11:26.101528] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-30T18:11:26.292493] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:11:26.295909] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-30T18:11:26.795989] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T18:11:26.897524] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-30T18:11:27.697534] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-30T18:11:27.994933] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T18:11:28.234820] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-30T18:11:28.497495] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-30T18:11:29.297499] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-30T18:11:29.651720] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-30T18:11:29.663494] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-30T18:11:29.663629] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-30T18:11:30.054147] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-30T18:11:30.054224] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-30T18:11:30.055067] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-30T18:11:30.055128] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-30T18:11:30.056528] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54084 (keeping 200 days of data) [2025-10-30T18:11:30.112982] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-30T18:11:30.388736] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-30T18:11:30.455639] [DEBUG] [LOCAL ] CVS: Primary data saved (54084 records). [2025-10-30T18:11:30.455870] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-30T18:11:30.455975] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVS took 36.7s. Estimated remaining: 3h 46m 14s. Rate: 7.9 symbols/min [2025-10-30T18:11:30.629169] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:11:30.629451] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-30T18:11:30.629564] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-30T18:11:30.629807] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-30T18:11:30.629919] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-30T18:11:30.630170] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-30T18:11:30.630304] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-30T18:11:30.908250] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-30T18:11:30.914303] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-30T18:11:31.033977] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:11:31.196932] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T18:11:31.697510] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-30T18:11:32.497510] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-30T18:11:32.884763] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-30T18:11:33.021354] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T18:11:33.297499] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-30T18:11:33.980860] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T18:11:34.097508] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-30T18:11:34.431508] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T18:11:34.897493] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-30T18:11:35.516740] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T18:11:35.697488] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-30T18:11:36.107407] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T18:11:36.497491] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-30T18:11:37.297503] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-30T18:11:37.786535] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-30T18:11:37.799701] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-30T18:11:37.799873] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-30T18:11:38.102725] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-30T18:11:38.156387] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-30T18:11:38.292502] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-30T18:11:38.292620] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-30T18:11:38.293502] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-30T18:11:38.293604] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-30T18:11:38.295374] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 54150 (keeping 200 days of data) [2025-10-30T18:11:38.558743] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:11:38.672090] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-10-30T18:11:38.672208] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-30T18:11:38.673172] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CVX took 42.9s. Estimated remaining: 3h 46m 8s. Rate: 7.9 symbols/min [2025-10-30T18:11:38.838456] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:11:38.838580] [DEBUG] [LOCAL ] CWK: No existing data file found in primary storage. [2025-10-30T18:11:38.838615] [WARN ] [MAIN ] CWK: No existing data found, performing full refresh instead. [2025-10-30T18:11:38.838766] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-30T18:11:38.838819] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-30T18:11:38.838861] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-30T18:11:38.838893] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-30T18:11:38.902598] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-30T18:11:39.190562] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:11:39.507613] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:11:39.697507] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-30T18:11:40.258204] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T18:11:40.497528] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-30T18:11:40.859399] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T18:11:41.297473] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-30T18:11:41.919412] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T18:11:42.097460] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-30T18:11:42.640136] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:11:42.897520] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-30T18:11:42.957230] [DEBUG] [REMOTE ] CWH: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-30T18:11:42.957460] [WARN ] [REMOTE ] CWH: No data returned for month 2025-05 [2025-10-30T18:11:42.957547] [FATAL] [REMOTE ] CWH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:11:42.957707] [FATAL] [MAIN ] CWH: Failed to fetch primary data. [2025-10-30T18:11:42.957785] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:11:42.957852] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-30T18:11:42.957937] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-30T18:11:42.957992] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-30T18:11:42.958044] [DEBUG] [LOCAL ] CWH: No derivative data file found to delete. [2025-10-30T18:11:42.958112] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CWH took 12.5s. Estimated remaining: 3h 45m 50s. Rate: 8.0 symbols/min [2025-10-30T18:11:43.131061] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:11:43.156094] [DEBUG] [LOCAL ] CWT: Loaded 27620 existing records from primary storage. [2025-10-30T18:11:43.156372] [INFO ] [MAIN ] CWT: Loaded 27620 existing records. [2025-10-30T18:11:43.340701] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:11:43.341077] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-30T18:11:43.341173] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-30T18:11:43.342044] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-30T18:11:43.342103] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-30T18:11:43.705057] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-30T18:11:43.704976] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-30T18:11:43.761937] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:11:44.497511] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-30T18:11:45.150920] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-30T18:11:45.297510] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-30T18:11:45.352059] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T18:11:46.097500] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-30T18:11:46.433497] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T18:11:46.776186] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-30T18:11:46.897576] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-30T18:11:47.697559] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-30T18:11:48.485720] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T18:11:48.497492] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-30T18:11:48.499371] [INFO ] [REMOTE ] CWAN: Full fetch complete (75636 records). [2025-10-30T18:11:48.499493] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-30T18:11:48.895682] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-30T18:11:48.895790] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-30T18:11:48.896664] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-30T18:11:48.896744] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-30T18:11:48.906824] [DEBUG] [LOCAL ] CWAN: Trimmed 75636 records to 53049 (keeping 200 days of data) [2025-10-30T18:11:48.923668] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T18:11:49.235938] [DEBUG] [LOCAL ] CWAN: Primary data saved (53049 records). [2025-10-30T18:11:49.236058] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-30T18:11:49.236750] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWAN took 27.3s. Estimated remaining: 3h 45m 39s. Rate: 8.0 symbols/min [2025-10-30T18:11:49.302220] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-30T18:11:49.428699] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:11:49.447208] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-30T18:11:49.501443] [DEBUG] [LOCAL ] CX: Loaded 52765 existing records from primary storage. [2025-10-30T18:11:49.501815] [INFO ] [MAIN ] CX: Loaded 52765 existing records. [2025-10-30T18:11:49.691125] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:11:49.691375] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-30T18:11:49.691424] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-30T18:11:49.692403] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-30T18:11:49.692464] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-30T18:11:50.079023] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:11:50.097467] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-30T18:11:50.423826] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T18:11:50.897529] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-30T18:11:51.551510] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T18:11:51.697498] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-30T18:11:52.043471] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T18:11:52.497521] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-30T18:11:52.893546] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T18:11:53.297486] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-30T18:11:53.495070] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T18:11:54.097542] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-30T18:11:54.657682] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T18:11:54.897556] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-30T18:11:55.409092] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T18:11:55.697505] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-30T18:11:56.025223] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T18:11:56.497549] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-30T18:11:57.243549] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-30T18:11:57.297468] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-30T18:11:57.429028] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T18:11:58.097548] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-30T18:11:58.627376] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T18:11:58.860067] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T18:11:58.897509] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-30T18:11:59.697466] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-30T18:11:59.808985] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T18:12:00.497491] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-30T18:12:01.280411] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-30T18:12:01.297532] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-30T18:12:01.666254] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:12:02.097565] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-30T18:12:02.891828] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T18:12:02.901614] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-30T18:12:02.903183] [INFO ] [REMOTE ] CWEN: Full fetch complete (65795 records). [2025-10-30T18:12:02.903276] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-30T18:12:03.285176] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-30T18:12:03.285266] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-30T18:12:03.286070] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-30T18:12:03.286138] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-30T18:12:03.287571] [DEBUG] [LOCAL ] CWEN: Trimmed 65795 records to 45419 (keeping 200 days of data) [2025-10-30T18:12:03.560273] [DEBUG] [LOCAL ] CWEN: Primary data saved (45419 records). [2025-10-30T18:12:03.560495] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-30T18:12:03.560597] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CWEN took 38.1s. Estimated remaining: 3h 45m 52s. Rate: 7.9 symbols/min [2025-10-30T18:12:03.709266] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-30T18:12:03.743917] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:03.776920] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-30T18:12:03.791555] [DEBUG] [LOCAL ] CXE: Loaded 6315 existing records from primary storage. [2025-10-30T18:12:03.792216] [INFO ] [MAIN ] CXE: Loaded 6315 existing records. [2025-10-30T18:12:03.994358] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:12:03.994667] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-30T18:12:03.994745] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-30T18:12:03.995031] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-30T18:12:04.011780] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-30T18:12:04.073536] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-30T18:12:04.132151] [INFO ] [REMOTE ] CWT: Full fetch complete (41062 records). [2025-10-30T18:12:04.143432] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-30T18:12:04.177709] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:12:04.209482] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:12:04.255606] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:12:04.282842] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-30T18:12:04.314815] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-30T18:12:04.315019] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-30T18:12:04.315367] [DEBUG] [LOCAL ] CWT: Deleted derivative data file. [2025-10-30T18:12:04.326062] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWT took 21.4s. Estimated remaining: 3h 45m 24s. Rate: 8.0 symbols/min [2025-10-30T18:12:04.499921] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-30T18:12:04.506782] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:04.579198] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:04.584981] [DEBUG] [LOCAL ] CXH: Loaded 4331 existing records from primary storage. [2025-10-30T18:12:04.585173] [INFO ] [MAIN ] CXH: Loaded 4331 existing records. [2025-10-30T18:12:04.760503] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:12:04.760762] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-30T18:12:04.760820] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-30T18:12:04.761035] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-30T18:12:04.761093] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-30T18:12:05.111758] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:05.297517] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-30T18:12:05.472633] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-30T18:12:05.675850] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T18:12:05.784264] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T18:12:06.097498] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-30T18:12:06.897494] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-30T18:12:07.193855] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T18:12:07.521029] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-30T18:12:07.697534] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-30T18:12:08.497513] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-30T18:12:08.967287] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T18:12:09.297499] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-30T18:12:09.683067] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:12:10.097526] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-30T18:12:10.355444] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-30T18:12:10.802516] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T18:12:10.897482] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-30T18:12:11.697502] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-30T18:12:12.074471] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T18:12:12.497481] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-30T18:12:12.587054] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T18:12:12.602917] [INFO ] [REMOTE ] CX: Full fetch complete (76545 records). [2025-10-30T18:12:12.603204] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-30T18:12:12.985454] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T18:12:13.039412] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-30T18:12:13.039529] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-30T18:12:13.040721] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-30T18:12:13.040793] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-30T18:12:13.042911] [DEBUG] [LOCAL ] CX: Trimmed 76545 records to 53144 (keeping 200 days of data) [2025-10-30T18:12:13.305997] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-30T18:12:13.398007] [DEBUG] [LOCAL ] CX: Primary data saved (53144 records). [2025-10-30T18:12:13.398238] [INFO ] [MAIN ] CX: Full history saved. [2025-10-30T18:12:13.399071] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CX took 24.2s. Estimated remaining: 3h 45m 21s. Rate: 8.0 symbols/min [2025-10-30T18:12:13.612003] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:13.612273] [DEBUG] [LOCAL ] CXM: No existing data file found in primary storage. [2025-10-30T18:12:13.612314] [WARN ] [MAIN ] CXM: No existing data found, performing full refresh instead. [2025-10-30T18:12:13.612468] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-30T18:12:13.612513] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-30T18:12:13.612555] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-10-30T18:12:13.612590] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-30T18:12:13.716545] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-30T18:12:14.049502] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:14.097495] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-30T18:12:14.897575] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-30T18:12:15.314206] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-30T18:12:15.353433] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:12:15.697468] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-30T18:12:16.344355] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-30T18:12:16.497476] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-30T18:12:16.961606] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T18:12:17.297514] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-30T18:12:18.097507] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-30T18:12:18.365543] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-30T18:12:18.472906] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T18:12:18.897495] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-30T18:12:19.418565] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T18:12:19.697540] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-30T18:12:20.127162] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-30T18:12:20.129048] [INFO ] [REMOTE ] CXH: Full fetch complete (5300 records). [2025-10-30T18:12:20.129183] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-30T18:12:20.505069] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-30T18:12:20.534823] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-30T18:12:20.534937] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-30T18:12:20.535234] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-30T18:12:20.535283] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-30T18:12:20.535838] [DEBUG] [LOCAL ] CXH: Trimmed 5300 records to 4344 (keeping 200 days of data) [2025-10-30T18:12:20.563015] [DEBUG] [LOCAL ] CXH: Primary data saved (4344 records). [2025-10-30T18:12:20.563157] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-30T18:12:20.563262] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CXH took 16.2s. Estimated remaining: 3h 45m 12s. Rate: 8.0 symbols/min [2025-10-30T18:12:20.761538] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:20.761759] [DEBUG] [LOCAL ] CXT: No existing data file found in primary storage. [2025-10-30T18:12:20.761805] [WARN ] [MAIN ] CXT: No existing data found, performing full refresh instead. [2025-10-30T18:12:20.761931] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-30T18:12:20.761971] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-30T18:12:20.762012] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-10-30T18:12:20.762042] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-30T18:12:21.108725] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:21.297503] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-30T18:12:21.726086] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T18:12:22.097502] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-30T18:12:22.471424] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T18:12:22.897496] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-30T18:12:23.269945] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-30T18:12:23.697484] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-30T18:12:23.942696] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:12:24.253374] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T18:12:24.497463] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-30T18:12:25.297526] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-30T18:12:25.521092] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T18:12:26.097488] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-30T18:12:26.300486] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-30T18:12:26.580689] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T18:12:26.897512] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-30T18:12:27.697516] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-30T18:12:28.094888] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:12:28.497479] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-30T18:12:28.617866] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T18:12:29.297509] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-30T18:12:29.592262] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T18:12:30.097500] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-30T18:12:30.446882] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T18:12:30.897493] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-30T18:12:31.284815] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:12:31.697709] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-30T18:12:31.784834] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T18:12:32.497501] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-30T18:12:32.871620] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T18:12:33.297497] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-30T18:12:33.465116] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T18:12:33.665066] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T18:12:34.097588] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-30T18:12:34.595410] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-30T18:12:34.897517] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-30T18:12:35.697490] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-30T18:12:35.869188] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T18:12:36.497502] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-30T18:12:36.851057] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T18:12:37.297502] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-30T18:12:37.510680] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T18:12:37.923636] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T18:12:38.097533] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-30T18:12:38.897516] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-30T18:12:39.353380] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T18:12:39.382007] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:12:39.697488] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-30T18:12:40.497504] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-30T18:12:40.911827] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-30T18:12:41.260039] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T18:12:41.271839] [INFO ] [REMOTE ] CWK: Full fetch complete (71510 records). [2025-10-30T18:12:41.271984] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-30T18:12:41.302719] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-30T18:12:41.679206] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-30T18:12:41.679299] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-30T18:12:41.680183] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-30T18:12:41.680247] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-30T18:12:41.681795] [DEBUG] [LOCAL ] CWK: Trimmed 71510 records to 49967 (keeping 200 days of data) [2025-10-30T18:12:41.897151] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-30T18:12:41.900984] [INFO ] [REMOTE ] CXE: Full fetch complete (11007 records). [2025-10-30T18:12:41.902180] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-30T18:12:42.109508] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-30T18:12:42.437238] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-30T18:12:42.441992] [DEBUG] [LOCAL ] CWK: Primary data saved (49967 records). [2025-10-30T18:12:42.442219] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-30T18:12:42.442358] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CWK took 1m 4s. Estimated remaining: 3h 45m 49s. Rate: 7.9 symbols/min [2025-10-30T18:12:42.442144] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-30T18:12:42.442841] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-30T18:12:42.448188] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-30T18:12:42.513824] [DEBUG] [LOCAL ] CXE: Trimmed 11007 records to 6405 (keeping 200 days of data) [2025-10-30T18:12:42.650921] [DEBUG] [LOCAL ] CXE: Primary data saved (6405 records). [2025-10-30T18:12:42.652893] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-30T18:12:42.653522] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXE took 39.1s. Estimated remaining: 3h 45m 19s. Rate: 7.9 symbols/min [2025-10-30T18:12:42.709869] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:42.854046] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:42.854278] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-30T18:12:42.854341] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-30T18:12:42.854452] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-30T18:12:42.854496] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-30T18:12:42.854537] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-30T18:12:42.854611] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-30T18:12:42.898259] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-30T18:12:43.001591] [DEBUG] [LOCAL ] CXW: Loaded 43431 existing records from primary storage. [2025-10-30T18:12:43.050599] [INFO ] [MAIN ] CXW: Loaded 43431 existing records. [2025-10-30T18:12:43.448161] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:43.455304] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:12:43.455938] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-30T18:12:43.456123] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-30T18:12:43.463860] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-30T18:12:43.475984] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-30T18:12:43.510930] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T18:12:43.702733] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-30T18:12:43.856208] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:44.023461] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-30T18:12:44.497530] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-30T18:12:44.928110] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-30T18:12:44.978237] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-30T18:12:44.985929] [INFO ] [REMOTE ] CXT: Full fetch complete (45396 records). [2025-10-30T18:12:44.986089] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-30T18:12:45.302761] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-30T18:12:45.396982] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-30T18:12:45.397075] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-30T18:12:45.397747] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-30T18:12:45.397813] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-30T18:12:45.399202] [DEBUG] [LOCAL ] CXT: Trimmed 45396 records to 30508 (keeping 200 days of data) [2025-10-30T18:12:45.582327] [DEBUG] [LOCAL ] CXT: Primary data saved (30508 records). [2025-10-30T18:12:45.582473] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-30T18:12:45.582547] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CXT took 25.0s. Estimated remaining: 3h 44m 57s. Rate: 7.9 symbols/min [2025-10-30T18:12:45.753500] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:45.792290] [DEBUG] [LOCAL ] CYH: Loaded 47644 existing records from primary storage. [2025-10-30T18:12:45.792577] [INFO ] [MAIN ] CYH: Loaded 47644 existing records. [2025-10-30T18:12:45.970613] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:12:45.970850] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-30T18:12:45.970897] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-30T18:12:45.971762] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-30T18:12:45.971832] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-30T18:12:46.111984] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-30T18:12:46.334926] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:46.843384] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-30T18:12:46.854721] [INFO ] [REMOTE ] CXM: Full fetch complete (68334 records). [2025-10-30T18:12:46.855137] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-30T18:12:46.903045] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-30T18:12:47.298565] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T18:12:47.321508] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-30T18:12:47.321627] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-30T18:12:47.322467] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-30T18:12:47.322534] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-30T18:12:47.324317] [DEBUG] [LOCAL ] CXM: Trimmed 68334 records to 47319 (keeping 200 days of data) [2025-10-30T18:12:47.639738] [DEBUG] [LOCAL ] CXM: Primary data saved (47319 records). [2025-10-30T18:12:47.639882] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-30T18:12:47.639954] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXM took 34.2s. Estimated remaining: 3h 44m 32s. Rate: 8.0 symbols/min [2025-10-30T18:12:47.703066] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-30T18:12:47.845731] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:12:47.899401] [DEBUG] [LOCAL ] D: Loaded 53648 existing records from primary storage. [2025-10-30T18:12:47.899847] [INFO ] [MAIN ] D: Loaded 53648 existing records. [2025-10-30T18:12:48.083388] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:12:48.083666] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-30T18:12:48.083727] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-30T18:12:48.084926] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-30T18:12:48.084984] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-30T18:12:48.464051] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:12:48.493981] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-30T18:12:48.502989] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-30T18:12:48.707788] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T18:12:49.297517] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-30T18:12:50.097220] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-30T18:12:50.107720] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-30T18:12:50.629735] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T18:12:50.897537] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-30T18:12:51.575597] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-30T18:12:51.697511] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-30T18:12:52.416824] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-30T18:12:52.497507] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-30T18:12:52.929628] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:12:53.297504] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-30T18:12:53.936405] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T18:12:54.097515] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-30T18:12:54.369007] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-30T18:12:54.897501] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-30T18:12:55.240528] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T18:12:55.697482] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-30T18:12:55.751125] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T18:12:56.497543] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-30T18:12:57.203718] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-30T18:12:57.297469] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-30T18:12:57.460597] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-30T18:12:58.097491] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-30T18:12:58.833353] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T18:12:58.897535] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-30T18:12:59.350423] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T18:12:59.697545] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-30T18:13:00.234181] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T18:13:00.497506] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-30T18:13:01.297491] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-30T18:13:01.354756] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-30T18:13:01.632898] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T18:13:02.097548] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-30T18:13:02.816771] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T18:13:02.897559] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-30T18:13:03.131062] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T18:13:03.697537] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-30T18:13:03.911182] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T18:13:04.497503] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-30T18:13:04.913633] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:13:05.297538] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-30T18:13:05.961328] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T18:13:06.097489] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-30T18:13:06.420071] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T18:13:06.897516] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-30T18:13:07.411172] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-30T18:13:07.697500] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-30T18:13:08.030551] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T18:13:08.037727] [INFO ] [REMOTE ] CYD: Full fetch complete (36935 records). [2025-10-30T18:13:08.037850] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-30T18:13:08.404459] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-30T18:13:08.404542] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-30T18:13:08.405159] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-30T18:13:08.405223] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-30T18:13:08.406142] [DEBUG] [LOCAL ] CYD: Trimmed 36935 records to 27034 (keeping 200 days of data) [2025-10-30T18:13:08.497852] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-30T18:13:08.565476] [DEBUG] [LOCAL ] CYD: Primary data saved (27034 records). [2025-10-30T18:13:08.565602] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-30T18:13:08.565692] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. CYD took 25.9s. Estimated remaining: 3h 45m 6s. Rate: 7.9 symbols/min [2025-10-30T18:13:08.743676] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:08.756922] [DEBUG] [LOCAL ] DAC: Loaded 11817 existing records from primary storage. [2025-10-30T18:13:08.757147] [INFO ] [MAIN ] DAC: Loaded 11817 existing records. [2025-10-30T18:13:08.964516] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:13:08.964733] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-30T18:13:08.964786] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-30T18:13:08.965177] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-30T18:13:08.965234] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-30T18:13:09.307290] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-30T18:13:09.311726] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:09.800292] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-30T18:13:09.812786] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-30T18:13:09.812931] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-30T18:13:09.992213] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T18:13:10.103617] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-30T18:13:10.256594] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-30T18:13:10.256699] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-30T18:13:10.257533] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-30T18:13:10.257575] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-30T18:13:10.259048] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 54038 (keeping 200 days of data) [2025-10-30T18:13:10.581980] [DEBUG] [LOCAL ] D: Primary data saved (54038 records). [2025-10-30T18:13:10.582112] [INFO ] [MAIN ] D: Full history saved. [2025-10-30T18:13:10.582834] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. D took 22.9s. Estimated remaining: 3h 44m 42s. Rate: 7.9 symbols/min [2025-10-30T18:13:10.756594] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:10.786034] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-30T18:13:10.840179] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-30T18:13:10.840476] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-30T18:13:10.904579] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-30T18:13:11.018983] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:13:11.019183] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-30T18:13:11.019232] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-30T18:13:11.020151] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-30T18:13:11.020208] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-30T18:13:11.385257] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:11.414813] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T18:13:11.697559] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-30T18:13:12.247192] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T18:13:12.497511] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-30T18:13:12.984858] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T18:13:13.297524] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-30T18:13:13.744714] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T18:13:14.097530] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-30T18:13:14.897555] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-30T18:13:15.115601] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-30T18:13:15.266266] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T18:13:15.697485] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-30T18:13:15.738140] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T18:13:16.497519] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-30T18:13:16.984457] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T18:13:17.297498] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-30T18:13:18.102627] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-30T18:13:18.119950] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-30T18:13:18.500083] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T18:13:18.897497] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-30T18:13:19.524307] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T18:13:19.534965] [INFO ] [REMOTE ] CYH: Full fetch complete (69685 records). [2025-10-30T18:13:19.535171] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-30T18:13:19.535874] [FATAL] [VALIDATOR ] CYH: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:13:19.535959] [FATAL] [MAIN ] CYH: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:13:19.536012] [WARN ] [MAIN ] CYH: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:13:19.536091] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-30T18:13:19.536169] [DEBUG] [LOCAL ] CYH: No primary data file found to delete. [2025-10-30T18:13:19.536218] [INFO ] [LOCAL ] CYH: Starting deletion of derivative data. [2025-10-30T18:13:19.536440] [DEBUG] [LOCAL ] CYH: Deleted derivative data file. [2025-10-30T18:13:19.536546] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. CYH took 34.0s. Estimated remaining: 3h 44m 38s. Rate: 7.9 symbols/min [2025-10-30T18:13:19.649373] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T18:13:19.701174] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-30T18:13:19.730262] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:19.772269] [DEBUG] [LOCAL ] DAN: Loaded 49322 existing records from primary storage. [2025-10-30T18:13:19.772568] [INFO ] [MAIN ] DAN: Loaded 49322 existing records. [2025-10-30T18:13:19.943534] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:13:19.943796] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-30T18:13:19.943846] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-30T18:13:19.944910] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-30T18:13:19.944966] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-30T18:13:20.322700] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:20.375477] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T18:13:20.497514] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-30T18:13:21.297524] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-30T18:13:21.918270] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T18:13:22.097516] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-30T18:13:22.779469] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T18:13:22.897464] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-30T18:13:22.944676] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-30T18:13:23.697491] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-30T18:13:24.281573] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T18:13:24.301197] [INFO ] [REMOTE ] CXW: Full fetch complete (64795 records). [2025-10-30T18:13:24.301815] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-30T18:13:24.301566] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-30T18:13:24.504778] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-30T18:13:24.730958] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-30T18:13:24.731052] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-30T18:13:24.731867] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-30T18:13:24.731932] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-30T18:13:24.733265] [DEBUG] [LOCAL ] CXW: Trimmed 64795 records to 43763 (keeping 200 days of data) [2025-10-30T18:13:24.984065] [DEBUG] [LOCAL ] CXW: Primary data saved (43763 records). [2025-10-30T18:13:24.984191] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-30T18:13:24.984270] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. CXW took 42.5s. Estimated remaining: 3h 44m 24s. Rate: 7.9 symbols/min [2025-10-30T18:13:25.162759] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:25.183213] [DEBUG] [LOCAL ] DAO: Loaded 19601 existing records from primary storage. [2025-10-30T18:13:25.183432] [INFO ] [MAIN ] DAO: Loaded 19601 existing records. [2025-10-30T18:13:25.302705] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-30T18:13:25.381854] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:13:25.382211] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-30T18:13:25.382273] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-30T18:13:25.382816] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-30T18:13:25.382874] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-30T18:13:25.758802] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:26.012781] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-30T18:13:26.097513] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-30T18:13:26.340589] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-30T18:13:26.897515] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-30T18:13:26.925196] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T18:13:27.419558] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-30T18:13:27.697564] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-30T18:13:28.497517] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-30T18:13:28.933171] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T18:13:29.297515] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-30T18:13:30.097548] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-30T18:13:30.345791] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:13:30.431128] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-30T18:13:30.545777] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-30T18:13:30.897512] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-30T18:13:31.697498] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-30T18:13:31.909371] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T18:13:32.497528] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-30T18:13:33.104537] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T18:13:33.123054] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T18:13:33.297488] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-30T18:13:34.097491] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-30T18:13:34.897526] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-30T18:13:35.050150] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T18:13:35.204531] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-30T18:13:35.697513] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-30T18:13:36.243637] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T18:13:36.379637] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-30T18:13:36.497505] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-30T18:13:37.292282] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-30T18:13:37.297455] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-30T18:13:37.882058] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-30T18:13:38.097517] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-30T18:13:38.863424] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-30T18:13:38.867367] [INFO ] [REMOTE ] DAC: Full fetch complete (18652 records). [2025-10-30T18:13:38.867540] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-30T18:13:38.903109] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-30T18:13:39.270745] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-30T18:13:39.270847] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-30T18:13:39.271252] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-30T18:13:39.271293] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-30T18:13:39.272086] [DEBUG] [LOCAL ] DAC: Trimmed 18652 records to 11857 (keeping 200 days of data) [2025-10-30T18:13:39.343003] [DEBUG] [LOCAL ] DAC: Primary data saved (11857 records). [2025-10-30T18:13:39.343140] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-30T18:13:39.343219] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. DAC took 30.8s. Estimated remaining: 3h 44m 37s. Rate: 7.9 symbols/min [2025-10-30T18:13:39.519079] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:39.567532] [DEBUG] [LOCAL ] DAR: Loaded 51972 existing records from primary storage. [2025-10-30T18:13:39.567887] [INFO ] [MAIN ] DAR: Loaded 51972 existing records. [2025-10-30T18:13:39.707204] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-30T18:13:39.748897] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:13:39.749329] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-30T18:13:39.749395] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-30T18:13:39.750213] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-30T18:13:39.750288] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-30T18:13:40.105862] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:40.261684] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T18:13:40.497512] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-30T18:13:41.294419] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T18:13:41.298618] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-30T18:13:41.755045] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-30T18:13:42.097506] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-30T18:13:42.675176] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-30T18:13:42.897520] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-30T18:13:43.501627] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T18:13:43.697489] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-30T18:13:44.497461] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-30T18:13:44.660112] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-30T18:13:45.211293] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-30T18:13:45.297572] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-30T18:13:45.715266] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T18:13:46.097556] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-30T18:13:46.727933] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T18:13:46.763682] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:13:46.897500] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-30T18:13:47.697538] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-30T18:13:48.124041] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T18:13:48.497540] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-30T18:13:48.746373] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T18:13:48.752266] [INFO ] [REMOTE ] DAO: Full fetch complete (32966 records). [2025-10-30T18:13:48.752410] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-30T18:13:49.143240] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-30T18:13:49.143365] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-30T18:13:49.144160] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-30T18:13:49.144291] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-30T18:13:49.145470] [DEBUG] [LOCAL ] DAO: Trimmed 32966 records to 19842 (keeping 200 days of data) [2025-10-30T18:13:49.264396] [DEBUG] [LOCAL ] DAO: Primary data saved (19842 records). [2025-10-30T18:13:49.264527] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-30T18:13:49.264602] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. DAO took 24.3s. Estimated remaining: 3h 44m 37s. Rate: 7.9 symbols/min [2025-10-30T18:13:49.307353] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-30T18:13:49.469110] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:49.469279] [DEBUG] [LOCAL ] DAVA: No existing data file found in primary storage. [2025-10-30T18:13:49.469332] [WARN ] [MAIN ] DAVA: No existing data found, performing full refresh instead. [2025-10-30T18:13:49.469476] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-30T18:13:49.469542] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-30T18:13:49.469612] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-30T18:13:49.469720] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-30T18:13:49.853429] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:50.047903] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-30T18:13:50.097472] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-30T18:13:50.348986] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T18:13:50.897476] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-30T18:13:51.075755] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T18:13:51.526714] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-30T18:13:51.538774] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-30T18:13:51.538930] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-30T18:13:51.698452] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-30T18:13:51.948710] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-30T18:13:51.948798] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-30T18:13:51.949678] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-30T18:13:51.949741] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-30T18:13:51.951190] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 54143 (keeping 200 days of data) [2025-10-30T18:13:52.284816] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-10-30T18:13:52.284944] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-30T18:13:52.285672] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAL took 41.7s. Estimated remaining: 3h 44m 16s. Rate: 7.9 symbols/min [2025-10-30T18:13:52.455679] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:52.500131] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-30T18:13:52.502133] [DEBUG] [LOCAL ] DAY: Loaded 49072 existing records from primary storage. [2025-10-30T18:13:52.502486] [INFO ] [MAIN ] DAY: Loaded 49072 existing records. [2025-10-30T18:13:52.678391] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:13:52.678624] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-30T18:13:52.678705] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-30T18:13:52.679442] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-30T18:13:52.679506] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-30T18:13:53.030262] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:53.297482] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-30T18:13:53.402342] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T18:13:53.439792] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-30T18:13:54.097494] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-30T18:13:54.855690] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T18:13:54.867430] [INFO ] [REMOTE ] DAN: Full fetch complete (71536 records). [2025-10-30T18:13:54.867572] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-30T18:13:54.908169] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-30T18:13:55.280236] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-30T18:13:55.280331] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-30T18:13:55.281284] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-30T18:13:55.281347] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-30T18:13:55.282665] [DEBUG] [LOCAL ] DAN: Trimmed 71536 records to 49707 (keeping 200 days of data) [2025-10-30T18:13:55.426758] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T18:13:55.615123] [DEBUG] [LOCAL ] DAN: Primary data saved (49707 records). [2025-10-30T18:13:55.615251] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-30T18:13:55.615329] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAN took 36.1s. Estimated remaining: 3h 43m 55s. Rate: 7.9 symbols/min [2025-10-30T18:13:55.705829] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-30T18:13:55.785047] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:13:55.830898] [DEBUG] [LOCAL ] DB: Loaded 52384 existing records from primary storage. [2025-10-30T18:13:55.831217] [INFO ] [MAIN ] DB: Loaded 52384 existing records. [2025-10-30T18:13:56.016747] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:13:56.016956] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-30T18:13:56.017002] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-30T18:13:56.017864] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-30T18:13:56.017920] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-30T18:13:56.433401] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:13:56.466025] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T18:13:56.497471] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-30T18:13:56.724908] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T18:13:57.297508] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-30T18:13:57.791980] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T18:13:58.097520] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-30T18:13:58.290481] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T18:13:58.897536] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-30T18:13:59.381674] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T18:13:59.697542] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-30T18:14:00.146003] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T18:14:00.497501] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-30T18:14:01.282855] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-30T18:14:01.297447] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-30T18:14:02.013784] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T18:14:02.097546] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-30T18:14:02.897477] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-30T18:14:03.091664] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-30T18:14:03.126427] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T18:14:03.697532] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-30T18:14:04.313623] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-30T18:14:04.497483] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-30T18:14:04.884199] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T18:14:05.297541] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-30T18:14:05.772724] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:14:06.097567] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-30T18:14:06.127893] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-30T18:14:06.897510] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-30T18:14:07.384585] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T18:14:07.697498] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-30T18:14:08.174292] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T18:14:08.497489] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-30T18:14:09.005562] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T18:14:09.297535] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-30T18:14:09.659785] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T18:14:10.097540] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-30T18:14:10.905369] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-30T18:14:10.925600] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-30T18:14:11.645603] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T18:14:11.657165] [INFO ] [REMOTE ] DAR: Full fetch complete (75234 records). [2025-10-30T18:14:11.657305] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-30T18:14:11.702630] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-30T18:14:12.060199] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-30T18:14:12.060277] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-30T18:14:12.061131] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-30T18:14:12.061194] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-30T18:14:12.062559] [DEBUG] [LOCAL ] DAR: Trimmed 75234 records to 52350 (keeping 200 days of data) [2025-10-30T18:14:12.395019] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T18:14:12.399912] [DEBUG] [LOCAL ] DAR: Primary data saved (52350 records). [2025-10-30T18:14:12.400343] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-30T18:14:12.414939] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAR took 33.1s. Estimated remaining: 3h 44m 16s. Rate: 7.9 symbols/min [2025-10-30T18:14:12.502703] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-30T18:14:12.636302] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:14:12.636494] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-30T18:14:12.636578] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-30T18:14:12.636728] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-30T18:14:12.636775] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-30T18:14:12.636816] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-30T18:14:12.636848] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-30T18:14:12.987150] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:14:13.117533] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T18:14:13.297493] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-30T18:14:13.686950] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T18:14:14.097554] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-30T18:14:14.642052] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T18:14:14.897582] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-30T18:14:15.384254] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T18:14:15.427178] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T18:14:15.697546] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-30T18:14:16.497509] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-30T18:14:17.152271] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T18:14:17.297492] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-30T18:14:17.880028] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-30T18:14:17.923104] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T18:14:17.933174] [INFO ] [REMOTE ] DAVA: Full fetch complete (57691 records). [2025-10-30T18:14:17.933264] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-30T18:14:18.100510] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-30T18:14:18.339522] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-30T18:14:18.339609] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-30T18:14:18.340366] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-30T18:14:18.340428] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-30T18:14:18.341673] [DEBUG] [LOCAL ] DAVA: Trimmed 57691 records to 42283 (keeping 200 days of data) [2025-10-30T18:14:18.586374] [DEBUG] [LOCAL ] DAVA: Primary data saved (42283 records). [2025-10-30T18:14:18.586523] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-30T18:14:18.586621] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DAVA took 29.3s. Estimated remaining: 3h 44m 4s. Rate: 7.9 symbols/min [2025-10-30T18:14:18.763305] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:14:18.799421] [DEBUG] [LOCAL ] DBI: Loaded 42869 existing records from primary storage. [2025-10-30T18:14:18.799717] [INFO ] [MAIN ] DBI: Loaded 42869 existing records. [2025-10-30T18:14:18.899702] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-30T18:14:18.978109] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:14:18.978313] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-30T18:14:18.978363] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-30T18:14:18.979074] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-30T18:14:18.979132] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-30T18:14:19.328454] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:14:19.622677] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T18:14:19.697499] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-30T18:14:20.260361] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T18:14:20.365187] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T18:14:20.497514] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-30T18:14:21.297506] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-30T18:14:21.964668] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T18:14:22.097508] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-30T18:14:22.631000] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T18:14:22.897517] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-30T18:14:23.539774] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-30T18:14:23.697490] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-30T18:14:23.739486] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T18:14:23.751432] [INFO ] [REMOTE ] DB: Full fetch complete (75782 records). [2025-10-30T18:14:23.751559] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-30T18:14:24.141729] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-30T18:14:24.141822] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-30T18:14:24.142794] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-30T18:14:24.142862] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-30T18:14:24.144282] [DEBUG] [LOCAL ] DB: Trimmed 75782 records to 52768 (keeping 200 days of data) [2025-10-30T18:14:24.459580] [DEBUG] [LOCAL ] DB: Primary data saved (52768 records). [2025-10-30T18:14:24.459788] [INFO ] [MAIN ] DB: Full history saved. [2025-10-30T18:14:24.459886] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DB took 28.8s. Estimated remaining: 3h 43m 51s. Rate: 7.9 symbols/min [2025-10-30T18:14:24.504130] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-30T18:14:24.642622] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:14:24.653818] [DEBUG] [LOCAL ] DBL: Loaded 9191 existing records from primary storage. [2025-10-30T18:14:24.654070] [INFO ] [MAIN ] DBL: Loaded 9191 existing records. [2025-10-30T18:14:24.847234] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:14:24.847684] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-30T18:14:24.847807] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-30T18:14:24.848139] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-30T18:14:24.848289] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-30T18:14:25.017144] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T18:14:25.295213] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:14:25.302578] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-30T18:14:25.310472] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-30T18:14:25.901499] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-30T18:14:26.097495] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-30T18:14:26.897500] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-30T18:14:27.180982] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T18:14:27.232883] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T18:14:27.697494] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-30T18:14:28.497481] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-30T18:14:29.167770] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T18:14:29.198369] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T18:14:29.205211] [INFO ] [REMOTE ] DAY: Full fetch complete (71990 records). [2025-10-30T18:14:29.205810] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-30T18:14:29.302706] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-30T18:14:29.665413] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-30T18:14:29.665512] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-30T18:14:29.666525] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-30T18:14:29.666595] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-30T18:14:29.668301] [DEBUG] [LOCAL ] DAY: Trimmed 71990 records to 49453 (keeping 200 days of data) [2025-10-30T18:14:29.974024] [DEBUG] [LOCAL ] DAY: Primary data saved (49453 records). [2025-10-30T18:14:29.974162] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-30T18:14:29.974761] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DAY took 37.7s. Estimated remaining: 3h 43m 38s. Rate: 7.9 symbols/min [2025-10-30T18:14:30.102613] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-30T18:14:30.162150] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:14:30.162463] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-30T18:14:30.162508] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-30T18:14:30.162674] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-30T18:14:30.162743] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-30T18:14:30.162798] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-30T18:14:30.162832] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-30T18:14:30.529043] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:14:30.700915] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:14:30.902616] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-30T18:14:30.913177] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T18:14:31.472812] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-30T18:14:31.697500] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-30T18:14:32.497494] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-30T18:14:32.995591] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T18:14:33.042766] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T18:14:33.297506] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-30T18:14:34.097516] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-30T18:14:34.567584] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T18:14:34.897543] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-30T18:14:35.264213] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T18:14:35.349873] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T18:14:35.697529] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-30T18:14:36.199703] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-30T18:14:36.497517] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-30T18:14:37.102397] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T18:14:37.297568] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-30T18:14:38.097541] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-30T18:14:38.412040] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T18:14:38.877902] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T18:14:38.897461] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-30T18:14:39.657519] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T18:14:39.663902] [INFO ] [REMOTE ] DBD: Full fetch complete (32320 records). [2025-10-30T18:14:39.664010] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-30T18:14:39.664696] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:14:39.664777] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:14:39.664819] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:14:39.664887] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-30T18:14:39.664965] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-30T18:14:39.665018] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-30T18:14:39.665060] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-30T18:14:39.665113] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DBD took 27.2s. Estimated remaining: 3h 43m 36s. Rate: 7.9 symbols/min [2025-10-30T18:14:39.702589] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-30T18:14:39.848431] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:14:39.881754] [DEBUG] [LOCAL ] DCI: Loaded 36552 existing records from primary storage. [2025-10-30T18:14:39.882022] [INFO ] [MAIN ] DCI: Loaded 36552 existing records. [2025-10-30T18:14:40.065360] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:14:40.065592] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-30T18:14:40.065661] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-30T18:14:40.066459] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-30T18:14:40.066516] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-30T18:14:40.429837] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:14:40.497482] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-30T18:14:40.830500] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T18:14:40.961850] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T18:14:41.297512] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-30T18:14:41.822409] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-30T18:14:42.097490] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-30T18:14:42.897466] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-30T18:14:43.098745] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T18:14:43.697501] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-30T18:14:44.295590] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:14:44.497496] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-30T18:14:44.902110] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T18:14:45.006404] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T18:14:45.297495] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-30T18:14:46.097499] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-30T18:14:46.560564] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T18:14:46.897487] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-30T18:14:47.286011] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T18:14:47.605611] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T18:14:47.607881] [INFO ] [REMOTE ] DBL: Full fetch complete (12711 records). [2025-10-30T18:14:47.607951] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-30T18:14:47.705769] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-30T18:14:47.987712] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-30T18:14:47.987841] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-30T18:14:47.988252] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-30T18:14:47.988317] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-30T18:14:47.989317] [DEBUG] [LOCAL ] DBL: Trimmed 12711 records to 9237 (keeping 200 days of data) [2025-10-30T18:14:48.048768] [DEBUG] [LOCAL ] DBL: Primary data saved (9237 records). [2025-10-30T18:14:48.048903] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-30T18:14:48.048984] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DBL took 23.6s. Estimated remaining: 3h 43m 31s. Rate: 7.9 symbols/min [2025-10-30T18:14:48.235060] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:14:48.235257] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-30T18:14:48.235302] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-30T18:14:48.235416] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-30T18:14:48.235461] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-30T18:14:48.235506] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-30T18:14:48.235541] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-30T18:14:48.502575] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-30T18:14:48.616722] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:14:48.920260] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T18:14:49.297494] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-30T18:14:49.551874] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:14:49.881308] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-30T18:14:50.097552] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-30T18:14:50.897544] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-30T18:14:51.235882] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T18:14:51.697542] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-30T18:14:52.305164] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-30T18:14:52.497496] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-30T18:14:52.654233] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T18:14:53.297528] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-30T18:14:53.755395] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T18:14:53.835686] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-30T18:14:54.097534] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-30T18:14:54.897505] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-30T18:14:55.267507] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T18:14:55.697479] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-30T18:14:56.105955] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T18:14:56.114266] [INFO ] [REMOTE ] DBI: Full fetch complete (64262 records). [2025-10-30T18:14:56.114408] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-30T18:14:56.497904] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-30T18:14:56.514900] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-30T18:14:56.515010] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-30T18:14:56.515816] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-30T18:14:56.516145] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-30T18:14:56.517506] [DEBUG] [LOCAL ] DBI: Trimmed 64262 records to 43087 (keeping 200 days of data) [2025-10-30T18:14:56.743243] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-30T18:14:56.804031] [DEBUG] [LOCAL ] DBI: Primary data saved (43087 records). [2025-10-30T18:14:56.804168] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-30T18:14:56.805096] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBI took 38.2s. Estimated remaining: 3h 43m 27s. Rate: 7.9 symbols/min [2025-10-30T18:14:56.987486] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:14:57.038742] [DEBUG] [LOCAL ] DD: Loaded 52905 existing records from primary storage. [2025-10-30T18:14:57.039045] [INFO ] [MAIN ] DD: Loaded 52905 existing records. [2025-10-30T18:14:57.223812] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:14:57.224040] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-30T18:14:57.224088] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-30T18:14:57.224991] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-30T18:14:57.225049] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-30T18:14:57.302578] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-30T18:14:57.581830] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:14:57.865814] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T18:14:58.097472] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-30T18:14:58.145200] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-30T18:14:58.897480] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-30T18:14:59.483164] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-30T18:14:59.630428] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-30T18:14:59.697514] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-30T18:15:00.497531] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-30T18:15:01.229542] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T18:15:01.297530] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-30T18:15:01.641888] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T18:15:02.097543] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-30T18:15:02.897509] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-30T18:15:03.180510] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T18:15:03.248221] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-30T18:15:03.601175] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T18:15:03.697511] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-30T18:15:04.502778] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-30T18:15:04.509516] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T18:15:05.297506] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-30T18:15:05.804946] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T18:15:05.817497] [INFO ] [REMOTE ] DBRG: Full fetch complete (72348 records). [2025-10-30T18:15:05.817697] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-30T18:15:05.818508] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:15:05.818613] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:15:05.818698] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:15:05.818773] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-30T18:15:05.818837] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-30T18:15:05.818875] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-10-30T18:15:05.818913] [DEBUG] [LOCAL ] DBRG: No derivative data file found to delete. [2025-10-30T18:15:05.818970] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DBRG took 35.8s. Estimated remaining: 3h 43m 24s. Rate: 7.9 symbols/min [2025-10-30T18:15:06.003441] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:15:06.053085] [DEBUG] [LOCAL ] DDD: Loaded 50923 existing records from primary storage. [2025-10-30T18:15:06.053378] [INFO ] [MAIN ] DDD: Loaded 50923 existing records. [2025-10-30T18:15:06.109405] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-30T18:15:06.240842] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:15:06.241246] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-30T18:15:06.241296] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-30T18:15:06.242285] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-30T18:15:06.242343] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-30T18:15:06.624109] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:15:06.652494] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T18:15:06.813567] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-30T18:15:06.897472] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-30T18:15:07.697475] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-30T18:15:07.870523] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T18:15:08.497558] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-30T18:15:09.020165] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T18:15:09.297570] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-30T18:15:09.879310] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-30T18:15:09.916129] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T18:15:10.097555] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-30T18:15:10.892806] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-30T18:15:10.897465] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-30T18:15:10.898561] [INFO ] [REMOTE ] DCO: Full fetch complete (19914 records). [2025-10-30T18:15:10.898667] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-30T18:15:10.899215] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:15:10.899370] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:15:10.899437] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:15:10.899509] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-30T18:15:10.899567] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-30T18:15:10.899605] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-30T18:15:10.899675] [DEBUG] [LOCAL ] DCO: No derivative data file found to delete. [2025-10-30T18:15:10.899752] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DCO took 22.9s. Estimated remaining: 3h 43m 9s. Rate: 7.9 symbols/min [2025-10-30T18:15:11.088778] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:15:11.124342] [DEBUG] [LOCAL ] DDL: Loaded 37085 existing records from primary storage. [2025-10-30T18:15:11.124680] [INFO ] [MAIN ] DDL: Loaded 37085 existing records. [2025-10-30T18:15:11.311538] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:15:11.311764] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-30T18:15:11.311814] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-30T18:15:11.312358] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-30T18:15:11.312415] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-30T18:15:11.699000] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-30T18:15:11.698893] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:15:12.212305] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-30T18:15:12.497512] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-30T18:15:12.845055] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-30T18:15:12.853290] [INFO ] [REMOTE ] DCI: Full fetch complete (53888 records). [2025-10-30T18:15:12.853409] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-30T18:15:13.232369] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-30T18:15:13.232448] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-30T18:15:13.233183] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-30T18:15:13.233245] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-30T18:15:13.234359] [DEBUG] [LOCAL ] DCI: Trimmed 53888 records to 36884 (keeping 200 days of data) [2025-10-30T18:15:13.320978] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-30T18:15:13.454953] [DEBUG] [LOCAL ] DCI: Primary data saved (36884 records). [2025-10-30T18:15:13.455101] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-30T18:15:13.455179] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DCI took 33.8s. Estimated remaining: 3h 42m 47s. Rate: 7.9 symbols/min [2025-10-30T18:15:13.673601] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T18:15:14.097506] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-30T18:15:14.901085] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-30T18:15:14.914615] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T18:15:15.076617] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T18:15:15.697505] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-30T18:15:16.489464] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T18:15:16.500170] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-30T18:15:16.895463] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T18:15:17.297470] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-30T18:15:17.492326] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T18:15:18.097509] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-30T18:15:18.686480] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-30T18:15:18.897520] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-30T18:15:19.241696] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T18:15:19.697522] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-30T18:15:20.497474] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-30T18:15:20.540977] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-30T18:15:20.702168] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T18:15:21.297497] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-30T18:15:21.832817] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T18:15:22.097520] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-30T18:15:22.576066] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T18:15:22.897498] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-30T18:15:23.018820] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T18:15:23.697519] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-30T18:15:24.205981] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:15:24.497562] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-30T18:15:25.069829] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:15:25.297528] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-30T18:15:25.843554] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T18:15:26.097537] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-30T18:15:26.844566] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-30T18:15:26.897531] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-30T18:15:27.119318] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T18:15:27.697542] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-30T18:15:28.201882] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T18:15:28.420259] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-30T18:15:28.497522] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-30T18:15:29.297521] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-30T18:15:29.390868] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-30T18:15:30.097508] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-30T18:15:30.897706] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-30T18:15:31.101697] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-30T18:15:31.114795] [INFO ] [REMOTE ] DD: Full fetch complete (76637 records). [2025-10-30T18:15:31.115055] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-30T18:15:31.545455] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T18:15:31.549256] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-30T18:15:31.549377] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-30T18:15:31.559186] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-30T18:15:31.559509] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-30T18:15:31.560321] [INFO ] [REMOTE ] DDL: Full fetch complete (54218 records). [2025-10-30T18:15:31.560488] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-30T18:15:31.605545] [DEBUG] [LOCAL ] DD: Trimmed 76637 records to 53293 (keeping 200 days of data) [2025-10-30T18:15:32.177504] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-30T18:15:32.179825] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-30T18:15:32.183469] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-30T18:15:32.183549] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-30T18:15:32.202910] [DEBUG] [LOCAL ] DDL: Trimmed 54218 records to 37475 (keeping 200 days of data) [2025-10-30T18:15:32.374893] [DEBUG] [LOCAL ] DD: Primary data saved (53293 records). [2025-10-30T18:15:32.379080] [INFO ] [MAIN ] DD: Full history saved. [2025-10-30T18:15:32.380671] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DD took 35.6s. Estimated remaining: 3h 43m 13s. Rate: 7.9 symbols/min [2025-10-30T18:15:32.508576] [DEBUG] [LOCAL ] DDL: Primary data saved (37475 records). [2025-10-30T18:15:32.508763] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-30T18:15:32.508846] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DDL took 21.6s. Estimated remaining: 3h 42m 43s. Rate: 7.9 symbols/min [2025-10-30T18:15:32.510408] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-30T18:15:32.521199] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-30T18:15:33.979123] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T18:15:33.991815] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-30T18:15:35.844138] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-30T18:15:35.855706] [INFO ] [REMOTE ] DDD: Full fetch complete (74049 records). [2025-10-30T18:15:35.855840] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-30T18:15:36.251188] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-30T18:15:36.251275] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-30T18:15:36.252164] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-30T18:15:36.252228] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-30T18:15:36.253675] [DEBUG] [LOCAL ] DDD: Trimmed 74049 records to 51304 (keeping 200 days of data) [2025-10-30T18:15:36.547130] [DEBUG] [LOCAL ] DDD: Primary data saved (51304 records). [2025-10-30T18:15:36.547266] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-30T18:15:36.547890] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDD took 30.7s. Estimated remaining: 3h 42m 25s. Rate: 7.9 symbols/min [2025-10-30T18:15:37.252077] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:15:37.241352] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:15:37.243266] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:15:37.303354] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:15:37.301079] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-30T18:15:37.304102] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-30T18:15:37.304297] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-30T18:15:37.304350] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-30T18:15:37.304392] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-30T18:15:37.304424] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-30T18:15:37.303490] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-30T18:15:37.309921] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-30T18:15:37.335135] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-30T18:15:37.345679] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-30T18:15:37.368713] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-30T18:15:37.368880] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-30T18:15:37.675901] [DEBUG] [LOCAL ] DEA: Loaded 39608 existing records from primary storage. [2025-10-30T18:15:37.710785] [INFO ] [MAIN ] DEA: Loaded 39608 existing records. [2025-10-30T18:15:37.841588] [DEBUG] [LOCAL ] DE: Loaded 47308 existing records from primary storage. [2025-10-30T18:15:37.848626] [INFO ] [MAIN ] DE: Loaded 47308 existing records. [2025-10-30T18:15:38.125158] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:15:38.201174] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-30T18:15:38.420979] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:15:38.441117] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-30T18:15:38.441222] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-30T18:15:38.424857] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:15:38.505833] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-30T18:15:38.505613] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-30T18:15:38.506117] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-30T18:15:38.506204] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-30T18:15:38.505531] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:15:38.542771] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-30T18:15:38.600160] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-30T18:15:38.617195] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-30T18:15:38.804043] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-30T18:15:38.871756] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-30T18:15:39.253639] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:15:39.306120] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-30T18:15:39.322117] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T18:15:39.341403] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-30T18:15:39.348283] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:15:39.349856] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-30T18:15:39.359681] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T18:15:39.362745] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-30T18:15:39.696595] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-30T18:15:39.698011] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-30T18:15:40.034890] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-30T18:15:40.036410] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-30T18:15:40.098750] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T18:15:40.273920] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-30T18:15:40.497479] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-30T18:15:40.598531] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T18:15:40.886582] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-30T18:15:41.205473] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-30T18:15:41.297550] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-30T18:15:42.097559] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-30T18:15:42.458831] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T18:15:42.897571] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-30T18:15:43.216809] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-30T18:15:43.496529] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-30T18:15:43.697511] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-30T18:15:44.059455] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-30T18:15:44.497502] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-30T18:15:45.173836] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T18:15:45.297567] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-30T18:15:45.924928] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-30T18:15:46.097514] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-30T18:15:46.897511] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-30T18:15:47.181623] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-30T18:15:47.444488] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T18:15:47.697491] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-30T18:15:48.497530] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-30T18:15:48.891929] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T18:15:49.172002] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:15:49.297508] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-30T18:15:49.744865] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-30T18:15:49.745788] [INFO ] [REMOTE ] DDT: Full fetch complete (2802 records). [2025-10-30T18:15:49.745857] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-30T18:15:49.746201] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:15:49.746305] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:15:49.746399] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:15:49.746475] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-30T18:15:49.746549] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-30T18:15:49.746586] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-30T18:15:49.746626] [DEBUG] [LOCAL ] DDT: No derivative data file found to delete. [2025-10-30T18:15:49.746724] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 13.2s. Estimated remaining: 3h 42m 34s. Rate: 7.9 symbols/min [2025-10-30T18:15:49.913200] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:15:49.913378] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-30T18:15:49.913414] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-30T18:15:49.913519] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-30T18:15:49.913559] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-30T18:15:49.913600] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-30T18:15:49.913632] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-30T18:15:50.103798] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-30T18:15:50.289674] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:15:50.897499] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-30T18:15:51.571088] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T18:15:51.697476] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-30T18:15:51.738496] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T18:15:52.497479] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-30T18:15:52.546981] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T18:15:53.297553] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-30T18:15:53.576051] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T18:15:53.890442] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T18:15:54.097544] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-30T18:15:54.897469] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-30T18:15:55.085865] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-30T18:15:55.499757] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T18:15:55.697549] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-30T18:15:56.497523] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-30T18:15:56.650869] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T18:15:57.297548] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-30T18:15:57.649048] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T18:15:58.097522] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-30T18:15:58.845216] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-30T18:15:58.897479] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-30T18:15:58.933548] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T18:15:59.697480] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-30T18:15:59.947638] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T18:16:00.275627] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-30T18:16:00.497541] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-30T18:16:01.297499] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-30T18:16:01.670319] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T18:16:02.097548] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-30T18:16:02.507817] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T18:16:02.897509] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-30T18:16:03.361518] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T18:16:03.697511] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-30T18:16:04.225067] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T18:16:04.233937] [INFO ] [REMOTE ] DEA: Full fetch complete (61107 records). [2025-10-30T18:16:04.234106] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-30T18:16:04.234894] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:16:04.234990] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:16:04.235032] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:16:04.235104] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-30T18:16:04.235175] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-30T18:16:04.235212] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-30T18:16:04.235422] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-30T18:16:04.235513] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DEA took 27.7s. Estimated remaining: 3h 42m 47s. Rate: 7.9 symbols/min [2025-10-30T18:16:04.412318] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:16:04.461149] [DEBUG] [LOCAL ] DECK: Loaded 53303 existing records from primary storage. [2025-10-30T18:16:04.461508] [INFO ] [MAIN ] DECK: Loaded 53303 existing records. [2025-10-30T18:16:04.505508] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-30T18:16:04.652784] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:16:04.653009] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-30T18:16:04.653059] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-30T18:16:04.654032] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-30T18:16:04.654091] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-30T18:16:05.036471] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:16:05.038105] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T18:16:05.297470] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-30T18:16:05.318939] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T18:16:05.321367] [INFO ] [REMOTE ] DDS: Full fetch complete (18090 records). [2025-10-30T18:16:05.321478] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-30T18:16:05.694898] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-30T18:16:05.694989] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-30T18:16:05.695462] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-30T18:16:05.695520] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-30T18:16:05.696105] [DEBUG] [LOCAL ] DDS: Trimmed 18090 records to 11868 (keeping 200 days of data) [2025-10-30T18:16:05.770988] [DEBUG] [LOCAL ] DDS: Primary data saved (11868 records). [2025-10-30T18:16:05.771118] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-30T18:16:05.771188] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DDS took 29.2s. Estimated remaining: 3h 42m 22s. Rate: 7.9 symbols/min [2025-10-30T18:16:05.943067] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:16:05.985724] [DEBUG] [LOCAL ] DEI: Loaded 48138 existing records from primary storage. [2025-10-30T18:16:05.986128] [INFO ] [MAIN ] DEI: Loaded 48138 existing records. [2025-10-30T18:16:06.105460] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-30T18:16:06.194366] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:16:06.194706] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-30T18:16:06.194945] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-30T18:16:06.205201] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-30T18:16:06.221498] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-30T18:16:06.290797] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-30T18:16:06.636166] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:16:06.897472] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-30T18:16:07.697475] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-30T18:16:07.749136] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-30T18:16:07.792318] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T18:16:08.497622] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-30T18:16:09.230572] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T18:16:09.297562] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-30T18:16:10.040086] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-30T18:16:10.084187] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T18:16:10.097454] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-30T18:16:10.897755] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-30T18:16:11.180712] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T18:16:11.697578] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-30T18:16:12.456608] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-30T18:16:12.497469] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-30T18:16:13.194083] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T18:16:13.297529] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-30T18:16:13.916117] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T18:16:14.097553] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-30T18:16:14.398768] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T18:16:14.410056] [INFO ] [REMOTE ] DEC: Full fetch complete (44826 records). [2025-10-30T18:16:14.410285] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-30T18:16:14.829458] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-30T18:16:14.829594] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-30T18:16:14.830419] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-30T18:16:14.830485] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-30T18:16:14.831782] [DEBUG] [LOCAL ] DEC: Trimmed 44826 records to 30013 (keeping 200 days of data) [2025-10-30T18:16:14.903166] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-30T18:16:15.041912] [DEBUG] [LOCAL ] DEC: Primary data saved (30013 records). [2025-10-30T18:16:15.042059] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-30T18:16:15.042141] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DEC took 25.3s. Estimated remaining: 3h 42m 19s. Rate: 7.9 symbols/min [2025-10-30T18:16:15.209066] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:16:15.258146] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-30T18:16:15.258471] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-30T18:16:15.434868] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:16:15.435220] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-30T18:16:15.435277] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-30T18:16:15.436408] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-30T18:16:15.436465] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-30T18:16:15.698691] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-30T18:16:15.804988] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:16:15.835089] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-30T18:16:15.937590] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T18:16:16.497543] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-30T18:16:17.089107] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T18:16:17.297472] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-30T18:16:17.715461] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:16:18.097490] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-30T18:16:18.852886] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T18:16:18.897458] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-30T18:16:19.500467] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T18:16:19.697489] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-30T18:16:20.337973] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T18:16:20.497518] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-30T18:16:21.297540] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-30T18:16:21.611378] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-30T18:16:22.083027] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-30T18:16:22.097468] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-30T18:16:22.837990] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-30T18:16:22.849033] [INFO ] [REMOTE ] DE: Full fetch complete (69829 records). [2025-10-30T18:16:22.849214] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-30T18:16:22.904846] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-30T18:16:23.248614] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-30T18:16:23.248748] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-30T18:16:23.249575] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-30T18:16:23.249621] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-30T18:16:23.250995] [DEBUG] [LOCAL ] DE: Trimmed 69829 records to 47646 (keeping 200 days of data) [2025-10-30T18:16:23.579679] [DEBUG] [LOCAL ] DE: Primary data saved (47646 records). [2025-10-30T18:16:23.579947] [INFO ] [MAIN ] DE: Full history saved. [2025-10-30T18:16:23.580803] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DE took 47.0s. Estimated remaining: 3h 42m 14s. Rate: 7.9 symbols/min [2025-10-30T18:16:23.706352] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-30T18:16:23.758868] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:16:23.794102] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-30T18:16:23.846877] [DEBUG] [LOCAL ] DEO: Loaded 49144 existing records from primary storage. [2025-10-30T18:16:23.847173] [INFO ] [MAIN ] DEO: Loaded 49144 existing records. [2025-10-30T18:16:24.027751] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:16:24.028029] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-30T18:16:24.028110] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-30T18:16:24.029097] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-30T18:16:24.029158] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-30T18:16:24.441281] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T18:16:24.439116] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:16:24.497523] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-30T18:16:25.297466] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-30T18:16:25.467441] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-30T18:16:26.108678] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-30T18:16:26.115349] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-30T18:16:26.477710] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T18:16:26.897495] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-30T18:16:27.697537] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-30T18:16:27.827224] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-30T18:16:28.199892] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:16:28.497510] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-30T18:16:29.297505] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-30T18:16:29.518468] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-30T18:16:29.558010] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T18:16:30.097498] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-30T18:16:30.897490] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-30T18:16:31.334352] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-30T18:16:31.346293] [INFO ] [REMOTE ] DECK: Full fetch complete (77285 records). [2025-10-30T18:16:31.346447] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-30T18:16:31.704111] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-30T18:16:31.755282] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-30T18:16:31.756370] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-30T18:16:31.757374] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-30T18:16:31.757473] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-30T18:16:31.759715] [DEBUG] [LOCAL ] DECK: Trimmed 77285 records to 53693 (keeping 200 days of data) [2025-10-30T18:16:31.902802] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-30T18:16:32.132923] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T18:16:32.166930] [DEBUG] [LOCAL ] DECK: Primary data saved (53693 records). [2025-10-30T18:16:32.167219] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-30T18:16:32.167810] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DECK took 27.9s. Estimated remaining: 3h 42m 10s. Rate: 7.9 symbols/min [2025-10-30T18:16:32.333272] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:16:32.363346] [DEBUG] [LOCAL ] DFH: Loaded 30988 existing records from primary storage. [2025-10-30T18:16:32.363591] [INFO ] [MAIN ] DFH: Loaded 30988 existing records. [2025-10-30T18:16:32.502625] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-30T18:16:32.540267] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:16:32.540470] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-30T18:16:32.540517] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-30T18:16:32.541057] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-30T18:16:32.541114] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-30T18:16:32.888118] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:16:33.297515] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-30T18:16:33.610110] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-30T18:16:34.003638] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-30T18:16:34.097497] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-30T18:16:34.534958] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T18:16:34.897490] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-30T18:16:35.384735] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T18:16:35.697484] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-30T18:16:36.175765] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:16:36.497507] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-30T18:16:37.297469] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-30T18:16:37.474424] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T18:16:37.536906] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-30T18:16:38.097505] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-30T18:16:38.505685] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T18:16:38.897511] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-30T18:16:39.594433] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T18:16:39.697484] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-30T18:16:40.420869] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T18:16:40.431726] [INFO ] [REMOTE ] DEI: Full fetch complete (69891 records). [2025-10-30T18:16:40.431894] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-30T18:16:40.503013] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-30T18:16:40.827772] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-30T18:16:40.827861] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-30T18:16:40.828623] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-30T18:16:40.828697] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-30T18:16:40.830060] [DEBUG] [LOCAL ] DEI: Trimmed 69891 records to 48507 (keeping 200 days of data) [2025-10-30T18:16:41.092817] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T18:16:41.187610] [DEBUG] [LOCAL ] DEI: Primary data saved (48507 records). [2025-10-30T18:16:41.187775] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-30T18:16:41.187860] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DEI took 35.4s. Estimated remaining: 3h 42m 6s. Rate: 7.9 symbols/min [2025-10-30T18:16:41.302615] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-30T18:16:41.361124] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:16:41.381182] [DEBUG] [LOCAL ] DFIN: Loaded 22019 existing records from primary storage. [2025-10-30T18:16:41.381418] [INFO ] [MAIN ] DFIN: Loaded 22019 existing records. [2025-10-30T18:16:41.567455] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:16:41.567610] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-30T18:16:41.567687] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-30T18:16:41.568107] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-30T18:16:41.568165] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-30T18:16:41.945467] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:16:42.097464] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-30T18:16:42.172345] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-30T18:16:42.790494] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T18:16:42.888759] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T18:16:42.897454] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-30T18:16:43.602187] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T18:16:43.697484] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-30T18:16:44.497471] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-30T18:16:44.625147] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T18:16:45.297534] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-30T18:16:45.355317] [DEBUG] [REMOTE ] DEO: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-30T18:16:45.355685] [WARN ] [REMOTE ] DEO: No data returned for month 2025-09 [2025-10-30T18:16:45.355795] [FATAL] [REMOTE ] DEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:16:45.355915] [FATAL] [MAIN ] DEO: Failed to fetch primary data. [2025-10-30T18:16:45.355993] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:16:45.356079] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-30T18:16:45.356159] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-30T18:16:45.356211] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-30T18:16:45.356427] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-10-30T18:16:45.357018] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DEO took 21.8s. Estimated remaining: 3h 41m 49s. Rate: 7.9 symbols/min [2025-10-30T18:16:45.540133] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:16:45.551547] [DEBUG] [LOCAL ] DFP: Loaded 10707 existing records from primary storage. [2025-10-30T18:16:45.551834] [INFO ] [MAIN ] DFP: Loaded 10707 existing records. [2025-10-30T18:16:45.732458] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:16:45.732985] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-30T18:16:45.733054] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-30T18:16:45.733448] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-30T18:16:45.733514] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-30T18:16:45.847983] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T18:16:46.098477] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-30T18:16:46.120156] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:16:46.897497] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-30T18:16:47.697478] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-30T18:16:47.870921] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T18:16:48.191951] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-30T18:16:48.214214] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-30T18:16:48.497508] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-30T18:16:49.024387] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-30T18:16:49.297502] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-30T18:16:50.097544] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-30T18:16:50.897497] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-30T18:16:50.984226] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-30T18:16:51.082756] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T18:16:51.633781] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-30T18:16:51.697480] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-30T18:16:52.504013] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-30T18:16:52.505957] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T18:16:53.297470] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-30T18:16:53.350114] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T18:16:54.097494] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-30T18:16:54.897694] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-30T18:16:54.949013] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-30T18:16:55.049789] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T18:16:55.450152] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-30T18:16:55.697478] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-30T18:16:56.228293] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T18:16:56.497543] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-30T18:16:56.981825] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T18:16:57.297503] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-30T18:16:58.054590] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T18:16:58.097498] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-30T18:16:58.867825] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-30T18:16:58.897464] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-30T18:16:59.618596] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T18:16:59.697473] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-30T18:17:00.497511] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-30T18:17:00.897346] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T18:17:01.297500] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-30T18:17:02.097557] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-30T18:17:02.660073] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-30T18:17:02.675809] [INFO ] [REMOTE ] DELL: Full fetch complete (77914 records). [2025-10-30T18:17:02.675995] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-30T18:17:02.908470] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-30T18:17:03.128305] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-30T18:17:03.158909] [INFO ] [REMOTE ] DFIN: Full fetch complete (33865 records). [2025-10-30T18:17:03.159345] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-30T18:17:03.159112] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-30T18:17:03.159700] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-30T18:17:03.183834] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-30T18:17:03.208449] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-30T18:17:03.288620] [DEBUG] [LOCAL ] DELL: Trimmed 77914 records to 54125 (keeping 200 days of data) [2025-10-30T18:17:03.338590] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T18:17:03.657910] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T18:17:03.699712] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-30T18:17:03.899584] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-30T18:17:03.899799] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-30T18:17:03.900690] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-30T18:17:03.900762] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-30T18:17:03.901927] [DEBUG] [LOCAL ] DFIN: Trimmed 33865 records to 22316 (keeping 200 days of data) [2025-10-30T18:17:04.194193] [DEBUG] [LOCAL ] DFIN: Primary data saved (22316 records). [2025-10-30T18:17:04.209811] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-30T18:17:04.270875] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFIN took 23.1s. Estimated remaining: 3h 42m 14s. Rate: 7.9 symbols/min [2025-10-30T18:17:04.498824] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-30T18:17:04.538862] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:04.553293] [DEBUG] [LOCAL ] DELL: Primary data saved (54125 records). [2025-10-30T18:17:04.554501] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-30T18:17:04.555613] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DELL took 49.5s. Estimated remaining: 3h 41m 46s. Rate: 7.9 symbols/min [2025-10-30T18:17:04.755598] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:04.785635] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-30T18:17:04.787101] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T18:17:04.786239] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-30T18:17:04.793344] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-30T18:17:04.793517] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-30T18:17:04.793591] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-30T18:17:04.793630] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-30T18:17:04.910618] [DEBUG] [LOCAL ] DG: Loaded 53186 existing records from primary storage. [2025-10-30T18:17:04.926511] [INFO ] [MAIN ] DG: Loaded 53186 existing records. [2025-10-30T18:17:05.302984] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-30T18:17:05.297702] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:17:05.293389] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-30T18:17:05.325988] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-30T18:17:05.355417] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-30T18:17:05.358973] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:05.360625] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-30T18:17:05.360708] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-30T18:17:05.720161] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:06.097539] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-30T18:17:06.425789] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-30T18:17:06.432990] [INFO ] [REMOTE ] DFH: Full fetch complete (46950 records). [2025-10-30T18:17:06.433166] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-30T18:17:06.856571] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-30T18:17:06.856723] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-30T18:17:06.857612] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-30T18:17:06.857688] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-30T18:17:06.859247] [DEBUG] [LOCAL ] DFH: Trimmed 46950 records to 31250 (keeping 200 days of data) [2025-10-30T18:17:06.913118] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-30T18:17:07.074133] [DEBUG] [LOCAL ] DFH: Primary data saved (31250 records). [2025-10-30T18:17:07.074353] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-30T18:17:07.075125] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DFH took 34.9s. Estimated remaining: 3h 41m 23s. Rate: 7.9 symbols/min [2025-10-30T18:17:07.286945] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:07.287332] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-30T18:17:07.287412] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-30T18:17:07.287717] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-30T18:17:07.287823] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-30T18:17:07.287922] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-30T18:17:07.288170] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-30T18:17:07.665836] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-30T18:17:07.702610] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-30T18:17:07.788806] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:08.319686] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T18:17:08.497460] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-30T18:17:08.904067] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T18:17:09.297540] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-30T18:17:09.775344] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T18:17:09.863731] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T18:17:10.097504] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-30T18:17:10.892090] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T18:17:10.897447] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-30T18:17:11.592942] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T18:17:11.697492] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-30T18:17:12.250057] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T18:17:12.497505] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-30T18:17:13.200316] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T18:17:13.297537] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-30T18:17:14.097494] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-30T18:17:14.653442] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T18:17:14.752345] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T18:17:14.754605] [INFO ] [REMOTE ] DFP: Full fetch complete (15807 records). [2025-10-30T18:17:14.754718] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-30T18:17:14.755146] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:17:14.755227] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:17:14.755269] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:17:14.755308] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-30T18:17:14.755361] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-30T18:17:14.755396] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-10-30T18:17:14.755546] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-10-30T18:17:14.755612] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DFP took 29.4s. Estimated remaining: 3h 41m 16s. Rate: 7.9 symbols/min [2025-10-30T18:17:14.907498] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-30T18:17:14.938824] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:14.939209] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-30T18:17:14.939312] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-30T18:17:14.939436] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-30T18:17:14.939485] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-30T18:17:14.939528] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-30T18:17:14.939561] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-30T18:17:15.295896] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:15.697482] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-30T18:17:16.437245] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T18:17:16.497499] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-30T18:17:17.034636] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:17:17.297506] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-30T18:17:18.102583] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-30T18:17:18.118977] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-30T18:17:18.224880] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T18:17:18.897500] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-30T18:17:19.505101] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T18:17:19.697496] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-30T18:17:20.474186] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T18:17:20.497485] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-30T18:17:21.127201] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T18:17:21.297506] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-30T18:17:21.990610] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-30T18:17:22.012248] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-30T18:17:22.097451] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-30T18:17:22.772065] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T18:17:22.897599] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-30T18:17:23.697491] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-30T18:17:24.427838] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T18:17:24.497450] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-30T18:17:24.514959] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T18:17:25.297488] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-30T18:17:25.778099] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T18:17:26.097521] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-30T18:17:26.697232] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:17:26.897460] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-30T18:17:26.940692] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T18:17:27.697474] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-30T18:17:27.712874] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-30T18:17:28.497494] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-30T18:17:29.096312] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:17:29.297501] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-30T18:17:29.622499] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T18:17:30.060694] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-30T18:17:30.097459] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-30T18:17:30.897504] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-30T18:17:31.229843] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T18:17:31.233934] [INFO ] [REMOTE ] DHF: Full fetch complete (29941 records). [2025-10-30T18:17:31.234009] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-30T18:17:31.624667] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-30T18:17:31.624793] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-30T18:17:31.625276] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-30T18:17:31.625317] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-30T18:17:31.626006] [DEBUG] [LOCAL ] DHF: Trimmed 29941 records to 20408 (keeping 200 days of data) [2025-10-30T18:17:31.707096] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-30T18:17:31.743465] [DEBUG] [LOCAL ] DHF: Primary data saved (20408 records). [2025-10-30T18:17:31.743583] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-30T18:17:31.743671] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DHF took 24.7s. Estimated remaining: 3h 41m 36s. Rate: 7.9 symbols/min [2025-10-30T18:17:31.920964] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:31.974506] [DEBUG] [LOCAL ] DHR: Loaded 53363 existing records from primary storage. [2025-10-30T18:17:31.974834] [INFO ] [MAIN ] DHR: Loaded 53363 existing records. [2025-10-30T18:17:32.166259] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:17:32.166807] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-30T18:17:32.166889] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-30T18:17:32.167366] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-30T18:17:32.167614] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-30T18:17:32.489975] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-30T18:17:32.500879] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-30T18:17:32.607136] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:33.251820] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-30T18:17:33.297460] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-30T18:17:34.097494] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-30T18:17:34.138822] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-30T18:17:34.808906] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T18:17:34.823191] [INFO ] [REMOTE ] DG: Full fetch complete (77243 records). [2025-10-30T18:17:34.823364] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-30T18:17:34.902615] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-30T18:17:35.310602] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-30T18:17:35.310784] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-30T18:17:35.311869] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-30T18:17:35.312032] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-30T18:17:35.313800] [DEBUG] [LOCAL ] DG: Trimmed 77243 records to 53549 (keeping 200 days of data) [2025-10-30T18:17:35.595203] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-30T18:17:35.710555] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-30T18:17:35.741311] [DEBUG] [LOCAL ] DG: Primary data saved (53549 records). [2025-10-30T18:17:35.741457] [INFO ] [MAIN ] DG: Full history saved. [2025-10-30T18:17:35.742393] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DG took 31.5s. Estimated remaining: 3h 41m 18s. Rate: 7.9 symbols/min [2025-10-30T18:17:35.927689] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:35.927876] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-30T18:17:35.927913] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-30T18:17:35.928044] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-30T18:17:35.928085] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-30T18:17:35.928125] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-30T18:17:35.928156] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-30T18:17:36.278782] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:36.497505] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-30T18:17:36.555925] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-30T18:17:37.129197] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T18:17:37.138737] [INFO ] [REMOTE ] DGX: Full fetch complete (65462 records). [2025-10-30T18:17:37.138881] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-30T18:17:37.139590] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:17:37.139711] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:17:37.139754] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:17:37.139798] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-30T18:17:37.139880] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-30T18:17:37.139915] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-30T18:17:37.139954] [DEBUG] [LOCAL ] DGX: No derivative data file found to delete. [2025-10-30T18:17:37.140015] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DGX took 32.6s. Estimated remaining: 3h 40m 53s. Rate: 7.9 symbols/min [2025-10-30T18:17:37.303591] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-30T18:17:37.307295] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:37.321174] [DEBUG] [LOCAL ] DHX: Loaded 12981 existing records from primary storage. [2025-10-30T18:17:37.321393] [INFO ] [MAIN ] DHX: Loaded 12981 existing records. [2025-10-30T18:17:37.504618] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:17:37.504842] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-30T18:17:37.504890] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-30T18:17:37.505103] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-30T18:17:37.505157] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-30T18:17:37.864602] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:37.919566] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T18:17:38.097500] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-30T18:17:38.897503] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-30T18:17:38.944135] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-30T18:17:39.494680] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T18:17:39.697478] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-30T18:17:39.774903] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T18:17:40.497503] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-30T18:17:41.068254] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T18:17:41.140814] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-30T18:17:41.297494] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-30T18:17:41.903778] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-30T18:17:42.097521] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-30T18:17:42.897500] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-30T18:17:43.327887] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T18:17:43.636896] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-30T18:17:43.697492] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-30T18:17:44.497549] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-30T18:17:45.297492] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-30T18:17:45.331996] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-30T18:17:45.836445] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T18:17:46.097503] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-30T18:17:46.759218] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T18:17:46.897526] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-30T18:17:47.707242] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-30T18:17:47.727747] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-30T18:17:48.086456] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T18:17:48.291830] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T18:17:48.497517] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-30T18:17:49.297553] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-30T18:17:49.875879] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T18:17:50.097546] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-30T18:17:50.451298] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T18:17:50.897515] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-30T18:17:50.996096] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T18:17:51.697592] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-30T18:17:52.510797] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-30T18:17:52.546281] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-30T18:17:52.921491] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:17:53.297534] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-30T18:17:53.860054] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T18:17:54.046481] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T18:17:54.097463] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-30T18:17:54.897545] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-30T18:17:55.448733] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T18:17:55.496140] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T18:17:55.697518] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-30T18:17:56.497504] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-30T18:17:57.297465] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-30T18:17:57.509148] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-30T18:17:57.520775] [INFO ] [REMOTE ] DHI: Full fetch complete (77400 records). [2025-10-30T18:17:57.520950] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-30T18:17:57.913034] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-30T18:17:57.913323] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-30T18:17:57.914245] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-30T18:17:57.914309] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-30T18:17:57.915721] [DEBUG] [LOCAL ] DHI: Trimmed 77400 records to 53730 (keeping 200 days of data) [2025-10-30T18:17:58.015857] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T18:17:58.068769] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T18:17:58.097466] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-30T18:17:58.301048] [DEBUG] [LOCAL ] DHI: Primary data saved (53730 records). [2025-10-30T18:17:58.301176] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-30T18:17:58.301255] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DHI took 43.5s. Estimated remaining: 3h 41m 24s. Rate: 7.9 symbols/min [2025-10-30T18:17:58.474192] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:17:58.486427] [DEBUG] [LOCAL ] DIAX: Loaded 12157 existing records from primary storage. [2025-10-30T18:17:58.486638] [INFO ] [MAIN ] DIAX: Loaded 12157 existing records. [2025-10-30T18:17:58.660170] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:17:58.660411] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-30T18:17:58.660460] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-30T18:17:58.660885] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-30T18:17:58.660944] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-30T18:17:58.902838] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-30T18:17:59.020945] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:17:59.535121] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T18:17:59.697497] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-30T18:17:59.743519] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:17:59.749066] [INFO ] [REMOTE ] DHX: Full fetch complete (21452 records). [2025-10-30T18:17:59.749285] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-30T18:18:00.181138] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-30T18:18:00.181253] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-30T18:18:00.181918] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-30T18:18:00.181990] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-30T18:18:00.183073] [DEBUG] [LOCAL ] DHX: Trimmed 21452 records to 13078 (keeping 200 days of data) [2025-10-30T18:18:00.261024] [DEBUG] [LOCAL ] DHX: Primary data saved (13078 records). [2025-10-30T18:18:00.261224] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-30T18:18:00.261329] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DHX took 23.1s. Estimated remaining: 3h 41m 0s. Rate: 7.9 symbols/min [2025-10-30T18:18:00.444693] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:00.444970] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-10-30T18:18:00.445013] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-10-30T18:18:00.445143] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-30T18:18:00.445186] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-30T18:18:00.445256] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-30T18:18:00.445292] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-30T18:18:00.510352] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-30T18:18:00.882120] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:18:01.297504] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-30T18:18:01.573828] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T18:18:01.710334] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-30T18:18:02.097499] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-30T18:18:02.476583] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T18:18:02.897470] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-30T18:18:03.673476] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-30T18:18:03.697456] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-30T18:18:04.289575] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-30T18:18:04.497511] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-30T18:18:05.297530] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-30T18:18:05.843294] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-30T18:18:05.891023] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T18:18:06.097508] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-30T18:18:06.673228] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-30T18:18:06.897490] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-30T18:18:07.457607] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-30T18:18:07.697518] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-30T18:18:08.246161] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-30T18:18:08.247995] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (4.55 seconds). [2025-10-30T18:18:08.262480] [INFO ] [REMOTE ] DHR: Full fetch complete (77440 records). [2025-10-30T18:18:08.262617] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-30T18:18:08.507676] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-30T18:18:08.656498] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-30T18:18:08.656586] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-30T18:18:08.657457] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-30T18:18:08.657524] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-30T18:18:08.659049] [DEBUG] [LOCAL ] DHR: Trimmed 77440 records to 53753 (keeping 200 days of data) [2025-10-30T18:18:08.988007] [DEBUG] [LOCAL ] DHR: Primary data saved (53753 records). [2025-10-30T18:18:08.988138] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-30T18:18:08.988851] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHR took 37.2s. Estimated remaining: 3h 40m 56s. Rate: 7.9 symbols/min [2025-10-30T18:18:09.156609] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:09.203978] [DEBUG] [LOCAL ] DINO: Loaded 52750 existing records from primary storage. [2025-10-30T18:18:09.204273] [INFO ] [MAIN ] DINO: Loaded 52750 existing records. [2025-10-30T18:18:09.303617] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-30T18:18:09.400986] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:18:09.401265] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-30T18:18:09.401315] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-30T18:18:09.402234] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-30T18:18:09.402293] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-30T18:18:09.865406] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:18:09.904572] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T18:18:10.097464] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-30T18:18:10.255492] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-30T18:18:10.266489] [INFO ] [REMOTE ] DHT: Full fetch complete (70339 records). [2025-10-30T18:18:10.266627] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-30T18:18:10.686138] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-30T18:18:10.686260] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-30T18:18:10.687409] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-30T18:18:10.687474] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-30T18:18:10.689075] [DEBUG] [LOCAL ] DHT: Trimmed 70339 records to 48135 (keeping 200 days of data) [2025-10-30T18:18:10.794443] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-30T18:18:10.904879] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-30T18:18:11.030361] [DEBUG] [LOCAL ] DHT: Primary data saved (48135 records). [2025-10-30T18:18:11.030509] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-30T18:18:11.030605] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DHT took 35.3s. Estimated remaining: 3h 40m 32s. Rate: 7.9 symbols/min [2025-10-30T18:18:11.199459] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:11.249943] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-30T18:18:11.250287] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-30T18:18:11.422763] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:18:11.422954] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-30T18:18:11.423000] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-30T18:18:11.424000] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-30T18:18:11.424057] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-30T18:18:11.702751] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-30T18:18:11.792908] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:18:12.003424] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T18:18:12.497595] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-30T18:18:13.255716] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-30T18:18:13.297453] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-30T18:18:13.341370] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-30T18:18:13.905553] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T18:18:14.097532] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-30T18:18:14.897494] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-30T18:18:15.445896] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T18:18:15.575545] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T18:18:15.578625] [INFO ] [REMOTE ] DIAX: Full fetch complete (17667 records). [2025-10-30T18:18:15.578725] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-30T18:18:15.702623] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-30T18:18:15.969725] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-30T18:18:15.969834] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-30T18:18:15.970279] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-30T18:18:15.970341] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-30T18:18:15.970898] [DEBUG] [LOCAL ] DIAX: Trimmed 17667 records to 12201 (keeping 200 days of data) [2025-10-30T18:18:16.046821] [DEBUG] [LOCAL ] DIAX: Primary data saved (12201 records). [2025-10-30T18:18:16.046947] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-30T18:18:16.047045] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DIAX took 17.7s. Estimated remaining: 3h 40m 18s. Rate: 7.9 symbols/min [2025-10-30T18:18:16.228103] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:16.228295] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-30T18:18:16.228355] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-30T18:18:16.228475] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-30T18:18:16.228517] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-30T18:18:16.228561] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-30T18:18:16.228595] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-30T18:18:16.502639] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-30T18:18:16.604165] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:18:16.930541] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:18:17.297503] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-30T18:18:17.878374] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T18:18:18.097482] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-30T18:18:18.355445] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-30T18:18:18.453238] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-30T18:18:18.897495] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-30T18:18:19.155259] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-30T18:18:19.697512] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-30T18:18:20.030073] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T18:18:20.497502] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-30T18:18:20.784631] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-30T18:18:21.297487] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-30T18:18:21.551332] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-30T18:18:22.097496] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-30T18:18:22.897506] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-30T18:18:23.352164] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T18:18:23.697460] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-30T18:18:23.882165] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-30T18:18:23.924474] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-30T18:18:24.497539] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-30T18:18:24.807625] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-30T18:18:25.297527] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-30T18:18:26.097594] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-30T18:18:26.693441] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T18:18:26.897500] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-30T18:18:27.697526] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-30T18:18:28.050273] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-30T18:18:28.208135] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:18:28.497536] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-30T18:18:28.681500] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T18:18:29.297566] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-30T18:18:29.706469] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T18:18:30.097477] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-30T18:18:30.897527] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-30T18:18:31.003151] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-30T18:18:31.199479] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T18:18:31.310573] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T18:18:31.697492] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-30T18:18:31.928325] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-30T18:18:32.497524] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-30T18:18:33.297503] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-30T18:18:33.649848] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-30T18:18:33.650581] [INFO ] [REMOTE ] DIVY: Full fetch complete (1646 records). [2025-10-30T18:18:33.650669] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-30T18:18:33.651017] [FATAL] [VALIDATOR ] DIVY: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:18:33.651094] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:18:33.651137] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:18:33.651175] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-30T18:18:33.651228] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-30T18:18:33.651262] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-30T18:18:33.651301] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-30T18:18:33.651350] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DIVY took 17.6s. Estimated remaining: 3h 40m 38s. Rate: 7.9 symbols/min [2025-10-30T18:18:33.818756] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:33.863382] [DEBUG] [LOCAL ] DK: Loaded 49050 existing records from primary storage. [2025-10-30T18:18:33.863753] [INFO ] [MAIN ] DK: Loaded 49050 existing records. [2025-10-30T18:18:34.052922] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:18:34.053419] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-30T18:18:34.053615] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-30T18:18:34.054374] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-30T18:18:34.054476] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-30T18:18:34.097767] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-30T18:18:34.473159] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-30T18:18:34.492680] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:18:34.897515] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-30T18:18:35.274388] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T18:18:35.697568] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-30T18:18:36.180018] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:18:36.497496] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-30T18:18:36.786297] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T18:18:37.297547] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-30T18:18:37.664871] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T18:18:38.097524] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-30T18:18:38.383995] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T18:18:38.391846] [INFO ] [REMOTE ] DIN: Full fetch complete (54235 records). [2025-10-30T18:18:38.391958] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-30T18:18:38.767662] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-30T18:18:38.767764] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-30T18:18:38.768439] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-30T18:18:38.768481] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-30T18:18:38.769698] [DEBUG] [LOCAL ] DIN: Trimmed 54235 records to 36457 (keeping 200 days of data) [2025-10-30T18:18:38.932674] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-30T18:18:38.991279] [DEBUG] [LOCAL ] DIN: Primary data saved (36457 records). [2025-10-30T18:18:38.991535] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-30T18:18:38.991622] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DIN took 38.7s. Estimated remaining: 3h 40m 24s. Rate: 7.9 symbols/min [2025-10-30T18:18:39.197015] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:39.212915] [DEBUG] [LOCAL ] DKL: Loaded 15808 existing records from primary storage. [2025-10-30T18:18:39.213215] [INFO ] [MAIN ] DKL: Loaded 15808 existing records. [2025-10-30T18:18:39.430410] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:18:39.430826] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-30T18:18:39.430884] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-30T18:18:39.431148] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-30T18:18:39.431207] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-30T18:18:39.710257] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-30T18:18:39.828563] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:18:39.860344] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-30T18:18:40.058680] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T18:18:40.497488] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-30T18:18:41.187750] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T18:18:41.297494] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-30T18:18:41.698078] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-30T18:18:41.966766] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T18:18:42.097518] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-30T18:18:42.897472] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-30T18:18:42.915567] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-30T18:18:43.697497] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-30T18:18:44.216934] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-30T18:18:44.227840] [INFO ] [REMOTE ] DINO: Full fetch complete (76270 records). [2025-10-30T18:18:44.227972] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-30T18:18:44.228766] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:18:44.228850] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:18:44.228892] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:18:44.228955] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-30T18:18:44.229017] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-30T18:18:44.229052] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-10-30T18:18:44.229202] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-10-30T18:18:44.229759] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DINO took 35.2s. Estimated remaining: 3h 40m 10s. Rate: 7.9 symbols/min [2025-10-30T18:18:44.397842] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:44.441828] [DEBUG] [LOCAL ] DKS: Loaded 48879 existing records from primary storage. [2025-10-30T18:18:44.442128] [INFO ] [MAIN ] DKS: Loaded 48879 existing records. [2025-10-30T18:18:44.503262] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-30T18:18:44.617352] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:18:44.617527] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-30T18:18:44.617573] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-30T18:18:44.617904] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-30T18:18:44.617965] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-30T18:18:45.012372] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:18:45.042038] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T18:18:45.297491] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-30T18:18:46.097453] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-30T18:18:46.353906] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-30T18:18:46.403166] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T18:18:46.897471] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-30T18:18:47.072691] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T18:18:47.697502] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-30T18:18:48.497473] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-30T18:18:48.565735] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-30T18:18:48.963323] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:18:49.297502] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-30T18:18:49.834305] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T18:18:50.097509] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-30T18:18:50.897482] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-30T18:18:50.948931] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-30T18:18:51.146559] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T18:18:51.697478] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-30T18:18:51.766985] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-30T18:18:52.497529] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-30T18:18:53.304999] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-30T18:18:53.329270] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-30T18:18:53.740967] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T18:18:54.097518] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-30T18:18:54.420385] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T18:18:54.897500] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-30T18:18:55.697507] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-30T18:18:55.754751] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-30T18:18:56.367240] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:18:56.497497] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-30T18:18:56.839030] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T18:18:57.297499] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-30T18:18:58.097506] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-30T18:18:58.586591] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-30T18:18:58.598706] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-30T18:18:58.598902] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-30T18:18:58.737776] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T18:18:58.781724] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T18:18:58.902597] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-30T18:18:59.054443] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-30T18:18:59.054526] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-30T18:18:59.055391] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-30T18:18:59.055458] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-30T18:18:59.056965] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54178 (keeping 200 days of data) [2025-10-30T18:18:59.385131] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-10-30T18:18:59.385288] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-30T18:18:59.385986] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DIS took 48.4s. Estimated remaining: 3h 40m 24s. Rate: 7.9 symbols/min [2025-10-30T18:18:59.553030] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:18:59.583578] [DEBUG] [LOCAL ] DLB: Loaded 32013 existing records from primary storage. [2025-10-30T18:18:59.583865] [INFO ] [MAIN ] DLB: Loaded 32013 existing records. [2025-10-30T18:18:59.702569] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-30T18:18:59.763669] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:18:59.763846] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-30T18:18:59.763894] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-30T18:18:59.764382] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-30T18:18:59.764438] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-30T18:19:00.132863] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:00.497566] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-30T18:19:01.102955] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-30T18:19:01.297477] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-30T18:19:01.512979] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-30T18:19:01.523535] [INFO ] [REMOTE ] DK: Full fetch complete (70735 records). [2025-10-30T18:19:01.523727] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-30T18:19:01.936069] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-30T18:19:01.936327] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-30T18:19:01.937344] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-30T18:19:01.943809] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-30T18:19:01.956636] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T18:19:01.965081] [DEBUG] [LOCAL ] DK: Trimmed 70735 records to 49391 (keeping 200 days of data) [2025-10-30T18:19:02.144527] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-30T18:19:02.275026] [DEBUG] [LOCAL ] DK: Primary data saved (49391 records). [2025-10-30T18:19:02.275182] [INFO ] [MAIN ] DK: Full history saved. [2025-10-30T18:19:02.276237] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DK took 28.6s. Estimated remaining: 3h 40m 3s. Rate: 7.9 symbols/min [2025-10-30T18:19:02.497542] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:02.506592] [DEBUG] [LOCAL ] DLNG: Loaded 5850 existing records from primary storage. [2025-10-30T18:19:02.506884] [INFO ] [MAIN ] DLNG: Loaded 5850 existing records. [2025-10-30T18:19:02.734678] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:19:02.735099] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-30T18:19:02.735305] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-30T18:19:02.735567] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-30T18:19:02.735638] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-30T18:19:02.902587] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-30T18:19:03.161794] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-30T18:19:03.192510] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:03.224752] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T18:19:03.609594] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T18:19:03.697492] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-30T18:19:04.497490] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-30T18:19:04.898364] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T18:19:05.297511] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-30T18:19:05.390109] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-30T18:19:05.945983] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T18:19:06.097505] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-30T18:19:06.613124] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T18:19:06.897495] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-30T18:19:07.697516] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-30T18:19:07.943849] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-30T18:19:08.300615] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-30T18:19:08.497487] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-30T18:19:09.134280] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-30T18:19:09.139926] [INFO ] [REMOTE ] DKL: Full fetch complete (27435 records). [2025-10-30T18:19:09.140050] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-30T18:19:09.300680] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-30T18:19:09.520710] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-30T18:19:09.520793] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-30T18:19:09.521258] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-30T18:19:09.521298] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-30T18:19:09.521965] [DEBUG] [LOCAL ] DKL: Trimmed 27435 records to 15939 (keeping 200 days of data) [2025-10-30T18:19:09.619866] [DEBUG] [LOCAL ] DKL: Primary data saved (15939 records). [2025-10-30T18:19:09.619993] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-30T18:19:09.620103] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DKL took 30.6s. Estimated remaining: 3h 39m 55s. Rate: 7.9 symbols/min [2025-10-30T18:19:09.774845] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-30T18:19:09.803147] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:09.850745] [DEBUG] [LOCAL ] DLR: Loaded 50528 existing records from primary storage. [2025-10-30T18:19:09.851137] [INFO ] [MAIN ] DLR: Loaded 50528 existing records. [2025-10-30T18:19:10.037204] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:19:10.037440] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-30T18:19:10.037523] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-30T18:19:10.038588] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-30T18:19:10.038673] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-30T18:19:10.102734] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-30T18:19:10.405259] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:10.897521] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-30T18:19:11.135052] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T18:19:11.697524] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-30T18:19:12.192663] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T18:19:12.268425] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:19:12.497474] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-30T18:19:13.297515] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-30T18:19:13.836113] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T18:19:14.097496] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-30T18:19:14.464480] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-30T18:19:14.465174] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T18:19:14.897494] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-30T18:19:15.697474] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-30T18:19:16.118768] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T18:19:16.497483] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-30T18:19:16.948487] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-30T18:19:17.096419] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:19:17.297498] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-30T18:19:17.727247] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-30T18:19:18.097492] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-30T18:19:18.417448] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-30T18:19:18.897501] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-30T18:19:19.368212] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-30T18:19:19.697490] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-30T18:19:20.497504] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-30T18:19:20.669932] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T18:19:20.969889] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-30T18:19:20.971813] [INFO ] [REMOTE ] DLNG: Full fetch complete (10820 records). [2025-10-30T18:19:20.971904] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-30T18:19:21.302673] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-30T18:19:21.366240] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-30T18:19:21.366320] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-30T18:19:21.366698] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-30T18:19:21.366765] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-30T18:19:21.367242] [DEBUG] [LOCAL ] DLNG: Trimmed 10820 records to 5904 (keeping 200 days of data) [2025-10-30T18:19:21.400895] [DEBUG] [LOCAL ] DLNG: Primary data saved (5904 records). [2025-10-30T18:19:21.401023] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-30T18:19:21.401102] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DLNG took 19.1s. Estimated remaining: 3h 39m 59s. Rate: 7.9 symbols/min [2025-10-30T18:19:21.579022] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:21.605384] [DEBUG] [LOCAL ] DLX: Loaded 27538 existing records from primary storage. [2025-10-30T18:19:21.605673] [INFO ] [MAIN ] DLX: Loaded 27538 existing records. [2025-10-30T18:19:21.792923] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:19:21.793143] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-30T18:19:21.793189] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-30T18:19:21.793806] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-30T18:19:21.793863] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-30T18:19:22.102727] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-30T18:19:22.165456] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:22.714239] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T18:19:22.897494] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-30T18:19:23.169098] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-30T18:19:23.609224] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-30T18:19:23.697504] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-30T18:19:24.497507] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-30T18:19:25.185399] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T18:19:25.195686] [INFO ] [REMOTE ] DKS: Full fetch complete (71246 records). [2025-10-30T18:19:25.195865] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-30T18:19:25.300023] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-30T18:19:25.608256] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-30T18:19:25.608366] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-30T18:19:25.609424] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-30T18:19:25.609531] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-30T18:19:25.643147] [DEBUG] [LOCAL ] DKS: Trimmed 71246 records to 49202 (keeping 200 days of data) [2025-10-30T18:19:25.644851] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T18:19:25.955404] [DEBUG] [LOCAL ] DKS: Primary data saved (49202 records). [2025-10-30T18:19:25.955528] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-30T18:19:25.956096] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DKS took 41.7s. Estimated remaining: 3h 39m 43s. Rate: 7.9 symbols/min [2025-10-30T18:19:26.107546] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-30T18:19:26.139077] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:26.160557] [DEBUG] [LOCAL ] DLY: Loaded 20562 existing records from primary storage. [2025-10-30T18:19:26.160869] [INFO ] [MAIN ] DLY: Loaded 20562 existing records. [2025-10-30T18:19:26.345478] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:19:26.345731] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-30T18:19:26.345818] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-30T18:19:26.346287] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-30T18:19:26.346362] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-30T18:19:26.729202] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:26.815360] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-30T18:19:26.897545] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-30T18:19:27.159639] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T18:19:27.696913] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T18:19:27.701501] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-30T18:19:28.307958] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T18:19:28.497484] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-30T18:19:29.297497] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-30T18:19:29.553924] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T18:19:29.788426] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T18:19:30.097491] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-30T18:19:30.825853] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-30T18:19:30.897454] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-30T18:19:31.697505] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-30T18:19:32.238984] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:19:32.497503] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-30T18:19:32.851503] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-30T18:19:32.859147] [INFO ] [REMOTE ] DLB: Full fetch complete (47450 records). [2025-10-30T18:19:32.859263] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-30T18:19:33.238731] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-30T18:19:33.238908] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-30T18:19:33.239582] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-30T18:19:33.239625] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-30T18:19:33.240666] [DEBUG] [LOCAL ] DLB: Trimmed 47450 records to 32309 (keeping 200 days of data) [2025-10-30T18:19:33.302001] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-30T18:19:33.353827] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-30T18:19:33.467744] [DEBUG] [LOCAL ] DLB: Primary data saved (32309 records). [2025-10-30T18:19:33.467882] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-30T18:19:33.467960] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLB took 34.1s. Estimated remaining: 3h 39m 35s. Rate: 7.9 symbols/min [2025-10-30T18:19:33.679777] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:33.685872] [DEBUG] [LOCAL ] DMA: Loaded 4693 existing records from primary storage. [2025-10-30T18:19:33.686058] [INFO ] [MAIN ] DMA: Loaded 4693 existing records. [2025-10-30T18:19:33.859419] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:19:33.859687] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-30T18:19:33.859744] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-30T18:19:33.859987] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-30T18:19:33.860044] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-30T18:19:34.102609] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-30T18:19:34.204895] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:34.669523] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T18:19:34.777858] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T18:19:34.897520] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-30T18:19:35.326771] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-30T18:19:35.697503] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-30T18:19:36.440878] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-30T18:19:36.497517] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-30T18:19:37.183370] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-30T18:19:37.297466] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-30T18:19:38.097473] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-30T18:19:38.234292] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T18:19:38.897504] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-30T18:19:39.383304] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T18:19:39.697478] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-30T18:19:39.884389] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T18:19:40.111262] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T18:19:40.497492] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-30T18:19:41.297512] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-30T18:19:41.382989] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T18:19:42.097512] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-30T18:19:42.714448] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-30T18:19:42.897490] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-30T18:19:42.920401] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-30T18:19:43.254793] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-30T18:19:43.697503] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-30T18:19:44.497510] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-30T18:19:44.566139] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T18:19:45.297492] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-30T18:19:45.554179] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T18:19:45.564025] [INFO ] [REMOTE ] DLY: Full fetch complete (28810 records). [2025-10-30T18:19:45.564157] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-30T18:19:45.564703] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:19:45.564790] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:19:45.564833] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:19:45.564872] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-30T18:19:45.564931] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-30T18:19:45.564967] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-10-30T18:19:45.565181] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-10-30T18:19:45.565285] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DLY took 19.6s. Estimated remaining: 3h 39m 40s. Rate: 7.9 symbols/min [2025-10-30T18:19:45.735253] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:45.735445] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-30T18:19:45.735483] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-30T18:19:45.735590] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-30T18:19:45.735632] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-30T18:19:45.735713] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-30T18:19:45.735753] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-30T18:19:46.077941] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:46.097464] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-30T18:19:46.340419] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T18:19:46.762637] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-30T18:19:46.897501] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-30T18:19:47.697532] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-30T18:19:47.805075] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T18:19:48.156115] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-30T18:19:48.497498] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-30T18:19:49.297493] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-30T18:19:49.446125] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T18:19:49.701383] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-30T18:19:50.097508] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-30T18:19:50.629411] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T18:19:50.897512] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-30T18:19:51.428887] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T18:19:51.697506] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-30T18:19:52.178099] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T18:19:52.497526] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-30T18:19:53.297511] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-30T18:19:53.702162] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T18:19:53.785537] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-30T18:19:54.097513] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-30T18:19:54.897475] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-30T18:19:55.002236] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-30T18:19:55.007310] [INFO ] [REMOTE ] DLX: Full fetch complete (41268 records). [2025-10-30T18:19:55.007403] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-30T18:19:55.007938] [FATAL] [VALIDATOR ] DLX: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:19:55.008021] [FATAL] [MAIN ] DLX: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:19:55.008084] [WARN ] [MAIN ] DLX: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:19:55.008156] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-30T18:19:55.008239] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-30T18:19:55.008293] [INFO ] [LOCAL ] DLX: Starting deletion of derivative data. [2025-10-30T18:19:55.008596] [DEBUG] [LOCAL ] DLX: Deleted derivative data file. [2025-10-30T18:19:55.008708] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DLX took 33.6s. Estimated remaining: 3h 39m 38s. Rate: 7.9 symbols/min [2025-10-30T18:19:55.180829] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:55.191512] [DEBUG] [LOCAL ] DMO: Loaded 9379 existing records from primary storage. [2025-10-30T18:19:55.191767] [INFO ] [MAIN ] DMO: Loaded 9379 existing records. [2025-10-30T18:19:55.374972] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T18:19:55.380699] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:19:55.383571] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-30T18:19:55.383631] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-30T18:19:55.383949] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-30T18:19:55.384012] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-30T18:19:55.707496] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-30T18:19:55.754094] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:19:56.497506] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-30T18:19:56.987941] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T18:19:57.035636] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-30T18:19:57.297542] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-30T18:19:58.097542] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-30T18:19:58.624435] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-30T18:19:58.902727] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-30T18:19:58.923302] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T18:19:58.934992] [INFO ] [REMOTE ] DLR: Full fetch complete (74166 records). [2025-10-30T18:19:58.935154] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-30T18:19:59.331273] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-30T18:19:59.331352] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-30T18:19:59.332202] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-30T18:19:59.332265] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-30T18:19:59.334028] [DEBUG] [LOCAL ] DLR: Trimmed 74166 records to 50904 (keeping 200 days of data) [2025-10-30T18:19:59.443881] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T18:19:59.668914] [DEBUG] [LOCAL ] DLR: Primary data saved (50904 records). [2025-10-30T18:19:59.669059] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-30T18:19:59.669811] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DLR took 50.0s. Estimated remaining: 3h 39m 22s. Rate: 7.9 symbols/min [2025-10-30T18:19:59.702558] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-30T18:19:59.844093] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:19:59.889555] [DEBUG] [LOCAL ] DNA: Loaded 48270 existing records from primary storage. [2025-10-30T18:19:59.889896] [INFO ] [MAIN ] DNA: Loaded 48270 existing records. [2025-10-30T18:20:00.065901] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:20:00.066102] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-30T18:20:00.066188] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-30T18:20:00.067032] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-30T18:20:00.067090] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-30T18:20:00.426079] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:20:00.497480] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-30T18:20:00.506945] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T18:20:01.297468] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-30T18:20:01.358442] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T18:20:02.097504] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-30T18:20:02.240134] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T18:20:02.243456] [INFO ] [REMOTE ] DMB: Full fetch complete (14420 records). [2025-10-30T18:20:02.243549] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-30T18:20:02.244022] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:20:02.244104] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:20:02.244145] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:20:02.244209] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-30T18:20:02.244271] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-30T18:20:02.244307] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-30T18:20:02.244344] [DEBUG] [LOCAL ] DMB: No derivative data file found to delete. [2025-10-30T18:20:02.244395] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DMB took 16.7s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min [2025-10-30T18:20:02.429215] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:02.469050] [DEBUG] [LOCAL ] DNOW: Loaded 43614 existing records from primary storage. [2025-10-30T18:20:02.469378] [INFO ] [MAIN ] DNOW: Loaded 43614 existing records. [2025-10-30T18:20:02.660815] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:20:02.661043] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-30T18:20:02.661090] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-30T18:20:02.661777] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-30T18:20:02.661834] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-30T18:20:02.899042] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-30T18:20:02.977417] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T18:20:03.068974] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:20:03.697505] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-30T18:20:04.222948] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T18:20:04.315267] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T18:20:04.497483] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-30T18:20:05.297528] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-30T18:20:05.833191] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T18:20:06.082103] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T18:20:06.097442] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-30T18:20:06.495004] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-30T18:20:06.897525] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-30T18:20:07.697501] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-30T18:20:08.082484] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T18:20:08.310300] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-30T18:20:08.497546] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-30T18:20:08.989453] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-30T18:20:09.297494] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-30T18:20:09.861356] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-30T18:20:10.097469] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-30T18:20:10.897527] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-30T18:20:11.061744] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T18:20:11.174415] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-30T18:20:11.697494] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-30T18:20:12.207776] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T18:20:12.497496] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-30T18:20:13.228315] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-30T18:20:13.230762] [INFO ] [REMOTE ] DMO: Full fetch complete (14253 records). [2025-10-30T18:20:13.230834] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-30T18:20:13.302616] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-30T18:20:13.603955] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-30T18:20:13.604033] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-30T18:20:13.604352] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-30T18:20:13.604390] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-30T18:20:13.604877] [DEBUG] [LOCAL ] DMO: Trimmed 14253 records to 9408 (keeping 200 days of data) [2025-10-30T18:20:13.660324] [DEBUG] [LOCAL ] DMO: Primary data saved (9408 records). [2025-10-30T18:20:13.660452] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-30T18:20:13.660528] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DMO took 18.7s. Estimated remaining: 3h 39m 3s. Rate: 7.9 symbols/min [2025-10-30T18:20:13.827109] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:13.827271] [DEBUG] [LOCAL ] DNP: No existing data file found in primary storage. [2025-10-30T18:20:13.827307] [WARN ] [MAIN ] DNP: No existing data found, performing full refresh instead. [2025-10-30T18:20:13.827413] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-30T18:20:13.827453] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-30T18:20:13.827494] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-30T18:20:13.827526] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-30T18:20:14.102583] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-30T18:20:14.173376] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:20:14.897498] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-30T18:20:15.345971] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-30T18:20:15.664306] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T18:20:15.697495] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-30T18:20:15.963999] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T18:20:16.069978] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-30T18:20:16.497512] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-30T18:20:17.297497] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-30T18:20:17.712101] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T18:20:18.097500] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-30T18:20:18.486766] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T18:20:18.897504] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-30T18:20:19.443306] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T18:20:19.697493] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-30T18:20:20.087615] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:20:20.497478] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-30T18:20:20.609621] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T18:20:21.297490] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-30T18:20:21.479003] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T18:20:22.097486] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-30T18:20:22.296056] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T18:20:22.658695] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-30T18:20:22.660266] [INFO ] [REMOTE ] DMA: Full fetch complete (6481 records). [2025-10-30T18:20:22.660348] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-30T18:20:22.902593] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-30T18:20:23.038872] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-30T18:20:23.038975] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-30T18:20:23.039162] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-30T18:20:23.039203] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-30T18:20:23.039566] [DEBUG] [LOCAL ] DMA: Trimmed 6481 records to 4708 (keeping 200 days of data) [2025-10-30T18:20:23.066721] [DEBUG] [LOCAL ] DMA: Primary data saved (4708 records). [2025-10-30T18:20:23.066803] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-30T18:20:23.066877] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DMA took 49.6s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min [2025-10-30T18:20:23.234046] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:23.282114] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-30T18:20:23.282426] [INFO ] [MAIN ] DOC: Loaded 53554 existing records. [2025-10-30T18:20:23.464096] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:20:23.464338] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-30T18:20:23.464386] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-30T18:20:23.465507] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-30T18:20:23.465566] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-30T18:20:23.702605] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-30T18:20:23.846478] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:20:24.202037] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T18:20:24.497491] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-30T18:20:24.722123] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T18:20:25.297483] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-30T18:20:26.021991] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T18:20:26.097489] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-30T18:20:26.565416] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:20:26.897520] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-30T18:20:27.405574] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:20:27.697510] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-30T18:20:28.378385] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-30T18:20:28.497509] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-30T18:20:28.921437] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T18:20:29.297522] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-30T18:20:29.787402] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T18:20:30.097514] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-30T18:20:30.897549] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-30T18:20:31.197207] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-30T18:20:31.511801] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T18:20:31.697504] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-30T18:20:32.063414] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-30T18:20:32.497510] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-30T18:20:33.109013] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T18:20:33.297533] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-30T18:20:33.739283] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T18:20:34.097531] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-30T18:20:34.740917] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T18:20:34.897493] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-30T18:20:35.287054] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T18:20:35.298011] [INFO ] [REMOTE ] DNOW: Full fetch complete (64005 records). [2025-10-30T18:20:35.298181] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-30T18:20:35.702443] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-30T18:20:35.719050] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-30T18:20:35.719108] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-30T18:20:35.719869] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-30T18:20:35.720031] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-30T18:20:35.721276] [DEBUG] [LOCAL ] DNOW: Trimmed 64005 records to 43945 (keeping 200 days of data) [2025-10-30T18:20:35.968842] [DEBUG] [LOCAL ] DNOW: Primary data saved (43945 records). [2025-10-30T18:20:35.968999] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-30T18:20:35.969574] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DNOW took 33.7s. Estimated remaining: 3h 39m 8s. Rate: 7.9 symbols/min [2025-10-30T18:20:36.141388] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:36.197674] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T18:20:36.223970] [DEBUG] [LOCAL ] DOCN: Loaded 51105 existing records from primary storage. [2025-10-30T18:20:36.224253] [INFO ] [MAIN ] DOCN: Loaded 51105 existing records. [2025-10-30T18:20:36.400320] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:20:36.400510] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-30T18:20:36.400557] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-30T18:20:36.401028] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-30T18:20:36.401087] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-30T18:20:36.505322] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-30T18:20:36.772107] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:20:36.789383] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T18:20:37.297481] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-30T18:20:37.971144] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T18:20:38.097518] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-30T18:20:38.773159] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T18:20:38.897507] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-30T18:20:39.613748] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T18:20:39.697470] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-30T18:20:40.497533] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-30T18:20:40.564874] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T18:20:40.577931] [INFO ] [REMOTE ] DNA: Full fetch complete (70962 records). [2025-10-30T18:20:40.578115] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-30T18:20:41.203894] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-30T18:20:41.204066] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-30T18:20:41.205012] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-30T18:20:41.205101] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-30T18:20:41.206935] [DEBUG] [LOCAL ] DNA: Trimmed 70962 records to 48585 (keeping 200 days of data) [2025-10-30T18:20:41.308587] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-30T18:20:41.366692] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-30T18:20:41.548513] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-30T18:20:41.609739] [DEBUG] [LOCAL ] DNA: Primary data saved (48585 records). [2025-10-30T18:20:41.609861] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-30T18:20:41.610857] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNA took 41.9s. Estimated remaining: 3h 38m 55s. Rate: 7.9 symbols/min [2025-10-30T18:20:42.097505] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-30T18:20:42.607843] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T18:20:42.897532] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-30T18:20:43.159189] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T18:20:43.697521] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-30T18:20:44.504205] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-30T18:20:44.507425] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T18:20:44.519141] [INFO ] [REMOTE ] DOC: Full fetch complete (77619 records). [2025-10-30T18:20:44.519257] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-30T18:20:44.856576] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T18:20:44.963667] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-30T18:20:44.963765] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-30T18:20:44.964747] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-30T18:20:44.964812] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-30T18:20:44.966224] [DEBUG] [LOCAL ] DOC: Trimmed 77619 records to 53944 (keeping 200 days of data) [2025-10-30T18:20:45.297609] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-30T18:20:45.305592] [DEBUG] [LOCAL ] DOC: Primary data saved (53944 records). [2025-10-30T18:20:45.305773] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-30T18:20:45.306411] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DOC took 22.2s. Estimated remaining: 3h 38m 37s. Rate: 7.9 symbols/min [2025-10-30T18:20:45.804816] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:20:46.097512] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-30T18:20:46.374558] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-30T18:20:46.381896] [INFO ] [REMOTE ] DNP: Full fetch complete (48317 records). [2025-10-30T18:20:46.381997] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-30T18:20:46.750470] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-30T18:20:46.750542] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-30T18:20:46.751170] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-30T18:20:46.751230] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-30T18:20:46.752197] [DEBUG] [LOCAL ] DNP: Trimmed 48317 records to 33020 (keeping 200 days of data) [2025-10-30T18:20:46.939448] [DEBUG] [LOCAL ] DNP: Primary data saved (33020 records). [2025-10-30T18:20:46.939576] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-30T18:20:46.939675] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DNP took 33.3s. Estimated remaining: 3h 38m 13s. Rate: 7.9 symbols/min [2025-10-30T18:20:47.394007] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T18:20:47.404129] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-30T18:20:48.685562] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T18:20:48.699820] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-30T18:20:50.196402] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T18:20:50.207010] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-30T18:20:51.529444] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T18:20:51.545084] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-30T18:20:53.019606] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T18:20:53.030571] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-30T18:20:54.659457] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-30T18:20:54.670522] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-30T18:20:56.214816] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-30T18:20:56.226123] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-30T18:20:58.015153] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-30T18:20:58.026851] [INFO ] [REMOTE ] DOCN: Full fetch complete (73266 records). [2025-10-30T18:20:58.026989] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-30T18:20:58.435840] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-30T18:20:58.435918] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-30T18:20:58.436809] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-30T18:20:58.436873] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-30T18:20:58.438239] [DEBUG] [LOCAL ] DOCN: Trimmed 73266 records to 51480 (keeping 200 days of data) [2025-10-30T18:20:58.739726] [DEBUG] [LOCAL ] DOCN: Primary data saved (51480 records). [2025-10-30T18:20:58.739912] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-30T18:20:58.740471] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOCN took 22.8s. Estimated remaining: 3h 38m 17s. Rate: 7.9 symbols/min [2025-10-30T18:20:59.248197] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:59.368359] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:59.424593] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:59.455032] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:20:59.504811] [DEBUG] [LOCAL ] DOUG: Loaded 33430 existing records from primary storage. [2025-10-30T18:20:59.505150] [INFO ] [MAIN ] DOUG: Loaded 33430 existing records. [2025-10-30T18:20:59.633988] [DEBUG] [LOCAL ] DOLE: Loaded 39082 existing records from primary storage. [2025-10-30T18:20:59.643856] [DEBUG] [LOCAL ] DOV: Loaded 45514 existing records from primary storage. [2025-10-30T18:20:59.648263] [INFO ] [MAIN ] DOV: Loaded 45514 existing records. [2025-10-30T18:20:59.659020] [INFO ] [MAIN ] DOLE: Loaded 39082 existing records. [2025-10-30T18:20:59.931261] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:20:59.959116] [DEBUG] [LOCAL ] DOCS: Loaded 50043 existing records from primary storage. [2025-10-30T18:20:59.959871] [INFO ] [MAIN ] DOCS: Loaded 50043 existing records. [2025-10-30T18:20:59.959754] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-30T18:20:59.970413] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-30T18:21:00.020301] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-30T18:21:00.030722] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-30T18:21:00.223907] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:00.312421] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-30T18:21:00.283890] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:00.312621] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-30T18:21:00.328727] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-30T18:21:00.331912] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-30T18:21:00.332040] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-30T18:21:00.332418] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-30T18:21:00.348524] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-30T18:21:00.363428] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-30T18:21:00.651596] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:00.765723] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-30T18:21:00.771018] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-30T18:21:00.823684] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-30T18:21:00.829040] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-30T18:21:01.423566] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:01.477890] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-30T18:21:01.593335] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:01.634034] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-30T18:21:01.776441] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:01.807108] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-30T18:21:01.886259] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:01.886670] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-30T18:21:02.820832] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T18:21:02.828590] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-30T18:21:02.967622] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T18:21:02.978693] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-30T18:21:03.161221] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T18:21:03.170044] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-30T18:21:03.693742] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-30T18:21:03.704024] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-30T18:21:03.775157] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T18:21:03.781626] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-30T18:21:03.837702] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T18:21:03.844689] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-30T18:21:04.089164] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T18:21:04.097722] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-30T18:21:04.822809] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T18:21:04.850378] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-30T18:21:04.853481] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T18:21:04.865751] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-30T18:21:04.904672] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T18:21:04.915055] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-30T18:21:05.385965] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T18:21:05.396205] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-30T18:21:05.687848] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T18:21:05.697778] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-30T18:21:06.044376] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T18:21:06.057300] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-30T18:21:06.084617] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T18:21:06.097455] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-30T18:21:06.839675] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T18:21:06.885063] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:21:06.897454] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-30T18:21:07.242887] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T18:21:07.332715] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T18:21:07.697502] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-30T18:21:07.822788] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T18:21:08.497500] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-30T18:21:08.632959] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T18:21:09.297510] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-30T18:21:09.389750] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T18:21:10.097467] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-30T18:21:10.221463] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T18:21:10.897532] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-30T18:21:11.307537] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T18:21:11.697497] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-30T18:21:11.835843] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T18:21:12.497500] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-30T18:21:12.804902] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T18:21:13.297467] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-30T18:21:14.097459] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-30T18:21:14.311860] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-30T18:21:14.555756] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T18:21:14.897498] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-30T18:21:15.123179] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T18:21:15.697502] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-30T18:21:16.245404] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T18:21:16.254435] [INFO ] [REMOTE ] DOLE: Full fetch complete (54807 records). [2025-10-30T18:21:16.254539] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-30T18:21:16.505918] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-30T18:21:16.642216] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-30T18:21:16.642290] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-30T18:21:16.642964] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-30T18:21:16.643026] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-30T18:21:16.644125] [DEBUG] [LOCAL ] DOLE: Trimmed 54807 records to 39389 (keeping 200 days of data) [2025-10-30T18:21:16.881437] [DEBUG] [LOCAL ] DOLE: Primary data saved (39389 records). [2025-10-30T18:21:16.881666] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-30T18:21:16.881828] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOLE took 18.1s. Estimated remaining: 3h 38m 38s. Rate: 7.9 symbols/min [2025-10-30T18:21:17.054915] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:21:17.084344] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-30T18:21:17.138719] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-30T18:21:17.139022] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-30T18:21:17.310987] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-30T18:21:17.315626] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:17.316812] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-30T18:21:17.316867] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-30T18:21:17.317939] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-30T18:21:17.317997] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-30T18:21:17.673006] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:17.689385] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T18:21:17.695426] [INFO ] [REMOTE ] DOUG: Full fetch complete (49035 records). [2025-10-30T18:21:17.695531] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-30T18:21:17.696066] [FATAL] [VALIDATOR ] DOUG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:21:17.696147] [FATAL] [MAIN ] DOUG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:21:17.696189] [WARN ] [MAIN ] DOUG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:21:17.696235] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-30T18:21:17.696291] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-10-30T18:21:17.696325] [INFO ] [LOCAL ] DOUG: Starting deletion of derivative data. [2025-10-30T18:21:17.696531] [DEBUG] [LOCAL ] DOUG: Deleted derivative data file. [2025-10-30T18:21:17.696617] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOUG took 19.0s. Estimated remaining: 3h 38m 12s. Rate: 7.9 symbols/min [2025-10-30T18:21:17.867725] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:21:17.881234] [DEBUG] [LOCAL ] DPG: Loaded 13076 existing records from primary storage. [2025-10-30T18:21:17.881470] [INFO ] [MAIN ] DPG: Loaded 13076 existing records. [2025-10-30T18:21:18.078129] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:18.078353] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-30T18:21:18.078401] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-30T18:21:18.078764] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-30T18:21:18.078823] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-30T18:21:18.102824] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-30T18:21:18.435241] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:18.613334] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T18:21:18.897569] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-30T18:21:19.510328] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-30T18:21:19.697502] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-30T18:21:20.497477] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-30T18:21:20.579955] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-30T18:21:20.900133] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T18:21:21.297497] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-30T18:21:21.597693] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:21:22.039193] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T18:21:22.097447] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-30T18:21:22.712431] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T18:21:22.897520] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-30T18:21:23.437398] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T18:21:23.697532] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-30T18:21:24.409818] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-30T18:21:24.497502] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-30T18:21:25.297541] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-30T18:21:25.844514] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T18:21:25.895618] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-30T18:21:26.097510] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-30T18:21:26.897519] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-30T18:21:27.630948] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-30T18:21:27.642487] [INFO ] [REMOTE ] DOV: Full fetch complete (66445 records). [2025-10-30T18:21:27.642721] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-30T18:21:27.709888] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-30T18:21:28.250240] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-30T18:21:28.250428] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-30T18:21:28.251767] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-30T18:21:28.251844] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-30T18:21:28.253313] [DEBUG] [LOCAL ] DOV: Trimmed 66445 records to 45891 (keeping 200 days of data) [2025-10-30T18:21:28.406499] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T18:21:28.529895] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-30T18:21:28.477832] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-30T18:21:28.673918] [DEBUG] [LOCAL ] DOV: Primary data saved (45891 records). [2025-10-30T18:21:28.674075] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-30T18:21:28.675005] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOV took 29.9s. Estimated remaining: 3h 38m 13s. Rate: 7.9 symbols/min [2025-10-30T18:21:28.843476] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:21:28.884996] [DEBUG] [LOCAL ] DQ: Loaded 43666 existing records from primary storage. [2025-10-30T18:21:28.885354] [INFO ] [MAIN ] DQ: Loaded 43666 existing records. [2025-10-30T18:21:29.067435] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:29.067691] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-30T18:21:29.067752] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-30T18:21:29.068455] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-30T18:21:29.068514] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-30T18:21:29.309822] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-30T18:21:29.426326] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:29.990593] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T18:21:30.001389] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-30T18:21:30.097471] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-30T18:21:30.699616] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T18:21:30.897519] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-30T18:21:31.519467] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T18:21:31.697481] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-30T18:21:32.497505] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-30T18:21:32.915427] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T18:21:33.276720] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-30T18:21:33.279815] [INFO ] [REMOTE ] DPG: Full fetch complete (18823 records). [2025-10-30T18:21:33.279891] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-30T18:21:33.280326] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:21:33.280424] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:21:33.280466] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:21:33.280529] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-30T18:21:33.280592] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-30T18:21:33.280626] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-10-30T18:21:33.280847] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-10-30T18:21:33.280938] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DPG took 15.6s. Estimated remaining: 3h 37m 58s. Rate: 7.9 symbols/min [2025-10-30T18:21:33.302690] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-30T18:21:33.462523] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:21:33.499253] [DEBUG] [LOCAL ] DRD: Loaded 37823 existing records from primary storage. [2025-10-30T18:21:33.499521] [INFO ] [MAIN ] DRD: Loaded 37823 existing records. [2025-10-30T18:21:33.679096] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:33.679340] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-30T18:21:33.679387] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-30T18:21:33.680106] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-30T18:21:33.680164] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-30T18:21:34.030475] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:34.097499] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-30T18:21:34.556463] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T18:21:34.897471] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-30T18:21:34.990068] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-30T18:21:35.697496] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-30T18:21:36.030811] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T18:21:36.463028] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-30T18:21:36.497471] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-30T18:21:37.297514] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-30T18:21:37.562991] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T18:21:38.097514] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-30T18:21:38.828400] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T18:21:38.897542] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-30T18:21:39.239589] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T18:21:39.697520] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-30T18:21:40.121747] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:21:40.497469] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-30T18:21:40.726481] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T18:21:41.297530] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-30T18:21:41.757733] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T18:21:42.097515] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-30T18:21:42.322403] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T18:21:42.897489] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-30T18:21:43.661561] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T18:21:43.676925] [INFO ] [REMOTE ] DOCS: Full fetch complete (73529 records). [2025-10-30T18:21:43.677106] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-30T18:21:43.702599] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-30T18:21:44.079788] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-30T18:21:44.079866] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-30T18:21:44.080683] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-30T18:21:44.080746] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-30T18:21:44.082093] [DEBUG] [LOCAL ] DOCS: Trimmed 73529 records to 50407 (keeping 200 days of data) [2025-10-30T18:21:44.368709] [DEBUG] [LOCAL ] DOCS: Primary data saved (50407 records). [2025-10-30T18:21:44.368833] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-30T18:21:44.368910] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DOCS took 45.6s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-10-30T18:21:44.500910] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-30T18:21:44.545151] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:21:44.588403] [DEBUG] [LOCAL ] DRH: Loaded 50050 existing records from primary storage. [2025-10-30T18:21:44.588710] [INFO ] [MAIN ] DRH: Loaded 50050 existing records. [2025-10-30T18:21:44.771425] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:21:44.772149] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-30T18:21:44.772265] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-30T18:21:44.773704] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-30T18:21:44.773766] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-30T18:21:45.018968] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-30T18:21:45.191830] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-30T18:21:45.240366] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:45.297448] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-30T18:21:46.058239] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T18:21:46.097469] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-30T18:21:46.451694] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:21:46.897505] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-30T18:21:47.144864] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T18:21:47.697519] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-30T18:21:48.073071] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T18:21:48.497520] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-30T18:21:49.023617] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T18:21:49.297530] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-30T18:21:50.086905] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-30T18:21:50.097948] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-30T18:21:50.561731] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T18:21:50.897508] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-30T18:21:51.652072] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T18:21:51.671577] [INFO ] [REMOTE ] DRD: Full fetch complete (52714 records). [2025-10-30T18:21:51.671829] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-30T18:21:51.705015] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-30T18:21:52.162104] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-30T18:21:52.181754] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-30T18:21:52.200127] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-30T18:21:52.200913] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-30T18:21:52.203371] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T18:21:52.215259] [DEBUG] [LOCAL ] DRD: Trimmed 52714 records to 38081 (keeping 200 days of data) [2025-10-30T18:21:52.449356] [DEBUG] [LOCAL ] DRD: Primary data saved (38081 records). [2025-10-30T18:21:52.449489] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-30T18:21:52.449584] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DRD took 19.2s. Estimated remaining: 3h 37m 53s. Rate: 7.9 symbols/min [2025-10-30T18:21:52.509338] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-30T18:21:52.631621] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:21:52.631817] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-30T18:21:52.631859] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-30T18:21:52.631980] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-30T18:21:52.632023] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-30T18:21:52.632064] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-30T18:21:52.632100] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-30T18:21:52.991960] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:53.286924] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-30T18:21:53.297864] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-30T18:21:53.592319] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T18:21:54.097544] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-30T18:21:54.592248] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T18:21:54.897548] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-30T18:21:55.466753] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T18:21:55.697507] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-30T18:21:56.497519] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-30T18:21:56.917504] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-30T18:21:56.996978] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T18:21:57.297524] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-30T18:21:57.862681] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T18:21:57.872562] [INFO ] [REMOTE ] DQ: Full fetch complete (63594 records). [2025-10-30T18:21:57.872759] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-30T18:21:57.873462] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:21:57.873546] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:21:57.873609] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:21:57.873678] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-30T18:21:57.873756] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-30T18:21:57.873792] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-10-30T18:21:57.873972] [DEBUG] [LOCAL ] DQ: Deleted derivative data file. [2025-10-30T18:21:57.874353] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DQ took 29.2s. Estimated remaining: 3h 37m 40s. Rate: 7.9 symbols/min [2025-10-30T18:21:58.050197] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:21:58.050418] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-30T18:21:58.050467] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-30T18:21:58.050792] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-30T18:21:58.050843] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-30T18:21:58.050885] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-30T18:21:58.050917] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-30T18:21:58.106254] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-30T18:21:58.411999] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:21:58.473111] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T18:21:58.897502] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-30T18:21:59.330058] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T18:21:59.407002] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-30T18:21:59.697526] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-30T18:22:00.497510] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-30T18:22:01.220350] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-30T18:22:01.297479] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-30T18:22:01.382440] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-30T18:22:02.097569] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-30T18:22:02.897506] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-30T18:22:03.042302] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-30T18:22:03.398675] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-30T18:22:03.488038] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:22:03.697519] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-30T18:22:04.258015] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-30T18:22:04.497501] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-30T18:22:05.297540] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-30T18:22:06.005934] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T18:22:06.097545] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-30T18:22:06.480351] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T18:22:06.897523] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-30T18:22:07.426766] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-30T18:22:07.429157] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T18:22:07.697487] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-30T18:22:08.237979] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T18:22:08.497538] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-30T18:22:09.297493] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-30T18:22:09.905706] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-30T18:22:10.097493] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-30T18:22:10.478211] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-30T18:22:10.489669] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-30T18:22:10.489793] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-30T18:22:10.876928] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-30T18:22:10.876992] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-30T18:22:10.877850] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-30T18:22:10.877916] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-30T18:22:10.879374] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 54123 (keeping 200 days of data) [2025-10-30T18:22:10.931556] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-30T18:22:11.201497] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-30T18:22:11.201624] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-30T18:22:11.201740] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DOW took 54.3s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-30T18:22:11.413316] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:11.444948] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T18:22:11.478957] [DEBUG] [LOCAL ] DSL: Loaded 28586 existing records from primary storage. [2025-10-30T18:22:11.479240] [INFO ] [MAIN ] DSL: Loaded 28586 existing records. [2025-10-30T18:22:11.674628] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:11.674849] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-30T18:22:11.674910] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-30T18:22:11.675526] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-30T18:22:11.675582] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-30T18:22:11.705694] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-30T18:22:12.026547] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:12.276682] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T18:22:12.355456] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-30T18:22:12.497522] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-30T18:22:13.297474] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-30T18:22:13.427530] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-30T18:22:14.097488] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-30T18:22:14.544334] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T18:22:14.897508] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-30T18:22:14.998459] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T18:22:15.697492] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-30T18:22:16.031282] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T18:22:16.497492] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-30T18:22:16.938253] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T18:22:17.297509] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-30T18:22:17.835425] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T18:22:18.097493] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-30T18:22:18.150570] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-30T18:22:18.619568] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T18:22:18.897494] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-30T18:22:19.519331] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-30T18:22:19.521395] [INFO ] [REMOTE ] DRLL: Full fetch complete (14332 records). [2025-10-30T18:22:19.521462] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-30T18:22:19.702574] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-30T18:22:19.900088] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-30T18:22:19.900166] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-30T18:22:19.900485] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-30T18:22:19.900525] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-30T18:22:19.901026] [DEBUG] [LOCAL ] DRLL: Trimmed 14332 records to 8460 (keeping 200 days of data) [2025-10-30T18:22:19.952943] [DEBUG] [LOCAL ] DRLL: Primary data saved (8460 records). [2025-10-30T18:22:19.953074] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-30T18:22:19.953143] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRLL took 22.1s. Estimated remaining: 3h 37m 43s. Rate: 7.9 symbols/min [2025-10-30T18:22:20.121690] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:20.135141] [DEBUG] [LOCAL ] DSM: Loaded 13872 existing records from primary storage. [2025-10-30T18:22:20.135391] [INFO ] [MAIN ] DSM: Loaded 13872 existing records. [2025-10-30T18:22:20.312961] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:20.313171] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-30T18:22:20.313218] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-30T18:22:20.313396] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-30T18:22:20.313450] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-30T18:22:20.502768] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-30T18:22:20.671986] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:21.297458] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-30T18:22:21.327845] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T18:22:21.338993] [INFO ] [REMOTE ] DRI: Full fetch complete (69402 records). [2025-10-30T18:22:21.339146] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-30T18:22:21.750033] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-30T18:22:21.750164] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-30T18:22:21.751074] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-30T18:22:21.751162] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-30T18:22:21.752797] [DEBUG] [LOCAL ] DRI: Trimmed 69402 records to 47697 (keeping 200 days of data) [2025-10-30T18:22:22.004941] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T18:22:22.099555] [DEBUG] [LOCAL ] DRI: Primary data saved (47697 records). [2025-10-30T18:22:22.099687] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-30T18:22:22.100061] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-30T18:22:22.101321] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRI took 29.7s. Estimated remaining: 3h 37m 21s. Rate: 7.9 symbols/min [2025-10-30T18:22:22.282124] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:22.303766] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-30T18:22:22.312934] [DEBUG] [LOCAL ] DSMC: Loaded 1739 existing records from primary storage. [2025-10-30T18:22:22.313769] [INFO ] [MAIN ] DSMC: Loaded 1739 existing records. [2025-10-30T18:22:22.496723] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:22.496977] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-30T18:22:22.497031] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-30T18:22:22.497194] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-30T18:22:22.497249] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-30T18:22:22.858890] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:22.869366] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-30T18:22:22.897455] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-30T18:22:23.190170] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-30T18:22:23.697539] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-30T18:22:24.497079] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T18:22:24.502281] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-30T18:22:25.214782] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-30T18:22:25.297494] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-30T18:22:26.071156] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-30T18:22:26.097482] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-30T18:22:26.772563] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T18:22:26.897503] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-30T18:22:27.504765] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T18:22:27.697507] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-30T18:22:28.384822] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T18:22:28.497498] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-30T18:22:29.297521] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-30T18:22:29.742426] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T18:22:29.883870] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T18:22:30.097509] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-30T18:22:30.832504] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T18:22:30.897509] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-30T18:22:31.697743] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-30T18:22:32.205170] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T18:22:32.216181] [INFO ] [REMOTE ] DRH: Full fetch complete (71995 records). [2025-10-30T18:22:32.216324] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-30T18:22:32.502756] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-30T18:22:32.625316] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-30T18:22:32.625488] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-30T18:22:32.626382] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-30T18:22:32.626453] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-30T18:22:32.627922] [DEBUG] [LOCAL ] DRH: Trimmed 71995 records to 50419 (keeping 200 days of data) [2025-10-30T18:22:32.855157] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T18:22:32.953437] [DEBUG] [LOCAL ] DRH: Primary data saved (50419 records). [2025-10-30T18:22:32.953576] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-30T18:22:32.954431] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DRH took 48.6s. Estimated remaining: 3h 37m 22s. Rate: 7.9 symbols/min [2025-10-30T18:22:33.105633] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-30T18:22:33.138460] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:33.159730] [DEBUG] [LOCAL ] DSU: Loaded 22385 existing records from primary storage. [2025-10-30T18:22:33.159996] [INFO ] [MAIN ] DSU: Loaded 22385 existing records. [2025-10-30T18:22:33.302720] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-30T18:22:33.338368] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:33.338826] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-30T18:22:33.338900] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-30T18:22:33.339452] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-30T18:22:33.339508] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-30T18:22:33.732902] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T18:22:33.758108] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:34.097543] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-30T18:22:34.556509] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-30T18:22:34.897520] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-30T18:22:35.697514] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-30T18:22:35.728315] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T18:22:36.497499] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-30T18:22:36.697519] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T18:22:37.225019] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T18:22:37.297506] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-30T18:22:37.985862] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T18:22:38.097516] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-30T18:22:38.784319] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-30T18:22:38.897567] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-30T18:22:39.171174] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-30T18:22:39.697553] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-30T18:22:40.497527] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-30T18:22:40.552610] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T18:22:40.736047] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-30T18:22:41.297518] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-30T18:22:41.923819] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T18:22:42.097526] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-30T18:22:42.717609] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-30T18:22:42.897527] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-30T18:22:43.269138] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-30T18:22:43.697525] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-30T18:22:44.379908] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T18:22:44.497490] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-30T18:22:45.297540] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-30T18:22:45.378208] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-30T18:22:46.097512] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-30T18:22:46.268954] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T18:22:46.866389] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-30T18:22:46.870140] [INFO ] [REMOTE ] DSM: Full fetch complete (24330 records). [2025-10-30T18:22:46.870220] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-30T18:22:46.902612] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-30T18:22:47.272929] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-30T18:22:47.273057] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-30T18:22:47.273499] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-30T18:22:47.273543] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-30T18:22:47.274300] [DEBUG] [LOCAL ] DSM: Trimmed 24330 records to 14036 (keeping 200 days of data) [2025-10-30T18:22:47.355369] [DEBUG] [LOCAL ] DSM: Primary data saved (14036 records). [2025-10-30T18:22:47.355516] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-30T18:22:47.355600] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DSM took 27.4s. Estimated remaining: 3h 37m 32s. Rate: 7.9 symbols/min [2025-10-30T18:22:47.530528] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:47.551072] [DEBUG] [LOCAL ] DSX: Loaded 23080 existing records from primary storage. [2025-10-30T18:22:47.551318] [INFO ] [MAIN ] DSX: Loaded 23080 existing records. [2025-10-30T18:22:47.700675] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-30T18:22:47.731851] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:47.732223] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-30T18:22:47.732273] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-30T18:22:47.732558] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-30T18:22:47.732614] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-30T18:22:47.925208] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-30T18:22:48.113405] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:48.497507] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-30T18:22:48.785766] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T18:22:48.793801] [INFO ] [REMOTE ] DSL: Full fetch complete (42193 records). [2025-10-30T18:22:48.793960] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-30T18:22:49.178249] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-30T18:22:49.178369] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-30T18:22:49.179069] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-30T18:22:49.179132] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-30T18:22:49.180240] [DEBUG] [LOCAL ] DSL: Trimmed 42193 records to 28902 (keeping 200 days of data) [2025-10-30T18:22:49.297490] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-30T18:22:49.364742] [DEBUG] [LOCAL ] DSL: Primary data saved (28902 records). [2025-10-30T18:22:49.365053] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-30T18:22:49.365154] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSL took 38.2s. Estimated remaining: 3h 37m 10s. Rate: 7.9 symbols/min [2025-10-30T18:22:49.484489] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T18:22:49.558434] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:49.604823] [DEBUG] [LOCAL ] DT: Loaded 52897 existing records from primary storage. [2025-10-30T18:22:49.605134] [INFO ] [MAIN ] DT: Loaded 52897 existing records. [2025-10-30T18:22:49.786972] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-30T18:22:49.792498] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:49.794399] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-30T18:22:49.794451] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-30T18:22:49.794925] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-30T18:22:49.794983] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-30T18:22:50.102743] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-30T18:22:50.164886] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:50.467528] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T18:22:50.897498] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-30T18:22:51.697537] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-30T18:22:52.268594] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T18:22:52.497506] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-30T18:22:52.707619] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T18:22:52.715836] [INFO ] [REMOTE ] DSU: Full fetch complete (32840 records). [2025-10-30T18:22:52.715997] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-30T18:22:53.110441] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-30T18:22:53.110521] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-30T18:22:53.111036] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-30T18:22:53.111097] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-30T18:22:53.111940] [DEBUG] [LOCAL ] DSU: Trimmed 32840 records to 22584 (keeping 200 days of data) [2025-10-30T18:22:53.252771] [DEBUG] [LOCAL ] DSU: Primary data saved (22584 records). [2025-10-30T18:22:53.252956] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-30T18:22:53.253239] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSU took 20.3s. Estimated remaining: 3h 36m 52s. Rate: 7.9 symbols/min [2025-10-30T18:22:53.308787] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-30T18:22:53.448141] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:53.449499] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T18:22:53.460946] [DEBUG] [LOCAL ] DTB: Loaded 4821 existing records from primary storage. [2025-10-30T18:22:53.461167] [INFO ] [MAIN ] DTB: Loaded 4821 existing records. [2025-10-30T18:22:53.641110] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:53.641400] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-30T18:22:53.641453] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-30T18:22:53.641673] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-30T18:22:53.641732] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-30T18:22:53.972001] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-30T18:22:53.984306] [INFO ] [REMOTE ] DSMC: Full fetch complete (2902 records). [2025-10-30T18:22:53.994052] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-30T18:22:54.061009] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:54.102635] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-30T18:22:54.378846] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-30T18:22:54.378921] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-30T18:22:54.379026] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-30T18:22:54.379064] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-30T18:22:54.379379] [DEBUG] [LOCAL ] DSMC: Trimmed 2902 records to 1743 (keeping 200 days of data) [2025-10-30T18:22:54.390369] [DEBUG] [LOCAL ] DSMC: Primary data saved (1743 records). [2025-10-30T18:22:54.390429] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-30T18:22:54.390495] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DSMC took 32.3s. Estimated remaining: 3h 36m 28s. Rate: 7.9 symbols/min [2025-10-30T18:22:54.562564] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:22:54.607992] [DEBUG] [LOCAL ] DTE: Loaded 46871 existing records from primary storage. [2025-10-30T18:22:54.608317] [INFO ] [MAIN ] DTE: Loaded 46871 existing records. [2025-10-30T18:22:54.791702] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:22:54.791934] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-30T18:22:54.791987] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-30T18:22:54.792552] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-30T18:22:54.792623] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-30T18:22:54.900850] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-30T18:22:55.191613] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:22:55.584016] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-30T18:22:55.697473] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-30T18:22:55.776009] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T18:22:56.497567] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-30T18:22:57.184375] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T18:22:57.297500] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-30T18:22:57.442592] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-30T18:22:58.097518] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-30T18:22:58.409831] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-30T18:22:58.607954] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T18:22:58.897517] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-30T18:22:59.697544] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-30T18:23:00.497557] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-30T18:23:01.297516] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-30T18:23:04.676576] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (5.78 seconds). [2025-10-30T18:23:04.677927] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-30T18:23:05.427430] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (5.73 seconds). [2025-10-30T18:23:05.433341] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-30T18:23:06.361623] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (5.86 seconds). [2025-10-30T18:23:06.371391] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-30T18:23:06.618448] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-30T18:23:06.620126] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-30T18:23:06.834826] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (5.54 seconds). [2025-10-30T18:23:06.843087] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T18:23:06.859483] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-30T18:23:06.859818] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-30T18:23:07.301528] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T18:23:07.303124] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-30T18:23:07.669247] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T18:23:07.697452] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-30T18:23:07.756848] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T18:23:08.035351] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-30T18:23:08.092724] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T18:23:08.150524] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T18:23:08.497496] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-30T18:23:09.297512] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-30T18:23:09.708810] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T18:23:09.992391] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T18:23:10.097476] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-30T18:23:10.897510] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-30T18:23:11.320238] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-30T18:23:11.705019] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-30T18:23:11.728015] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-30T18:23:12.497506] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-30T18:23:12.543504] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-30T18:23:12.986896] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T18:23:13.297491] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-30T18:23:14.020314] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-30T18:23:14.097503] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-30T18:23:14.627105] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-30T18:23:14.628361] [INFO ] [REMOTE ] DTB: Full fetch complete (6425 records). [2025-10-30T18:23:14.628451] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-30T18:23:14.628845] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:23:14.628928] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:23:14.628971] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:23:14.629009] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-30T18:23:14.629063] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-30T18:23:14.629097] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-30T18:23:14.629382] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-30T18:23:14.629469] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DTB took 21.4s. Estimated remaining: 3h 36m 53s. Rate: 7.9 symbols/min [2025-10-30T18:23:14.797486] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:14.797695] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-30T18:23:14.797748] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-30T18:23:14.797858] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-30T18:23:14.797900] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-30T18:23:14.797941] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-30T18:23:14.797975] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-30T18:23:14.902792] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-30T18:23:15.168579] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:15.697490] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-30T18:23:16.080121] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T18:23:16.369235] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T18:23:16.497525] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-30T18:23:17.297492] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-30T18:23:17.793148] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T18:23:18.097467] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-30T18:23:18.235326] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T18:23:18.897693] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-30T18:23:19.697545] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-30T18:23:19.862292] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-30T18:23:19.873634] [INFO ] [REMOTE ] DT: Full fetch complete (76864 records). [2025-10-30T18:23:19.873814] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-30T18:23:20.110263] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T18:23:20.267914] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-30T18:23:20.268013] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-30T18:23:20.268873] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-30T18:23:20.269088] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-30T18:23:20.270792] [DEBUG] [LOCAL ] DT: Trimmed 76864 records to 53286 (keeping 200 days of data) [2025-10-30T18:23:20.502241] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-30T18:23:20.510895] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-30T18:23:20.617105] [DEBUG] [LOCAL ] DT: Primary data saved (53286 records). [2025-10-30T18:23:20.617226] [INFO ] [MAIN ] DT: Full history saved. [2025-10-30T18:23:20.617302] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DT took 31.3s. Estimated remaining: 3h 36m 41s. Rate: 7.9 symbols/min [2025-10-30T18:23:20.781488] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:20.781676] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-30T18:23:20.781729] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-30T18:23:20.781835] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-30T18:23:20.781876] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-30T18:23:20.781916] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-30T18:23:20.781949] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-30T18:23:21.128182] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:21.297486] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-30T18:23:21.344674] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:23:21.349745] [INFO ] [REMOTE ] DSX: Full fetch complete (34947 records). [2025-10-30T18:23:21.349880] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-30T18:23:21.725038] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-30T18:23:21.725152] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-30T18:23:21.730304] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-30T18:23:21.730438] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-30T18:23:21.731260] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-30T18:23:21.734716] [DEBUG] [LOCAL ] DSX: Trimmed 34947 records to 23140 (keeping 200 days of data) [2025-10-30T18:23:21.865774] [DEBUG] [LOCAL ] DSX: Primary data saved (23140 records). [2025-10-30T18:23:21.865903] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-30T18:23:21.865980] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DSX took 34.5s. Estimated remaining: 3h 36m 17s. Rate: 7.9 symbols/min [2025-10-30T18:23:22.033213] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:22.033398] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-30T18:23:22.033435] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-30T18:23:22.033543] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-30T18:23:22.033583] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-30T18:23:22.033621] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-30T18:23:22.033683] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-30T18:23:22.102740] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-30T18:23:22.377870] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:22.551788] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T18:23:22.897521] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-30T18:23:23.038178] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T18:23:23.038544] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-30T18:23:23.038680] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:23:23.038771] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-30T18:23:23.038874] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:23:23.038965] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-30T18:23:23.039046] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-30T18:23:23.039084] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-30T18:23:23.039123] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-30T18:23:23.039168] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DTK took 1.2s. Estimated remaining: 3h 35m 53s. Rate: 7.9 symbols/min [2025-10-30T18:23:23.242222] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:23.284181] [DEBUG] [LOCAL ] DTM: Loaded 43541 existing records from primary storage. [2025-10-30T18:23:23.284553] [INFO ] [MAIN ] DTM: Loaded 43541 existing records. [2025-10-30T18:23:23.481955] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:23:23.482184] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-30T18:23:23.482232] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-30T18:23:23.483134] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-30T18:23:23.483205] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-30T18:23:23.702561] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-30T18:23:23.854432] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:24.261907] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T18:23:24.497530] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-30T18:23:25.297506] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-30T18:23:25.599810] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-30T18:23:25.828357] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T18:23:26.097567] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-30T18:23:26.434794] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-30T18:23:26.897514] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-30T18:23:27.351891] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T18:23:27.697572] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-30T18:23:28.050604] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-30T18:23:28.497553] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-30T18:23:28.738760] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-30T18:23:29.297545] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-30T18:23:30.097583] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-30T18:23:30.849989] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T18:23:30.897527] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-30T18:23:31.525432] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T18:23:31.697545] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-30T18:23:31.970925] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-30T18:23:32.029397] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T18:23:32.497496] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-30T18:23:32.809437] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-30T18:23:33.297568] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-30T18:23:34.097518] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-30T18:23:34.343138] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-30T18:23:34.762792] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:23:34.897543] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-30T18:23:35.697496] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-30T18:23:36.315762] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T18:23:36.497541] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-30T18:23:36.788869] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-30T18:23:37.084781] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T18:23:37.297505] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-30T18:23:37.773799] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-30T18:23:37.774620] [INFO ] [REMOTE ] DTF: Full fetch complete (1707 records). [2025-10-30T18:23:37.774714] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-30T18:23:37.775058] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:23:37.775140] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:23:37.775182] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:23:37.775219] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-30T18:23:37.775276] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-30T18:23:37.775309] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-30T18:23:37.775473] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-30T18:23:37.775540] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTF took 23.1s. Estimated remaining: 3h 36m 4s. Rate: 7.9 symbols/min [2025-10-30T18:23:37.943068] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:37.948994] [DEBUG] [LOCAL ] DTW: Loaded 4575 existing records from primary storage. [2025-10-30T18:23:37.949161] [INFO ] [MAIN ] DTW: Loaded 4575 existing records. [2025-10-30T18:23:38.102762] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-30T18:23:38.140674] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:23:38.141262] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-30T18:23:38.141334] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-30T18:23:38.141588] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-30T18:23:38.141678] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-30T18:23:38.500558] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:38.897587] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-30T18:23:39.418478] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-30T18:23:39.507541] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:23:39.697499] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-30T18:23:40.048019] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-30T18:23:40.497539] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-30T18:23:41.297521] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-30T18:23:41.989708] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-30T18:23:42.097460] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-30T18:23:42.667206] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T18:23:42.897488] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-30T18:23:43.254435] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T18:23:43.516250] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-30T18:23:43.697485] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-30T18:23:44.077887] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T18:23:44.497501] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-30T18:23:45.297519] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-30T18:23:45.740158] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-30T18:23:45.861252] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T18:23:46.097504] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-30T18:23:46.897501] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-30T18:23:47.450414] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T18:23:47.697509] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-30T18:23:48.499460] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-30T18:23:48.501945] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T18:23:48.512087] [INFO ] [REMOTE ] DTE: Full fetch complete (68822 records). [2025-10-30T18:23:48.512227] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-30T18:23:48.902618] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-30T18:23:48.902763] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-30T18:23:48.903704] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-30T18:23:48.903869] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-30T18:23:48.905635] [DEBUG] [LOCAL ] DTE: Trimmed 68822 records to 47224 (keeping 200 days of data) [2025-10-30T18:23:49.008246] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T18:23:49.162781] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T18:23:49.251669] [DEBUG] [LOCAL ] DTE: Primary data saved (47224 records). [2025-10-30T18:23:49.251816] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-30T18:23:49.252553] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTE took 54.9s. Estimated remaining: 3h 36m 6s. Rate: 7.9 symbols/min [2025-10-30T18:23:49.308280] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-30T18:23:49.434040] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:49.484778] [DEBUG] [LOCAL ] DUK: Loaded 53417 existing records from primary storage. [2025-10-30T18:23:49.485136] [INFO ] [MAIN ] DUK: Loaded 53417 existing records. [2025-10-30T18:23:49.660882] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:23:49.661122] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-30T18:23:49.661171] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-30T18:23:49.661763] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-30T18:23:49.661821] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-30T18:23:49.964739] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-30T18:23:50.000591] [INFO ] [REMOTE ] DTG: Full fetch complete (8321 records). [2025-10-30T18:23:50.015138] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-30T18:23:50.034317] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:23:50.035003] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:23:50.038361] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:50.038541] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:23:50.038906] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-30T18:23:50.038991] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-30T18:23:50.039045] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-30T18:23:50.039089] [DEBUG] [LOCAL ] DTG: No derivative data file found to delete. [2025-10-30T18:23:50.039162] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTG took 29.4s. Estimated remaining: 3h 35m 41s. Rate: 7.9 symbols/min [2025-10-30T18:23:50.102691] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-30T18:23:50.207472] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:50.207675] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-30T18:23:50.207729] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-30T18:23:50.207837] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-30T18:23:50.207904] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-30T18:23:50.207965] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-30T18:23:50.208024] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-30T18:23:50.562189] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:50.897539] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-30T18:23:51.454778] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T18:23:51.702779] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-30T18:23:51.716603] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-30T18:23:52.497503] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-30T18:23:53.297504] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-30T18:23:53.329425] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T18:23:53.339693] [INFO ] [REMOTE ] DTM: Full fetch complete (65285 records). [2025-10-30T18:23:53.339810] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-30T18:23:53.755380] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-30T18:23:53.755498] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-30T18:23:53.756567] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-30T18:23:53.756673] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-30T18:23:53.758507] [DEBUG] [LOCAL ] DTM: Trimmed 65285 records to 43877 (keeping 200 days of data) [2025-10-30T18:23:53.765236] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T18:23:53.902914] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-30T18:23:54.074954] [DEBUG] [LOCAL ] DTM: Primary data saved (43877 records). [2025-10-30T18:23:54.075088] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-30T18:23:54.075745] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DTM took 31.0s. Estimated remaining: 3h 35m 24s. Rate: 7.9 symbols/min [2025-10-30T18:23:54.104749] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-30T18:23:54.244040] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:23:54.297159] [DEBUG] [LOCAL ] DV: Loaded 51192 existing records from primary storage. [2025-10-30T18:23:54.297511] [INFO ] [MAIN ] DV: Loaded 51192 existing records. [2025-10-30T18:23:54.472638] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:23:54.472851] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-30T18:23:54.472899] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-30T18:23:54.473914] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-30T18:23:54.473972] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-30T18:23:54.652118] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-30T18:23:54.829898] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:23:54.897454] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-30T18:23:55.697512] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-30T18:23:56.176808] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T18:23:56.331142] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T18:23:56.497467] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-30T18:23:56.951165] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T18:23:57.297537] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-30T18:23:58.097493] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-30T18:23:58.571101] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-30T18:23:58.600413] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:23:58.897489] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-30T18:23:59.453066] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T18:23:59.697472] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-30T18:24:00.497528] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-30T18:24:01.297531] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-30T18:24:01.861922] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-30T18:24:02.097469] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-30T18:24:02.154185] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-30T18:24:02.759974] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T18:24:02.897480] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-30T18:24:03.367884] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T18:24:03.697491] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-30T18:24:04.073430] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-30T18:24:04.112871] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-30T18:24:04.497494] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-30T18:24:04.805096] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-30T18:24:05.297514] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-30T18:24:05.714424] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-30T18:24:06.097495] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-30T18:24:06.897504] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-30T18:24:07.704237] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-30T18:24:07.710975] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-30T18:24:08.239690] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-30T18:24:08.241261] [INFO ] [REMOTE ] DUKB: Full fetch complete (8889 records). [2025-10-30T18:24:08.241330] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-30T18:24:08.498081] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-30T18:24:08.615925] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-30T18:24:08.616153] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-30T18:24:08.616606] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-30T18:24:08.616836] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-30T18:24:08.617681] [DEBUG] [LOCAL ] DUKB: Trimmed 8889 records to 5906 (keeping 200 days of data) [2025-10-30T18:24:08.667552] [DEBUG] [LOCAL ] DUKB: Primary data saved (5906 records). [2025-10-30T18:24:08.685030] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-30T18:24:08.685204] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DUKB took 18.6s. Estimated remaining: 3h 35m 35s. Rate: 7.9 symbols/min [2025-10-30T18:24:08.772427] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-30T18:24:08.875531] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:24:08.875735] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-10-30T18:24:08.875783] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-10-30T18:24:08.875895] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-30T18:24:08.875939] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-30T18:24:08.875980] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-30T18:24:08.876013] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-30T18:24:09.231794] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:24:09.297497] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-30T18:24:09.832069] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-30T18:24:10.097472] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-30T18:24:10.337498] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-30T18:24:10.897494] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-30T18:24:11.358691] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T18:24:11.373040] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-30T18:24:11.697471] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-30T18:24:12.497502] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-30T18:24:13.297482] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-30T18:24:13.510207] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-30T18:24:13.703917] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T18:24:14.097511] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-30T18:24:14.598169] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T18:24:14.596562] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T18:24:14.897499] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-30T18:24:15.372120] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-30T18:24:15.373475] [INFO ] [REMOTE ] DTW: Full fetch complete (6839 records). [2025-10-30T18:24:15.373544] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-30T18:24:15.702601] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-30T18:24:15.748281] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-30T18:24:15.748389] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-30T18:24:15.748639] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-30T18:24:15.748728] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-30T18:24:15.749169] [DEBUG] [LOCAL ] DTW: Trimmed 6839 records to 4587 (keeping 200 days of data) [2025-10-30T18:24:15.777442] [DEBUG] [LOCAL ] DTW: Primary data saved (4587 records). [2025-10-30T18:24:15.777551] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-30T18:24:15.777628] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DTW took 38.0s. Estimated remaining: 3h 35m 26s. Rate: 7.9 symbols/min [2025-10-30T18:24:15.951134] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:24:16.003585] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-30T18:24:16.003950] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-30T18:24:16.180693] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:24:16.180892] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-30T18:24:16.180941] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-30T18:24:16.181873] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-30T18:24:16.181955] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-30T18:24:16.506702] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-30T18:24:16.527183] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:24:17.297924] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-30T18:24:17.302066] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-30T18:24:17.806013] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T18:24:18.097493] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-30T18:24:18.501141] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T18:24:18.897496] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-30T18:24:19.519587] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T18:24:19.697572] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-30T18:24:20.391832] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T18:24:20.497559] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-30T18:24:21.297554] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-30T18:24:21.706897] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-30T18:24:21.720907] [INFO ] [REMOTE ] DUK: Full fetch complete (77558 records). [2025-10-30T18:24:21.721144] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-30T18:24:22.102232] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-30T18:24:22.213561] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-30T18:24:22.224440] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-30T18:24:22.228231] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-30T18:24:22.228940] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-30T18:24:22.230328] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-30T18:24:22.242693] [DEBUG] [LOCAL ] DUK: Trimmed 77558 records to 53807 (keeping 200 days of data) [2025-10-30T18:24:22.585062] [DEBUG] [LOCAL ] DUK: Primary data saved (53807 records). [2025-10-30T18:24:22.585203] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-30T18:24:22.586054] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DUK took 33.3s. Estimated remaining: 3h 35m 16s. Rate: 7.9 symbols/min [2025-10-30T18:24:22.763774] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:24:22.816369] [DEBUG] [LOCAL ] DX: Loaded 52472 existing records from primary storage. [2025-10-30T18:24:22.816714] [INFO ] [MAIN ] DX: Loaded 52472 existing records. [2025-10-30T18:24:22.902985] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-30T18:24:23.022336] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:24:23.022726] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-30T18:24:23.022806] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-30T18:24:23.024196] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-30T18:24:23.024256] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-30T18:24:23.436859] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:24:23.475782] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-30T18:24:23.573797] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:24:23.697501] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-30T18:24:24.291853] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T18:24:24.497511] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-30T18:24:24.992578] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T18:24:25.297548] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-30T18:24:25.902088] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T18:24:25.913378] [INFO ] [REMOTE ] DV: Full fetch complete (73890 records). [2025-10-30T18:24:25.913539] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-30T18:24:26.104137] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-30T18:24:26.301861] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-30T18:24:26.301939] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-30T18:24:26.302761] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-30T18:24:26.302825] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-30T18:24:26.304203] [DEBUG] [LOCAL ] DV: Trimmed 73890 records to 51552 (keeping 200 days of data) [2025-10-30T18:24:26.604497] [DEBUG] [LOCAL ] DV: Primary data saved (51552 records). [2025-10-30T18:24:26.604661] [INFO ] [MAIN ] DV: Full history saved. [2025-10-30T18:24:26.605271] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DV took 32.5s. Estimated remaining: 3h 34m 59s. Rate: 7.9 symbols/min [2025-10-30T18:24:26.780194] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:24:26.827985] [DEBUG] [LOCAL ] DXC: Loaded 49814 existing records from primary storage. [2025-10-30T18:24:26.828280] [INFO ] [MAIN ] DXC: Loaded 49814 existing records. [2025-10-30T18:24:26.902571] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-30T18:24:27.013259] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:24:27.013603] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-30T18:24:27.013699] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-30T18:24:27.014088] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-30T18:24:27.014152] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-30T18:24:27.386783] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-30T18:24:27.424396] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:24:27.704443] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-30T18:24:27.723556] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-30T18:24:28.107249] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T18:24:28.497509] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-30T18:24:28.811412] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T18:24:29.297507] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-30T18:24:29.652065] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:24:30.097494] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-30T18:24:30.497317] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T18:24:30.897485] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-30T18:24:31.272260] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T18:24:31.697499] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-30T18:24:32.490368] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T18:24:32.500890] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-30T18:24:33.189831] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T18:24:33.297494] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-30T18:24:33.647766] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T18:24:34.097514] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-30T18:24:34.625574] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T18:24:34.897495] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-30T18:24:35.427578] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T18:24:35.697511] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-30T18:24:36.333901] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T18:24:36.497490] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-30T18:24:37.297466] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-30T18:24:37.483261] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-30T18:24:38.097470] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-30T18:24:38.286454] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-30T18:24:38.452268] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:24:38.897465] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-30T18:24:39.697483] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-30T18:24:39.888082] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-30T18:24:40.497496] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-30T18:24:40.932908] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-30T18:24:41.262889] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T18:24:41.297456] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-30T18:24:42.097508] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-30T18:24:42.358666] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-30T18:24:42.561880] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T18:24:42.897531] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-30T18:24:43.297230] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T18:24:43.697493] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-30T18:24:44.497467] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-30T18:24:44.626203] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-30T18:24:45.262896] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-30T18:24:45.297458] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-30T18:24:45.925198] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T18:24:46.097519] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-30T18:24:46.907056] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-30T18:24:46.912938] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-30T18:24:47.697466] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-30T18:24:47.758206] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-30T18:24:47.769440] [INFO ] [REMOTE ] DXC: Full fetch complete (70590 records). [2025-10-30T18:24:47.769587] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-30T18:24:48.173628] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-30T18:24:48.173736] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-30T18:24:48.174533] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-30T18:24:48.174575] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-30T18:24:48.175899] [DEBUG] [LOCAL ] DXC: Trimmed 70590 records to 50191 (keeping 200 days of data) [2025-10-30T18:24:48.419926] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T18:24:48.434510] [INFO ] [REMOTE ] DVA: Full fetch complete (59273 records). [2025-10-30T18:24:48.438081] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-30T18:24:48.462245] [FATAL] [VALIDATOR ] DVA: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:24:48.467168] [FATAL] [MAIN ] DVA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:24:48.480420] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:24:48.482705] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-30T18:24:48.483074] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-30T18:24:48.483370] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-10-30T18:24:48.486940] [DEBUG] [LOCAL ] DVA: No derivative data file found to delete. [2025-10-30T18:24:48.494685] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DVA took 39.8s. Estimated remaining: 3h 35m 28s. Rate: 7.9 symbols/min [2025-10-30T18:24:48.497480] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-30T18:24:48.497562] [DEBUG] [LOCAL ] DXC: Primary data saved (50191 records). [2025-10-30T18:24:48.509754] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-30T18:24:48.520439] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DXC took 21.9s. Estimated remaining: 3h 35m 1s. Rate: 7.9 symbols/min [2025-10-30T18:24:48.863950] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:24:48.862583] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:24:48.864100] [DEBUG] [LOCAL ] DY: No existing data file found in primary storage. [2025-10-30T18:24:48.864194] [WARN ] [MAIN ] DY: No existing data found, performing full refresh instead. [2025-10-30T18:24:48.864563] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-30T18:24:48.864747] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-30T18:24:48.864890] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-30T18:24:48.864943] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-30T18:24:49.180037] [DEBUG] [LOCAL ] DXYZ: Loaded 36608 existing records from primary storage. [2025-10-30T18:24:49.191261] [INFO ] [MAIN ] DXYZ: Loaded 36608 existing records. [2025-10-30T18:24:49.311527] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:24:49.329046] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-30T18:24:49.448938] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:24:49.449173] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-30T18:24:49.449336] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-30T18:24:49.449733] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-30T18:24:49.449820] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-30T18:24:49.583141] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-30T18:24:49.849371] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:24:50.097487] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-30T18:24:50.432047] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-30T18:24:50.487682] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T18:24:50.897497] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-30T18:24:51.617750] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-30T18:24:51.697516] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-30T18:24:52.497525] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-30T18:24:52.780750] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T18:24:52.981529] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-30T18:24:53.297504] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-30T18:24:54.038472] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-30T18:24:54.097515] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-30T18:24:54.454887] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T18:24:54.897480] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-30T18:24:55.697476] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-30T18:24:55.767336] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-30T18:24:56.106683] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T18:24:56.497497] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-30T18:24:57.301259] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-30T18:24:57.308845] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-30T18:24:57.340785] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-30T18:24:58.097508] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-30T18:24:58.897496] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-30T18:24:59.425243] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-30T18:24:59.437867] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-30T18:24:59.438107] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-30T18:24:59.707844] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-30T18:24:59.861190] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-30T18:24:59.861357] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-30T18:24:59.862951] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-30T18:24:59.863037] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-30T18:24:59.865557] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 54089 (keeping 200 days of data) [2025-10-30T18:24:59.998324] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-30T18:25:00.048579] [INFO ] [REMOTE ] DX: Full fetch complete (75947 records). [2025-10-30T18:25:00.048811] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-30T18:25:00.517490] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-30T18:25:00.529771] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-30T18:25:00.556980] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DVN took 44.8s. Estimated remaining: 3h 35m 5s. Rate: 7.9 symbols/min [2025-10-30T18:25:00.845531] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-30T18:25:00.867894] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-30T18:25:00.942034] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-30T18:25:00.946596] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:25:00.946975] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-30T18:25:00.950376] [DEBUG] [LOCAL ] DX: Trimmed 75947 records to 52861 (keeping 200 days of data) [2025-10-30T18:25:01.040116] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-30T18:25:01.093317] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-30T18:25:01.252847] [DEBUG] [LOCAL ] E: Loaded 32570 existing records from primary storage. [2025-10-30T18:25:01.258590] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-30T18:25:01.264945] [INFO ] [MAIN ] E: Loaded 32570 existing records. [2025-10-30T18:25:01.299777] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-30T18:25:01.512702] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:25:01.516106] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-30T18:25:01.518670] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-30T18:25:01.562982] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-30T18:25:01.569203] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-30T18:25:01.723764] [DEBUG] [LOCAL ] DX: Primary data saved (52861 records). [2025-10-30T18:25:01.725187] [INFO ] [MAIN ] DX: Full history saved. [2025-10-30T18:25:01.725355] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DX took 39.1s. Estimated remaining: 3h 34m 41s. Rate: 7.9 symbols/min [2025-10-30T18:25:02.103453] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:25:02.126257] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-10-30T18:25:02.145117] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-10-30T18:25:02.147206] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-30T18:25:02.166854] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-30T18:25:02.166775] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:25:02.167250] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-30T18:25:02.167022] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-30T18:25:02.167344] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-30T18:25:02.529941] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:25:02.721422] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-30T18:25:02.897501] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-30T18:25:03.395948] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T18:25:03.697500] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-30T18:25:03.775868] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-30T18:25:04.258835] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T18:25:04.497618] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-30T18:25:04.780365] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T18:25:05.297500] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-30T18:25:05.484221] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T18:25:06.097485] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-30T18:25:06.866490] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-30T18:25:06.897557] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-30T18:25:07.217850] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T18:25:07.697569] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-30T18:25:08.060488] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T18:25:08.497540] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-30T18:25:08.896128] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T18:25:09.297489] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-30T18:25:10.097484] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-30T18:25:10.209808] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-30T18:25:10.865114] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-30T18:25:10.897447] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-30T18:25:11.080320] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-30T18:25:11.085696] [INFO ] [REMOTE ] DY: Full fetch complete (43241 records). [2025-10-30T18:25:11.085794] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-30T18:25:11.485041] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-30T18:25:11.485118] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-30T18:25:11.485764] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-30T18:25:11.485825] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-30T18:25:11.486766] [DEBUG] [LOCAL ] DY: Trimmed 43241 records to 27736 (keeping 200 days of data) [2025-10-30T18:25:11.655960] [DEBUG] [LOCAL ] DY: Primary data saved (27736 records). [2025-10-30T18:25:11.656101] [INFO ] [MAIN ] DY: Full history saved. [2025-10-30T18:25:11.656172] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. DY took 23.1s. Estimated remaining: 3h 34m 39s. Rate: 7.9 symbols/min [2025-10-30T18:25:11.705767] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-30T18:25:11.845158] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:25:11.850245] [DEBUG] [LOCAL ] EAI: Loaded 3759 existing records from primary storage. [2025-10-30T18:25:11.850407] [INFO ] [MAIN ] EAI: Loaded 3759 existing records. [2025-10-30T18:25:12.025872] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:25:12.026155] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-30T18:25:12.026264] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-30T18:25:12.026475] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-30T18:25:12.026532] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-30T18:25:12.407462] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:25:12.409768] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-30T18:25:12.497453] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-30T18:25:13.017764] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-30T18:25:13.180052] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T18:25:13.297462] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-30T18:25:14.097515] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-30T18:25:14.502050] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-30T18:25:14.686615] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-30T18:25:14.897490] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-30T18:25:15.246159] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-30T18:25:15.697471] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-30T18:25:16.497494] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-30T18:25:16.964985] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T18:25:17.297498] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-30T18:25:18.097513] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-30T18:25:18.409669] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-30T18:25:18.456560] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-30T18:25:18.844570] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-30T18:25:18.897462] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-30T18:25:19.697502] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-30T18:25:19.975346] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-30T18:25:20.497532] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-30T18:25:21.186813] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T18:25:21.297496] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-30T18:25:21.672314] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T18:25:22.097508] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-30T18:25:22.710340] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T18:25:22.897481] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-30T18:25:23.666999] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:25:23.697455] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-30T18:25:24.014606] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T18:25:24.497552] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-30T18:25:25.135419] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T18:25:25.297524] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-30T18:25:25.722811] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-30T18:25:25.731470] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56015 records). [2025-10-30T18:25:25.731575] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-30T18:25:26.106639] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-30T18:25:26.109613] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-30T18:25:26.109756] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-30T18:25:26.110916] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-30T18:25:26.111613] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-30T18:25:26.113318] [DEBUG] [LOCAL ] DXYZ: Trimmed 56015 records to 36901 (keeping 200 days of data) [2025-10-30T18:25:26.327499] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36901 records). [2025-10-30T18:25:26.327626] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-30T18:25:26.327736] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. DXYZ took 37.8s. Estimated remaining: 3h 34m 50s. Rate: 7.9 symbols/min [2025-10-30T18:25:26.507424] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:25:26.504044] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T18:25:26.533421] [DEBUG] [LOCAL ] EARN: Loaded 26981 existing records from primary storage. [2025-10-30T18:25:26.533694] [INFO ] [MAIN ] EARN: Loaded 26981 existing records. [2025-10-30T18:25:26.725271] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:25:26.725572] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-30T18:25:26.725627] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-30T18:25:26.726535] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-30T18:25:26.726595] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-30T18:25:26.897685] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-30T18:25:27.155966] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:25:27.171232] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-30T18:25:27.307396] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T18:25:27.697491] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-30T18:25:27.983828] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-30T18:25:28.497507] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-30T18:25:29.297504] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-30T18:25:29.501601] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T18:25:30.097462] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-30T18:25:30.463972] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:25:30.475062] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T18:25:30.897478] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-30T18:25:31.443726] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T18:25:31.445207] [INFO ] [REMOTE ] EAI: Full fetch complete (5655 records). [2025-10-30T18:25:31.445298] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-30T18:25:31.702570] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-30T18:25:31.798324] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-30T18:25:31.798398] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-30T18:25:31.798562] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-30T18:25:31.798600] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-30T18:25:31.798980] [DEBUG] [LOCAL ] EAI: Trimmed 5655 records to 3784 (keeping 200 days of data) [2025-10-30T18:25:31.821189] [DEBUG] [LOCAL ] EAI: Primary data saved (3784 records). [2025-10-30T18:25:31.821287] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-30T18:25:31.821362] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. EAI took 20.2s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-30T18:25:31.992178] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:25:32.038671] [DEBUG] [LOCAL ] EAT: Loaded 49713 existing records from primary storage. [2025-10-30T18:25:32.039035] [INFO ] [MAIN ] EAT: Loaded 49713 existing records. [2025-10-30T18:25:32.212564] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:25:32.212861] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-30T18:25:32.212932] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-30T18:25:32.213886] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-30T18:25:32.213946] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-30T18:25:32.502606] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-30T18:25:32.565216] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:25:32.906716] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T18:25:32.913401] [INFO ] [REMOTE ] EAF: Full fetch complete (61247 records). [2025-10-30T18:25:32.913515] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-30T18:25:33.305173] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-30T18:25:33.321197] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-30T18:25:33.321278] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-30T18:25:33.322046] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-30T18:25:33.322110] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-30T18:25:33.323743] [DEBUG] [LOCAL ] EAF: Trimmed 61247 records to 40611 (keeping 200 days of data) [2025-10-30T18:25:33.545820] [DEBUG] [LOCAL ] EAF: Primary data saved (40611 records). [2025-10-30T18:25:33.545937] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-30T18:25:33.546020] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. EAF took 31.8s. Estimated remaining: 3h 34m 14s. Rate: 7.9 symbols/min [2025-10-30T18:25:33.724233] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:25:33.748243] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T18:25:33.786194] [DEBUG] [LOCAL ] EB: Loaded 35576 existing records from primary storage. [2025-10-30T18:25:33.786543] [INFO ] [MAIN ] EB: Loaded 35576 existing records. [2025-10-30T18:25:33.963048] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:25:33.963327] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-30T18:25:33.963377] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-30T18:25:33.964067] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-30T18:25:33.964126] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-30T18:25:34.106271] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-30T18:25:34.334277] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:25:34.854525] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T18:25:34.897454] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-30T18:25:35.398340] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T18:25:35.405356] [INFO ] [REMOTE ] E: Full fetch complete (47581 records). [2025-10-30T18:25:35.405464] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-30T18:25:35.702803] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-30T18:25:35.808799] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-30T18:25:35.808890] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-30T18:25:35.809601] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-30T18:25:35.809692] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-30T18:25:35.810735] [DEBUG] [LOCAL ] E: Trimmed 47581 records to 32809 (keeping 200 days of data) [2025-10-30T18:25:36.010776] [DEBUG] [LOCAL ] E: Primary data saved (32809 records). [2025-10-30T18:25:36.010941] [INFO ] [MAIN ] E: Full history saved. [2025-10-30T18:25:36.011156] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. E took 35.4s. Estimated remaining: 3h 33m 54s. Rate: 7.9 symbols/min [2025-10-30T18:25:36.194976] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:25:36.219407] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T18:25:36.248760] [DEBUG] [LOCAL ] EBF: Loaded 19290 existing records from primary storage. [2025-10-30T18:25:36.249056] [INFO ] [MAIN ] EBF: Loaded 19290 existing records. [2025-10-30T18:25:36.429586] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:25:36.429837] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-30T18:25:36.429886] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-30T18:25:36.430310] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-30T18:25:36.430366] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-30T18:25:36.506244] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-30T18:25:36.800834] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:25:36.820000] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T18:25:37.297510] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-30T18:25:37.433295] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T18:25:38.097541] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-30T18:25:38.731382] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T18:25:38.778849] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T18:25:38.897499] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-30T18:25:39.518674] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T18:25:39.697501] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-30T18:25:40.497531] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-30T18:25:41.217229] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-30T18:25:41.297513] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-30T18:25:41.902090] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-30T18:25:42.097484] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-30T18:25:42.159316] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T18:25:42.897516] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-30T18:25:43.204379] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T18:25:43.697506] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-30T18:25:44.497616] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-30T18:25:44.499020] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-30T18:25:44.720204] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T18:25:45.213214] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-30T18:25:45.297477] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-30T18:25:46.097582] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-30T18:25:46.897467] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-30T18:25:46.968837] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-30T18:25:47.320192] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:25:47.697497] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-30T18:25:47.753570] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-30T18:25:48.338270] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T18:25:48.497538] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-30T18:25:49.263833] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-30T18:25:49.297503] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-30T18:25:50.097484] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-30T18:25:50.177067] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T18:25:50.897488] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-30T18:25:50.954382] [DEBUG] [REMOTE ] EBF: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-30T18:25:50.954778] [WARN ] [REMOTE ] EBF: No data returned for month 2025-07 [2025-10-30T18:25:50.954878] [FATAL] [REMOTE ] EBF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:25:50.954971] [FATAL] [MAIN ] EBF: Failed to fetch primary data. [2025-10-30T18:25:50.955039] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:25:50.955108] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-30T18:25:50.955169] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-30T18:25:50.955206] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-30T18:25:50.955348] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-30T18:25:50.955412] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EBF took 14.9s. Estimated remaining: 3h 34m 5s. Rate: 7.9 symbols/min [2025-10-30T18:25:51.594174] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T18:25:51.697505] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-30T18:25:52.497497] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-30T18:25:53.065727] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T18:25:53.297527] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-30T18:25:53.359133] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T18:25:54.097518] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-30T18:25:54.865740] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T18:25:54.897455] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-30T18:25:55.355602] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T18:25:55.361979] [INFO ] [REMOTE ] EARN: Full fetch complete (44910 records). [2025-10-30T18:25:55.362086] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-30T18:25:55.699512] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-30T18:25:55.756863] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-30T18:25:55.756986] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-30T18:25:55.757715] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-30T18:25:55.757783] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-30T18:25:55.758739] [DEBUG] [LOCAL ] EARN: Trimmed 44910 records to 27219 (keeping 200 days of data) [2025-10-30T18:25:55.913257] [DEBUG] [LOCAL ] EARN: Primary data saved (27219 records). [2025-10-30T18:25:55.913397] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-30T18:25:55.913487] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EARN took 29.6s. Estimated remaining: 3h 33m 50s. Rate: 7.9 symbols/min [2025-10-30T18:25:56.615295] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-30T18:25:56.625508] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-30T18:25:56.758198] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-30T18:25:57.297565] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-30T18:25:58.009016] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T18:25:58.097456] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-30T18:25:58.435267] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T18:25:58.897485] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-30T18:25:59.806896] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-30T18:25:59.817763] [INFO ] [REMOTE ] EAT: Full fetch complete (72534 records). [2025-10-30T18:25:59.817891] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-30T18:26:00.238155] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T18:26:00.244984] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-30T18:26:00.245373] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-30T18:26:00.246270] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-30T18:26:00.246388] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-30T18:26:00.246899] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-30T18:26:00.248787] [DEBUG] [LOCAL ] EAT: Trimmed 72534 records to 50100 (keeping 200 days of data) [2025-10-30T18:26:00.553408] [DEBUG] [LOCAL ] EAT: Primary data saved (50100 records). [2025-10-30T18:26:00.553532] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-30T18:26:00.554137] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EAT took 28.7s. Estimated remaining: 3h 33m 35s. Rate: 7.9 symbols/min [2025-10-30T18:26:02.505893] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-30T18:26:02.515075] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-30T18:26:03.621077] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T18:26:03.630020] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-30T18:26:04.620392] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T18:26:04.627355] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-30T18:26:05.600756] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-30T18:26:05.607940] [INFO ] [REMOTE ] EB: Full fetch complete (54351 records). [2025-10-30T18:26:05.608072] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-30T18:26:05.988377] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-30T18:26:05.988458] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-30T18:26:05.989141] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-30T18:26:05.989204] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-30T18:26:05.990340] [DEBUG] [LOCAL ] EB: Trimmed 54351 records to 35765 (keeping 200 days of data) [2025-10-30T18:26:06.183874] [DEBUG] [LOCAL ] EB: Primary data saved (35765 records). [2025-10-30T18:26:06.184007] [INFO ] [MAIN ] EB: Full history saved. [2025-10-30T18:26:06.184084] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EB took 32.6s. Estimated remaining: 3h 33m 23s. Rate: 7.9 symbols/min [2025-10-30T18:26:06.830815] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:06.854797] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:06.902131] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:06.930990] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:06.970429] [DEBUG] [LOCAL ] ECAT: Loaded 28853 existing records from primary storage. [2025-10-30T18:26:06.970863] [INFO ] [MAIN ] ECAT: Loaded 28853 existing records. [2025-10-30T18:26:07.110262] [DEBUG] [LOCAL ] EC: Loaded 48692 existing records from primary storage. [2025-10-30T18:26:07.127628] [INFO ] [MAIN ] EC: Loaded 48692 existing records. [2025-10-30T18:26:07.211013] [DEBUG] [LOCAL ] EBR: Loaded 43166 existing records from primary storage. [2025-10-30T18:26:07.216947] [DEBUG] [LOCAL ] EBS: Loaded 46494 existing records from primary storage. [2025-10-30T18:26:07.243734] [INFO ] [MAIN ] EBS: Loaded 46494 existing records. [2025-10-30T18:26:07.293729] [INFO ] [MAIN ] EBR: Loaded 43166 existing records. [2025-10-30T18:26:07.321488] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:26:07.431822] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-30T18:26:07.470098] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-30T18:26:07.554719] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-30T18:26:07.579139] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-30T18:26:07.764297] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:26:07.830330] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:26:07.835600] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-30T18:26:07.846089] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-30T18:26:07.847097] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-30T18:26:07.881701] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:26:07.893127] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-30T18:26:07.893903] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-30T18:26:07.899257] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-30T18:26:07.920017] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-30T18:26:07.932810] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-30T18:26:07.920130] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-30T18:26:07.938052] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-30T18:26:07.958915] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-30T18:26:08.064483] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-30T18:26:09.008614] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:09.085907] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-30T18:26:09.178606] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:09.197976] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-30T18:26:09.326827] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:09.348806] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-30T18:26:09.348516] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:09.349103] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-30T18:26:10.260973] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T18:26:10.267754] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-30T18:26:10.462916] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T18:26:10.471830] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-30T18:26:10.610596] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:26:10.620178] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-30T18:26:10.711474] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T18:26:10.721306] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-30T18:26:11.240407] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T18:26:11.246908] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-30T18:26:11.571779] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T18:26:11.579613] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-30T18:26:11.770229] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T18:26:11.779314] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-30T18:26:11.928459] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T18:26:11.938248] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-30T18:26:12.258852] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T18:26:12.497492] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-30T18:26:12.754103] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T18:26:13.062357] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T18:26:13.165404] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:26:13.292173] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T18:26:13.297884] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-30T18:26:14.097495] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-30T18:26:14.810115] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-30T18:26:14.897492] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-30T18:26:15.394153] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T18:26:15.697501] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-30T18:26:16.509790] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-30T18:26:16.546072] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-30T18:26:16.679711] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-30T18:26:17.297509] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-30T18:26:17.827733] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T18:26:18.097495] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-30T18:26:18.612686] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T18:26:18.897528] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-30T18:26:19.264524] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-30T18:26:19.697604] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-30T18:26:20.263364] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:26:20.497522] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-30T18:26:21.297476] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-30T18:26:21.337607] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-30T18:26:21.697775] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T18:26:22.097521] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-30T18:26:22.452721] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T18:26:22.897538] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-30T18:26:23.362414] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:26:23.697472] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-30T18:26:23.740697] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-30T18:26:24.497535] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-30T18:26:24.974889] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T18:26:25.297520] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-30T18:26:25.761576] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:26:26.097512] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-30T18:26:26.263016] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-30T18:26:26.897539] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-30T18:26:27.707495] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-30T18:26:27.734972] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T18:26:27.745930] [INFO ] [REMOTE ] EC: Full fetch complete (71813 records). [2025-10-30T18:26:27.746049] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-30T18:26:28.122787] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-30T18:26:28.122861] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-30T18:26:28.123662] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-30T18:26:28.123729] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-30T18:26:28.124974] [DEBUG] [LOCAL ] EC: Trimmed 71813 records to 49037 (keeping 200 days of data) [2025-10-30T18:26:28.407593] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T18:26:28.448043] [DEBUG] [LOCAL ] EC: Primary data saved (49037 records). [2025-10-30T18:26:28.448304] [INFO ] [MAIN ] EC: Full history saved. [2025-10-30T18:26:28.448391] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. EC took 22.3s. Estimated remaining: 3h 33m 52s. Rate: 7.9 symbols/min [2025-10-30T18:26:28.502942] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-30T18:26:28.625267] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:28.661316] [DEBUG] [LOCAL ] ECC: Loaded 43003 existing records from primary storage. [2025-10-30T18:26:28.661590] [INFO ] [MAIN ] ECC: Loaded 43003 existing records. [2025-10-30T18:26:28.848217] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:26:28.859789] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-30T18:26:28.860115] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-30T18:26:28.861456] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T18:26:28.861499] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-30T18:26:28.868357] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-30T18:26:29.219800] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:29.297473] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-30T18:26:29.868883] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-30T18:26:30.097564] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-30T18:26:30.558115] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:26:30.897509] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-30T18:26:31.507256] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T18:26:31.697601] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-30T18:26:32.123581] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T18:26:32.130064] [INFO ] [REMOTE ] ECAT: Full fetch complete (42767 records). [2025-10-30T18:26:32.130200] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-30T18:26:32.505766] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-30T18:26:32.517497] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-30T18:26:32.517563] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-30T18:26:32.518250] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-30T18:26:32.518414] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-30T18:26:32.519449] [DEBUG] [LOCAL ] ECAT: Trimmed 42767 records to 29095 (keeping 200 days of data) [2025-10-30T18:26:32.695786] [DEBUG] [LOCAL ] ECAT: Primary data saved (29095 records). [2025-10-30T18:26:32.695913] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-30T18:26:32.695993] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. ECAT took 26.5s. Estimated remaining: 3h 33m 36s. Rate: 7.9 symbols/min [2025-10-30T18:26:32.876136] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:32.876319] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-30T18:26:32.876473] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-30T18:26:32.876615] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-30T18:26:32.876735] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-30T18:26:32.876871] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-30T18:26:32.876943] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-30T18:26:33.023991] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T18:26:33.259672] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:33.297473] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-30T18:26:33.618819] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-30T18:26:34.097469] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-30T18:26:34.137294] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T18:26:34.147482] [INFO ] [REMOTE ] EBS: Full fetch complete (67463 records). [2025-10-30T18:26:34.147600] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-30T18:26:34.386116] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T18:26:34.532314] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-30T18:26:34.532392] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-30T18:26:34.533171] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-30T18:26:34.533234] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-30T18:26:34.534451] [DEBUG] [LOCAL ] EBS: Trimmed 67463 records to 46884 (keeping 200 days of data) [2025-10-30T18:26:34.785491] [DEBUG] [LOCAL ] EBS: Primary data saved (46884 records). [2025-10-30T18:26:34.785613] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-30T18:26:34.785729] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EBS took 28.6s. Estimated remaining: 3h 33m 15s. Rate: 7.9 symbols/min [2025-10-30T18:26:34.902702] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-30T18:26:34.954715] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:34.955112] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-30T18:26:34.955168] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-30T18:26:34.955279] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-30T18:26:34.955321] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-30T18:26:34.955360] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-30T18:26:34.955390] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-30T18:26:35.298993] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:35.697500] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-30T18:26:36.346765] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T18:26:36.497481] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-30T18:26:37.078522] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T18:26:37.297562] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-30T18:26:37.529297] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-30T18:26:37.653845] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T18:26:38.097498] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-30T18:26:38.576982] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-30T18:26:38.897516] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-30T18:26:39.123498] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-30T18:26:39.697497] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-30T18:26:40.497510] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-30T18:26:40.793813] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-30T18:26:41.051003] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T18:26:41.297475] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-30T18:26:42.097591] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-30T18:26:42.365199] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-30T18:26:42.642849] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T18:26:42.897493] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-30T18:26:43.697498] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-30T18:26:44.085900] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-30T18:26:44.202553] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:26:44.497503] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-30T18:26:45.297554] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-30T18:26:45.634445] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-30T18:26:45.704542] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T18:26:46.097511] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-30T18:26:46.449677] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-30T18:26:46.897496] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-30T18:26:47.697513] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-30T18:26:47.917223] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-30T18:26:48.250860] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T18:26:48.497533] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-30T18:26:48.730800] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-30T18:26:49.297511] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-30T18:26:49.552780] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-30T18:26:50.097498] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-30T18:26:50.478546] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-30T18:26:50.479374] [INFO ] [REMOTE ] ECCC: Full fetch complete (1303 records). [2025-10-30T18:26:50.479442] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-30T18:26:50.479806] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:26:50.479888] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:26:50.479930] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:26:50.479970] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-30T18:26:50.480023] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-30T18:26:50.480058] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-30T18:26:50.480097] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-30T18:26:50.480148] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. ECCC took 17.8s. Estimated remaining: 3h 33m 27s. Rate: 7.9 symbols/min [2025-10-30T18:26:50.650530] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:50.650749] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-30T18:26:50.650796] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-30T18:26:50.650911] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-30T18:26:50.650974] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-30T18:26:50.651015] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-30T18:26:50.651045] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-30T18:26:50.902553] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-30T18:26:51.034519] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:51.324558] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-30T18:26:51.697477] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-30T18:26:52.497523] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-30T18:26:52.909458] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T18:26:53.194865] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T18:26:53.208017] [INFO ] [REMOTE ] EBR: Full fetch complete (62360 records). [2025-10-30T18:26:53.208184] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-30T18:26:53.302748] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-30T18:26:53.613936] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-30T18:26:53.614044] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-30T18:26:53.614822] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-30T18:26:53.614884] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-30T18:26:53.616099] [DEBUG] [LOCAL ] EBR: Trimmed 62360 records to 43489 (keeping 200 days of data) [2025-10-30T18:26:53.724767] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-30T18:26:53.868326] [DEBUG] [LOCAL ] EBR: Primary data saved (43489 records). [2025-10-30T18:26:53.868453] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-30T18:26:53.869431] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. EBR took 47.7s. Estimated remaining: 3h 33m 9s. Rate: 7.9 symbols/min [2025-10-30T18:26:54.039885] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:26:54.040070] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-30T18:26:54.040108] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-30T18:26:54.040238] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-30T18:26:54.040282] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-30T18:26:54.040324] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-30T18:26:54.040357] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-30T18:26:54.103069] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-30T18:26:54.389041] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T18:26:54.410286] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:26:54.897483] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-30T18:26:55.279291] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T18:26:55.697525] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-30T18:26:55.930262] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-30T18:26:56.497506] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-30T18:26:56.783876] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-30T18:26:57.297511] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-30T18:26:58.097524] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-30T18:26:58.329139] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-30T18:26:58.693794] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:26:58.897507] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-30T18:26:59.697526] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-30T18:26:59.987036] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-30T18:27:00.314567] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T18:27:00.497496] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-30T18:27:00.847348] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-30T18:27:01.297498] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-30T18:27:02.097495] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-30T18:27:02.395895] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-30T18:27:02.812377] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T18:27:02.821539] [INFO ] [REMOTE ] ECC: Full fetch complete (61374 records). [2025-10-30T18:27:02.821694] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-30T18:27:02.822418] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:27:02.822507] [FATAL] [MAIN ] ECC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:27:02.822552] [WARN ] [MAIN ] ECC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:27:02.822589] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-30T18:27:02.822665] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-30T18:27:02.822723] [INFO ] [LOCAL ] ECC: Starting deletion of derivative data. [2025-10-30T18:27:02.822871] [DEBUG] [LOCAL ] ECC: Deleted derivative data file. [2025-10-30T18:27:02.823875] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECC took 34.4s. Estimated remaining: 3h 33m 5s. Rate: 7.9 symbols/min [2025-10-30T18:27:02.902598] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-30T18:27:03.007447] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:03.007614] [DEBUG] [LOCAL ] ECG: No existing data file found in primary storage. [2025-10-30T18:27:03.007680] [WARN ] [MAIN ] ECG: No existing data found, performing full refresh instead. [2025-10-30T18:27:03.007799] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-30T18:27:03.007841] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-30T18:27:03.007882] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-30T18:27:03.007915] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-30T18:27:03.349216] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-30T18:27:03.513397] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:03.697573] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-30T18:27:04.127992] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-30T18:27:04.497500] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-30T18:27:04.876257] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T18:27:05.297531] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-30T18:27:06.097499] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-30T18:27:06.399846] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-30T18:27:06.466073] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T18:27:06.897500] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-30T18:27:07.234260] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T18:27:07.697500] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-30T18:27:08.030764] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-30T18:27:08.497529] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-30T18:27:09.297533] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-30T18:27:09.532985] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T18:27:09.545913] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-30T18:27:10.097528] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-30T18:27:10.485375] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-30T18:27:10.486440] [INFO ] [REMOTE ] ECCU: Full fetch complete (3936 records). [2025-10-30T18:27:10.486515] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-30T18:27:10.874835] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-30T18:27:10.874914] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-30T18:27:10.875080] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-30T18:27:10.875120] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-30T18:27:10.875464] [DEBUG] [LOCAL ] ECCU: Trimmed 3936 records to 2074 (keeping 200 days of data) [2025-10-30T18:27:10.888316] [DEBUG] [LOCAL ] ECCU: Primary data saved (2074 records). [2025-10-30T18:27:10.888433] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-30T18:27:10.888510] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECCU took 36.1s. Estimated remaining: 3h 32m 58s. Rate: 7.9 symbols/min [2025-10-30T18:27:10.902710] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-30T18:27:11.064667] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:11.106241] [DEBUG] [LOCAL ] ECL: Loaded 46668 existing records from primary storage. [2025-10-30T18:27:11.106576] [INFO ] [MAIN ] ECL: Loaded 46668 existing records. [2025-10-30T18:27:11.255070] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-30T18:27:11.296717] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:27:11.296927] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-30T18:27:11.296976] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-30T18:27:11.297871] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-30T18:27:11.297928] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-30T18:27:11.662846] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:11.697497] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-30T18:27:11.939116] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-30T18:27:12.497501] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-30T18:27:12.778983] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-30T18:27:13.297585] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-30T18:27:13.865967] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-30T18:27:13.867439] [INFO ] [REMOTE ] ECCW: Full fetch complete (1419 records). [2025-10-30T18:27:13.867567] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-30T18:27:14.061463] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-30T18:27:14.061766] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:27:14.061844] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:27:14.061934] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-30T18:27:14.062021] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-30T18:27:14.062109] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-30T18:27:14.062174] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-30T18:27:14.062252] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCW took 23.6s. Estimated remaining: 3h 32m 40s. Rate: 7.9 symbols/min [2025-10-30T18:27:14.102671] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-30T18:27:14.246189] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:14.265066] [DEBUG] [LOCAL ] ECO: Loaded 17965 existing records from primary storage. [2025-10-30T18:27:14.265398] [INFO ] [MAIN ] ECO: Loaded 17965 existing records. [2025-10-30T18:27:14.450213] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:27:14.450518] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-30T18:27:14.450570] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-30T18:27:14.451073] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-30T18:27:14.451130] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-30T18:27:14.826000] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:14.897538] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-30T18:27:15.368363] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T18:27:15.697500] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-30T18:27:15.923076] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-30T18:27:16.394260] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T18:27:16.497524] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-30T18:27:17.297497] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-30T18:27:17.694725] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T18:27:18.097497] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-30T18:27:18.538717] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T18:27:18.897462] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-30T18:27:18.932455] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T18:27:19.697511] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-30T18:27:20.024582] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T18:27:20.497513] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-30T18:27:20.906495] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-30T18:27:21.088153] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T18:27:21.297509] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-30T18:27:22.097480] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-30T18:27:22.207678] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-30T18:27:22.897504] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-30T18:27:23.520341] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T18:27:23.697522] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-30T18:27:23.806606] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T18:27:24.497546] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-30T18:27:25.076098] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T18:27:25.297471] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-30T18:27:25.417908] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-30T18:27:25.621393] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-30T18:27:25.622154] [INFO ] [REMOTE ] ECCX: Full fetch complete (1433 records). [2025-10-30T18:27:25.622221] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-30T18:27:25.799098] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-30T18:27:25.799303] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:27:25.799373] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:27:25.799424] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-30T18:27:25.799480] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-30T18:27:25.799515] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-30T18:27:25.799555] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-30T18:27:25.799611] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECCX took 31.9s. Estimated remaining: 3h 32m 42s. Rate: 7.9 symbols/min [2025-10-30T18:27:25.967694] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:25.967893] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-30T18:27:25.967938] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-30T18:27:25.968044] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-30T18:27:25.968084] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-30T18:27:25.968124] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-30T18:27:25.968157] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-30T18:27:26.103693] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-30T18:27:26.322180] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:26.897504] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-30T18:27:27.146055] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T18:27:27.697530] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-30T18:27:28.334314] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-30T18:27:28.504321] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-30T18:27:28.508704] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T18:27:29.297507] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-30T18:27:29.789876] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T18:27:30.097541] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-30T18:27:30.155502] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T18:27:30.897473] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-30T18:27:31.052094] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T18:27:31.697535] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-30T18:27:32.190385] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T18:27:32.497477] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-30T18:27:32.564096] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T18:27:33.297510] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-30T18:27:33.764922] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T18:27:33.772181] [INFO ] [REMOTE ] ECG: Full fetch complete (50829 records). [2025-10-30T18:27:33.772298] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-30T18:27:34.098774] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-30T18:27:34.196426] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T18:27:34.217670] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-30T18:27:34.218252] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-30T18:27:34.219492] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-30T18:27:34.219566] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-30T18:27:34.221019] [DEBUG] [LOCAL ] ECG: Trimmed 50829 records to 32474 (keeping 200 days of data) [2025-10-30T18:27:34.416217] [DEBUG] [LOCAL ] ECG: Primary data saved (32474 records). [2025-10-30T18:27:34.416394] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-30T18:27:34.416485] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECG took 31.6s. Estimated remaining: 3h 32m 37s. Rate: 7.9 symbols/min [2025-10-30T18:27:34.586024] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:34.633331] [DEBUG] [LOCAL ] ED: Loaded 52469 existing records from primary storage. [2025-10-30T18:27:34.633681] [INFO ] [MAIN ] ED: Loaded 52469 existing records. [2025-10-30T18:27:34.809922] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:27:34.810157] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-30T18:27:34.810205] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-30T18:27:34.810901] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-30T18:27:34.810959] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-30T18:27:34.902865] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-30T18:27:35.167928] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:35.189167] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T18:27:35.697517] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-30T18:27:35.852348] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T18:27:36.497526] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-30T18:27:37.061888] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T18:27:37.297505] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-30T18:27:37.709091] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T18:27:38.097501] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-30T18:27:38.612257] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-30T18:27:38.897554] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-30T18:27:39.141196] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-30T18:27:39.697509] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-30T18:27:40.414308] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-30T18:27:40.497522] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-30T18:27:41.175250] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T18:27:41.195671] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-30T18:27:41.297454] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-30T18:27:42.097501] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-30T18:27:42.810124] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T18:27:42.820606] [INFO ] [REMOTE ] ECL: Full fetch complete (68084 records). [2025-10-30T18:27:42.820764] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-30T18:27:42.821451] [FATAL] [VALIDATOR ] ECL: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:27:42.821542] [FATAL] [MAIN ] ECL: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:27:42.821585] [WARN ] [MAIN ] ECL: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:27:42.821681] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-30T18:27:42.821785] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-10-30T18:27:42.821840] [INFO ] [LOCAL ] ECL: Starting deletion of derivative data. [2025-10-30T18:27:42.822027] [DEBUG] [LOCAL ] ECL: Deleted derivative data file. [2025-10-30T18:27:42.822118] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECL took 31.9s. Estimated remaining: 3h 32m 31s. Rate: 7.9 symbols/min [2025-10-30T18:27:42.902583] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-30T18:27:43.029236] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:43.053743] [DEBUG] [LOCAL ] EDD: Loaded 26792 existing records from primary storage. [2025-10-30T18:27:43.054019] [INFO ] [MAIN ] EDD: Loaded 26792 existing records. [2025-10-30T18:27:43.235898] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:27:43.236191] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-30T18:27:43.236244] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-30T18:27:43.236843] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-30T18:27:43.236901] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-30T18:27:43.612821] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:43.614932] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T18:27:43.697459] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-30T18:27:43.761146] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-30T18:27:44.497509] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-30T18:27:44.821815] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T18:27:45.290624] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-30T18:27:45.297449] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-30T18:27:46.097522] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-30T18:27:46.325075] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-30T18:27:46.330415] [INFO ] [REMOTE ] ECO: Full fetch complete (28267 records). [2025-10-30T18:27:46.330553] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-30T18:27:46.727424] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-30T18:27:46.727549] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-30T18:27:46.728423] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-30T18:27:46.728489] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-30T18:27:46.729424] [DEBUG] [LOCAL ] ECO: Trimmed 28267 records to 18271 (keeping 200 days of data) [2025-10-30T18:27:46.850237] [DEBUG] [LOCAL ] ECO: Primary data saved (18271 records). [2025-10-30T18:27:46.850464] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-30T18:27:46.850597] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECO took 32.8s. Estimated remaining: 3h 32m 15s. Rate: 7.9 symbols/min [2025-10-30T18:27:46.908857] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-30T18:27:47.041323] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:47.057007] [DEBUG] [LOCAL ] EDF: Loaded 12631 existing records from primary storage. [2025-10-30T18:27:47.057316] [INFO ] [MAIN ] EDF: Loaded 12631 existing records. [2025-10-30T18:27:47.247959] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:27:47.248307] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-30T18:27:47.248360] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-30T18:27:47.248749] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-30T18:27:47.248809] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-30T18:27:47.636030] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:47.683546] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-30T18:27:47.697448] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-30T18:27:48.362254] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T18:27:48.497507] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-30T18:27:49.253512] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-30T18:27:49.280560] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T18:27:49.297480] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-30T18:27:50.046730] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T18:27:50.097515] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-30T18:27:50.897519] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-30T18:27:51.533447] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-30T18:27:51.602405] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T18:27:51.697493] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-30T18:27:52.497521] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-30T18:27:53.297509] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-30T18:27:53.426797] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-30T18:27:53.709759] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T18:27:54.097468] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-30T18:27:54.246771] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T18:27:54.897507] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-30T18:27:55.331457] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T18:27:55.697553] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-30T18:27:55.761303] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T18:27:56.497574] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-30T18:27:57.079134] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T18:27:57.297506] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-30T18:27:57.869525] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T18:27:57.878314] [INFO ] [REMOTE ] ECVT: Full fetch complete (60490 records). [2025-10-30T18:27:57.878454] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-30T18:27:58.099829] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-30T18:27:58.284428] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-30T18:27:58.285506] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T18:27:58.285691] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-30T18:27:58.286742] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-30T18:27:58.292563] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-30T18:27:58.294619] [DEBUG] [LOCAL ] ECVT: Trimmed 60490 records to 42880 (keeping 200 days of data) [2025-10-30T18:27:58.527570] [DEBUG] [LOCAL ] ECVT: Primary data saved (42880 records). [2025-10-30T18:27:58.527715] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-30T18:27:58.527796] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ECVT took 32.7s. Estimated remaining: 3h 32m 17s. Rate: 7.9 symbols/min [2025-10-30T18:27:58.695274] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:27:58.695421] [DEBUG] [LOCAL ] EDN: No existing data file found in primary storage. [2025-10-30T18:27:58.695459] [WARN ] [MAIN ] EDN: No existing data found, performing full refresh instead. [2025-10-30T18:27:58.695567] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-30T18:27:58.695609] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-30T18:27:58.695676] [DEBUG] [LOCAL ] EDN: No primary data file found to delete. [2025-10-30T18:27:58.695729] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-30T18:27:58.906488] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-30T18:27:59.056849] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:27:59.599139] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-30T18:27:59.697506] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-30T18:27:59.931275] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T18:28:00.497503] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-30T18:28:01.012866] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T18:28:01.297518] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-30T18:28:02.097497] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-30T18:28:02.153350] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T18:28:02.240778] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T18:28:02.252359] [INFO ] [REMOTE ] ED: Full fetch complete (76309 records). [2025-10-30T18:28:02.252505] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-30T18:28:02.667718] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-30T18:28:02.667810] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-30T18:28:02.668682] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-30T18:28:02.668747] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-30T18:28:02.670225] [DEBUG] [LOCAL ] ED: Trimmed 76309 records to 52854 (keeping 200 days of data) [2025-10-30T18:28:02.898567] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-30T18:28:02.921331] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T18:28:03.018690] [DEBUG] [LOCAL ] ED: Primary data saved (52854 records). [2025-10-30T18:28:03.018853] [INFO ] [MAIN ] ED: Full history saved. [2025-10-30T18:28:03.019600] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. ED took 28.6s. Estimated remaining: 3h 32m 2s. Rate: 7.9 symbols/min [2025-10-30T18:28:03.201562] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:28:03.241116] [DEBUG] [LOCAL ] EDU: Loaded 44586 existing records from primary storage. [2025-10-30T18:28:03.241418] [INFO ] [MAIN ] EDU: Loaded 44586 existing records. [2025-10-30T18:28:03.414580] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:28:03.414811] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-30T18:28:03.414874] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-30T18:28:03.415608] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-30T18:28:03.415701] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-30T18:28:03.702632] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-30T18:28:03.776090] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:28:03.856563] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T18:28:04.360882] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-30T18:28:04.497506] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-30T18:28:05.297498] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-30T18:28:05.955567] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T18:28:05.976992] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T18:28:06.097490] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-30T18:28:06.899819] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-30T18:28:06.903247] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-30T18:28:07.697491] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-30T18:28:08.251732] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T18:28:08.272364] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-30T18:28:08.497491] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-30T18:28:09.190588] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T18:28:09.297471] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-30T18:28:09.879456] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-30T18:28:10.097483] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-30T18:28:10.822752] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T18:28:10.897473] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-30T18:28:11.697510] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-30T18:28:12.350028] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-30T18:28:12.497524] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-30T18:28:12.657951] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-30T18:28:13.297473] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-30T18:28:13.318716] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-30T18:28:14.097547] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-30T18:28:14.803914] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-30T18:28:14.897487] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-30T18:28:15.144308] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-30T18:28:15.494878] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-30T18:28:15.697518] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-30T18:28:16.497509] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-30T18:28:16.545458] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T18:28:17.180326] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T18:28:17.184439] [INFO ] [REMOTE ] EDF: Full fetch complete (19799 records). [2025-10-30T18:28:17.184707] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-30T18:28:17.305727] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-30T18:28:17.607226] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-30T18:28:17.607329] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-30T18:28:17.608009] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-30T18:28:17.608076] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-30T18:28:17.608980] [DEBUG] [LOCAL ] EDF: Trimmed 19799 records to 12737 (keeping 200 days of data) [2025-10-30T18:28:17.682734] [DEBUG] [LOCAL ] EDF: Primary data saved (12737 records). [2025-10-30T18:28:17.682865] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-30T18:28:17.682941] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. EDF took 30.8s. Estimated remaining: 3h 32m 11s. Rate: 7.9 symbols/min [2025-10-30T18:28:17.863429] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:28:17.893474] [DEBUG] [LOCAL ] EE: Loaded 32404 existing records from primary storage. [2025-10-30T18:28:17.893774] [INFO ] [MAIN ] EE: Loaded 32404 existing records. [2025-10-30T18:28:18.074941] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:28:18.075209] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-30T18:28:18.075261] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-30T18:28:18.075927] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-30T18:28:18.076121] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-30T18:28:18.106058] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-30T18:28:18.186031] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T18:28:18.455851] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:28:18.897490] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-30T18:28:19.391459] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T18:28:19.697505] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-30T18:28:19.866801] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T18:28:20.497511] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-30T18:28:20.877692] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T18:28:21.266931] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-30T18:28:21.297510] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-30T18:28:22.097489] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-30T18:28:22.207919] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-30T18:28:22.897508] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-30T18:28:23.124966] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T18:28:23.697530] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-30T18:28:23.813140] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-30T18:28:24.497560] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-30T18:28:24.667069] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T18:28:25.297539] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-30T18:28:25.381485] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T18:28:26.097556] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-30T18:28:26.477212] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T18:28:26.483447] [INFO ] [REMOTE ] EDN: Full fetch complete (29756 records). [2025-10-30T18:28:26.483571] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-30T18:28:26.856678] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-30T18:28:26.856783] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-30T18:28:26.857293] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-30T18:28:26.857336] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-30T18:28:26.858121] [DEBUG] [LOCAL ] EDN: Trimmed 29756 records to 20089 (keeping 200 days of data) [2025-10-30T18:28:26.904713] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-30T18:28:26.974435] [DEBUG] [LOCAL ] EDN: Primary data saved (20089 records). [2025-10-30T18:28:26.974542] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-30T18:28:26.974606] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. EDN took 28.4s. Estimated remaining: 3h 32m 8s. Rate: 7.9 symbols/min [2025-10-30T18:28:27.161986] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:28:27.162173] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-30T18:28:27.162210] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-30T18:28:27.162323] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-30T18:28:27.162364] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-30T18:28:27.162404] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-30T18:28:27.162435] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-30T18:28:27.521452] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:28:27.555868] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:28:27.697543] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-30T18:28:27.933404] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T18:28:28.111415] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T18:28:28.497468] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-30T18:28:29.274729] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T18:28:29.297461] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-30T18:28:30.097551] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-30T18:28:30.573722] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T18:28:30.897518] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-30T18:28:31.193920] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T18:28:31.443843] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T18:28:31.697507] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-30T18:28:32.497519] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-30T18:28:32.836688] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T18:28:33.297555] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-30T18:28:33.703520] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T18:28:33.709176] [INFO ] [REMOTE ] EDD: Full fetch complete (38692 records). [2025-10-30T18:28:33.709269] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-30T18:28:33.709847] [FATAL] [VALIDATOR ] EDD: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:28:33.709927] [FATAL] [MAIN ] EDD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:28:33.709969] [WARN ] [MAIN ] EDD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:28:33.710006] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-30T18:28:33.710061] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-30T18:28:33.710095] [INFO ] [LOCAL ] EDD: Starting deletion of derivative data. [2025-10-30T18:28:33.710268] [DEBUG] [LOCAL ] EDD: Deleted derivative data file. [2025-10-30T18:28:33.710371] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EDD took 50.9s. Estimated remaining: 3h 31m 58s. Rate: 7.9 symbols/min [2025-10-30T18:28:33.880008] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:28:33.890213] [DEBUG] [LOCAL ] EEX: Loaded 9289 existing records from primary storage. [2025-10-30T18:28:33.890427] [INFO ] [MAIN ] EEX: Loaded 9289 existing records. [2025-10-30T18:28:34.068526] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:28:34.068778] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-30T18:28:34.068829] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-30T18:28:34.069153] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-30T18:28:34.069210] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-30T18:28:34.102719] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-30T18:28:34.468773] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:28:34.483823] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T18:28:34.490839] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-30T18:28:34.897509] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-30T18:28:35.657024] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T18:28:35.697504] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-30T18:28:36.497536] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-30T18:28:36.952159] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T18:28:36.983728] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T18:28:37.297547] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-30T18:28:38.097516] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-30T18:28:38.834903] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T18:28:38.887600] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T18:28:38.902920] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-30T18:28:38.905203] [INFO ] [REMOTE ] EDU: Full fetch complete (67153 records). [2025-10-30T18:28:38.905434] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-30T18:28:39.369115] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-30T18:28:39.369207] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-30T18:28:39.370041] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-30T18:28:39.370109] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-30T18:28:39.371465] [DEBUG] [LOCAL ] EDU: Trimmed 67153 records to 44960 (keeping 200 days of data) [2025-10-30T18:28:39.626940] [DEBUG] [LOCAL ] EDU: Primary data saved (44960 records). [2025-10-30T18:28:39.627066] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-30T18:28:39.627806] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EDU took 36.6s. Estimated remaining: 3h 31m 46s. Rate: 7.9 symbols/min [2025-10-30T18:28:39.701075] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-30T18:28:39.805712] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:28:39.820731] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-30T18:28:39.865529] [DEBUG] [LOCAL ] EFC: Loaded 46106 existing records from primary storage. [2025-10-30T18:28:39.865882] [INFO ] [MAIN ] EFC: Loaded 46106 existing records. [2025-10-30T18:28:40.037976] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:28:40.038212] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-30T18:28:40.038260] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-30T18:28:40.039413] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-30T18:28:40.039472] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-30T18:28:40.422892] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:28:40.497475] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-30T18:28:41.157068] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T18:28:41.164610] [INFO ] [REMOTE ] EE: Full fetch complete (44762 records). [2025-10-30T18:28:41.164753] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-30T18:28:41.303374] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-30T18:28:41.548142] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-30T18:28:41.548216] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-30T18:28:41.548848] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-30T18:28:41.548911] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-30T18:28:41.549828] [DEBUG] [LOCAL ] EE: Trimmed 44762 records to 32636 (keeping 200 days of data) [2025-10-30T18:28:41.751234] [DEBUG] [LOCAL ] EE: Primary data saved (32636 records). [2025-10-30T18:28:41.751515] [INFO ] [MAIN ] EE: Full history saved. [2025-10-30T18:28:41.751692] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EE took 24.1s. Estimated remaining: 3h 31m 26s. Rate: 7.9 symbols/min [2025-10-30T18:28:41.882425] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T18:28:41.865327] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T18:28:41.971236] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:28:41.987568] [DEBUG] [LOCAL ] EFR: Loaded 14592 existing records from primary storage. [2025-10-30T18:28:41.987865] [INFO ] [MAIN ] EFR: Loaded 14592 existing records. [2025-10-30T18:28:42.102702] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-30T18:28:42.171129] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:28:42.171392] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-30T18:28:42.171475] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-30T18:28:42.171796] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-30T18:28:42.171872] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-30T18:28:42.549704] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:28:42.897570] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-30T18:28:43.218987] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-30T18:28:43.533467] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T18:28:43.697563] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-30T18:28:44.497502] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-30T18:28:44.828408] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-30T18:28:45.176297] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T18:28:45.297503] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-30T18:28:46.097499] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-30T18:28:46.731694] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T18:28:46.738470] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T18:28:46.897509] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-30T18:28:47.511948] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T18:28:47.697516] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-30T18:28:48.229407] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-30T18:28:48.497498] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-30T18:28:49.297505] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-30T18:28:49.371058] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T18:28:49.697453] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T18:28:50.097494] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-30T18:28:50.498347] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-30T18:28:50.499333] [INFO ] [REMOTE ] EEA: Full fetch complete (3717 records). [2025-10-30T18:28:50.499402] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-30T18:28:50.672107] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T18:28:50.672317] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:28:50.672385] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:28:50.672456] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-30T18:28:50.672517] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-30T18:28:50.672552] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-30T18:28:50.672590] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-30T18:28:50.672665] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EEA took 23.7s. Estimated remaining: 3h 31m 21s. Rate: 7.9 symbols/min [2025-10-30T18:28:50.837304] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:28:50.849513] [DEBUG] [LOCAL ] EFT: Loaded 12550 existing records from primary storage. [2025-10-30T18:28:50.849740] [INFO ] [MAIN ] EFT: Loaded 12550 existing records. [2025-10-30T18:28:50.902700] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-30T18:28:51.024558] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:28:51.024776] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-30T18:28:51.024864] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-30T18:28:51.025186] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-30T18:28:51.025243] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-30T18:28:51.379200] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:28:51.697503] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-30T18:28:52.253496] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T18:28:52.439748] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T18:28:52.497492] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-30T18:28:53.297507] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-30T18:28:53.659726] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T18:28:53.724614] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-30T18:28:54.097546] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-30T18:28:54.724601] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T18:28:54.897492] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-30T18:28:55.380837] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-30T18:28:55.697464] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-30T18:28:56.327196] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-30T18:28:56.497540] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-30T18:28:57.297513] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-30T18:28:57.866916] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:28:57.959473] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T18:28:58.097478] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-30T18:28:58.635367] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T18:28:58.897474] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-30T18:28:59.534289] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T18:28:59.697508] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-30T18:29:00.309344] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-30T18:29:00.497497] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-30T18:29:01.297542] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-30T18:29:01.916309] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T18:29:02.097712] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-30T18:29:02.237303] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T18:29:02.787500] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T18:29:02.897485] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-30T18:29:03.621265] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-30T18:29:03.623366] [INFO ] [REMOTE ] EEX: Full fetch complete (17905 records). [2025-10-30T18:29:03.623440] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-30T18:29:03.623901] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:29:03.623980] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:29:03.624029] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:29:03.624093] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-30T18:29:03.624155] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-30T18:29:03.624189] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-10-30T18:29:03.624409] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-10-30T18:29:03.624492] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EEX took 29.9s. Estimated remaining: 3h 31m 26s. Rate: 7.9 symbols/min [2025-10-30T18:29:03.702671] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-30T18:29:03.844940] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:29:03.888073] [DEBUG] [LOCAL ] EFX: Loaded 44457 existing records from primary storage. [2025-10-30T18:29:03.888410] [INFO ] [MAIN ] EFX: Loaded 44457 existing records. [2025-10-30T18:29:04.099695] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:29:04.099894] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-30T18:29:04.099942] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-30T18:29:04.100857] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-30T18:29:04.100914] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-30T18:29:04.254518] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-30T18:29:04.490286] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:29:04.497452] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-30T18:29:05.297500] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-30T18:29:06.063376] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:29:06.097452] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-30T18:29:06.618887] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T18:29:06.897499] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-30T18:29:07.331326] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T18:29:07.343123] [INFO ] [REMOTE ] EFC: Full fetch complete (66888 records). [2025-10-30T18:29:07.343321] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-30T18:29:07.702575] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-30T18:29:07.695444] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T18:29:07.832757] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-30T18:29:07.832849] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-30T18:29:07.833624] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-30T18:29:07.833698] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-30T18:29:07.834952] [DEBUG] [LOCAL ] EFC: Trimmed 66888 records to 46468 (keeping 200 days of data) [2025-10-30T18:29:08.105543] [DEBUG] [LOCAL ] EFC: Primary data saved (46468 records). [2025-10-30T18:29:08.105712] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-30T18:29:08.106274] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EFC took 28.5s. Estimated remaining: 3h 31m 11s. Rate: 7.9 symbols/min [2025-10-30T18:29:08.263855] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T18:29:08.290546] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:29:08.317518] [DEBUG] [LOCAL ] EFXT: Loaded 29467 existing records from primary storage. [2025-10-30T18:29:08.317798] [INFO ] [MAIN ] EFXT: Loaded 29467 existing records. [2025-10-30T18:29:08.502594] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-30T18:29:08.510704] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:29:08.511068] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-30T18:29:08.511972] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-30T18:29:08.513522] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-30T18:29:08.513851] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-30T18:29:08.926822] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:29:09.123326] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T18:29:09.297553] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-30T18:29:10.097535] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-30T18:29:10.466039] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T18:29:10.897502] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-30T18:29:11.424749] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T18:29:11.633738] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T18:29:11.697546] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-30T18:29:12.379488] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T18:29:12.383305] [INFO ] [REMOTE ] EFR: Full fetch complete (19672 records). [2025-10-30T18:29:12.383399] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-30T18:29:12.383898] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:29:12.383981] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:29:12.384023] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:29:12.384061] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-30T18:29:12.384114] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-30T18:29:12.384151] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-10-30T18:29:12.384329] [DEBUG] [LOCAL ] EFR: Deleted derivative data file. [2025-10-30T18:29:12.384416] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFR took 30.6s. Estimated remaining: 3h 30m 56s. Rate: 7.9 symbols/min [2025-10-30T18:29:12.502752] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-30T18:29:12.552680] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:29:12.582578] [DEBUG] [LOCAL ] EG: Loaded 27336 existing records from primary storage. [2025-10-30T18:29:12.582948] [INFO ] [MAIN ] EG: Loaded 27336 existing records. [2025-10-30T18:29:12.758603] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:29:12.758892] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-30T18:29:12.758948] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-30T18:29:12.759252] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-30T18:29:12.759308] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-30T18:29:13.102836] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:29:13.297477] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-30T18:29:13.969908] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:29:14.097472] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-30T18:29:14.730442] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T18:29:14.897529] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-30T18:29:15.499789] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-30T18:29:15.697528] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-30T18:29:15.839980] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T18:29:16.497562] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-30T18:29:17.055070] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T18:29:17.297478] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-30T18:29:17.433616] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T18:29:18.097531] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-30T18:29:18.371325] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T18:29:18.897541] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-30T18:29:19.165340] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T18:29:19.697492] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-30T18:29:19.823223] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T18:29:20.497520] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-30T18:29:20.795296] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-30T18:29:21.297501] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-30T18:29:21.494872] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T18:29:22.055469] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T18:29:22.097477] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-30T18:29:22.744130] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-30T18:29:22.897482] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-30T18:29:23.697502] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-30T18:29:24.050951] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T18:29:24.497496] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-30T18:29:25.051285] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T18:29:25.297492] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-30T18:29:25.585440] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T18:29:26.097494] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-30T18:29:26.457964] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T18:29:26.897489] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-30T18:29:27.175897] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T18:29:27.697505] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-30T18:29:28.254961] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T18:29:28.296136] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T18:29:28.497565] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-30T18:29:29.084855] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-30T18:29:29.297512] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-30T18:29:29.915163] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T18:29:30.097488] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-30T18:29:30.897483] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-30T18:29:31.574633] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T18:29:31.577854] [INFO ] [REMOTE ] EFT: Full fetch complete (17726 records). [2025-10-30T18:29:31.577923] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-30T18:29:31.578309] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:29:31.578390] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:29:31.578432] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:29:31.578499] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-30T18:29:31.578559] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-30T18:29:31.578594] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-10-30T18:29:31.578790] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-10-30T18:29:31.578873] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EFT took 40.9s. Estimated remaining: 3h 31m 15s. Rate: 7.9 symbols/min [2025-10-30T18:29:31.701808] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-30T18:29:31.751180] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:29:31.787567] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T18:29:31.798914] [INFO ] [REMOTE ] EFX: Full fetch complete (65116 records). [2025-10-30T18:29:31.799116] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-30T18:29:32.055088] [DEBUG] [LOCAL ] EGO: Loaded 51692 existing records from primary storage. [2025-10-30T18:29:32.119051] [INFO ] [MAIN ] EGO: Loaded 51692 existing records. [2025-10-30T18:29:32.446131] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-30T18:29:32.445998] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:29:32.446314] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-30T18:29:32.447538] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-30T18:29:32.447736] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-30T18:29:32.447842] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-30T18:29:32.447943] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-30T18:29:32.448788] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-30T18:29:32.448900] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-30T18:29:32.502586] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-30T18:29:32.536829] [DEBUG] [LOCAL ] EFX: Trimmed 65116 records to 44790 (keeping 200 days of data) [2025-10-30T18:29:32.945256] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:29:33.058171] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T18:29:33.126678] [DEBUG] [LOCAL ] EFX: Primary data saved (44790 records). [2025-10-30T18:29:33.126804] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-30T18:29:33.126878] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EFX took 29.5s. Estimated remaining: 3h 30m 53s. Rate: 7.9 symbols/min [2025-10-30T18:29:33.290610] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:29:33.290800] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-30T18:29:33.290842] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-30T18:29:33.290949] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-30T18:29:33.290989] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-30T18:29:33.291029] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-30T18:29:33.291068] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-30T18:29:33.303497] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-30T18:29:33.529091] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T18:29:33.677112] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:29:34.097504] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-30T18:29:34.802273] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T18:29:34.897506] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-30T18:29:35.244847] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T18:29:35.697467] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-30T18:29:35.723209] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-30T18:29:36.497495] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-30T18:29:36.805283] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T18:29:37.297472] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-30T18:29:37.451111] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-30T18:29:38.042792] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-30T18:29:38.097470] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-30T18:29:38.897498] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-30T18:29:39.127950] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-30T18:29:39.133639] [INFO ] [REMOTE ] EG: Full fetch complete (42775 records). [2025-10-30T18:29:39.133760] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-30T18:29:39.504425] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-30T18:29:39.504494] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-30T18:29:39.505096] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-30T18:29:39.505158] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-30T18:29:39.505986] [DEBUG] [LOCAL ] EG: Trimmed 42775 records to 27650 (keeping 200 days of data) [2025-10-30T18:29:39.672363] [DEBUG] [LOCAL ] EG: Primary data saved (27650 records). [2025-10-30T18:29:39.672469] [INFO ] [MAIN ] EG: Full history saved. [2025-10-30T18:29:39.672539] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EG took 27.3s. Estimated remaining: 3h 30m 43s. Rate: 7.9 symbols/min [2025-10-30T18:29:39.697464] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-30T18:29:39.847547] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:29:39.847814] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-10-30T18:29:39.847939] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-10-30T18:29:39.848071] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-30T18:29:39.848124] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-30T18:29:39.848294] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-30T18:29:39.848422] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-30T18:29:39.957518] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T18:29:40.227093] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:29:40.497468] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-30T18:29:41.078019] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T18:29:41.297460] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-30T18:29:41.619066] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T18:29:42.097502] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-30T18:29:42.282317] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T18:29:42.897494] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-30T18:29:43.256776] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T18:29:43.697510] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-30T18:29:44.015137] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T18:29:44.497501] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-30T18:29:44.895105] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:29:45.297506] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-30T18:29:45.568166] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T18:29:45.576126] [INFO ] [REMOTE ] EFXT: Full fetch complete (44333 records). [2025-10-30T18:29:45.576244] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-30T18:29:45.956463] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-30T18:29:45.956541] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-30T18:29:45.957172] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-30T18:29:45.957234] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-30T18:29:45.958157] [DEBUG] [LOCAL ] EFXT: Trimmed 44333 records to 29717 (keeping 200 days of data) [2025-10-30T18:29:46.099598] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-30T18:29:46.129226] [DEBUG] [LOCAL ] EFXT: Primary data saved (29717 records). [2025-10-30T18:29:46.129405] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-30T18:29:46.129493] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EFXT took 38.0s. Estimated remaining: 3h 30m 33s. Rate: 7.9 symbols/min [2025-10-30T18:29:46.311299] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:29:46.339794] [DEBUG] [LOCAL ] EHAB: Loaded 28998 existing records from primary storage. [2025-10-30T18:29:46.340093] [INFO ] [MAIN ] EHAB: Loaded 28998 existing records. [2025-10-30T18:29:46.555844] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:29:46.556052] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-30T18:29:46.556100] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-30T18:29:46.556744] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-30T18:29:46.556833] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-30T18:29:46.898231] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-30T18:29:46.929005] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:29:46.964115] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-30T18:29:47.491803] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T18:29:47.697490] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-30T18:29:48.227874] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T18:29:48.497506] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-30T18:29:49.109272] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T18:29:49.297481] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-30T18:29:49.782211] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T18:29:50.097485] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-30T18:29:50.624469] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T18:29:50.897492] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-30T18:29:50.959217] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-30T18:29:51.697529] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-30T18:29:52.241238] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T18:29:52.497535] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-30T18:29:52.630985] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T18:29:53.297499] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-30T18:29:53.467338] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T18:29:54.097493] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-30T18:29:54.771342] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-30T18:29:54.801638] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T18:29:54.897494] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-30T18:29:55.697503] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-30T18:29:55.792764] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-30T18:29:56.497519] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-30T18:29:56.699776] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T18:29:57.292373] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T18:29:57.298232] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-30T18:29:58.097501] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-30T18:29:58.639703] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T18:29:58.897483] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-30T18:29:59.456898] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T18:29:59.697503] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-30T18:29:59.899322] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T18:30:00.497503] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-30T18:30:01.172251] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-30T18:30:01.297520] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-30T18:30:01.797082] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T18:30:02.097506] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-30T18:30:02.841149] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T18:30:02.897498] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-30T18:30:03.697495] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-30T18:30:04.037307] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-30T18:30:04.050163] [INFO ] [REMOTE ] EGO: Full fetch complete (74427 records). [2025-10-30T18:30:04.050290] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-30T18:30:04.051082] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:30:04.051170] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:30:04.051225] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:30:04.051307] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-30T18:30:04.051388] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-30T18:30:04.051442] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-10-30T18:30:04.051628] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-10-30T18:30:04.052739] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EGO took 32.5s. Estimated remaining: 3h 30m 49s. Rate: 7.9 symbols/min [2025-10-30T18:30:04.225046] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:04.269293] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:30:04.290819] [DEBUG] [LOCAL ] EHC: Loaded 40558 existing records from primary storage. [2025-10-30T18:30:04.291111] [INFO ] [MAIN ] EHC: Loaded 40558 existing records. [2025-10-30T18:30:04.468745] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:30:04.468972] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-30T18:30:04.469021] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-30T18:30:04.469681] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-30T18:30:04.469741] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-30T18:30:04.502729] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-30T18:30:04.827768] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:05.157998] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T18:30:05.164893] [INFO ] [REMOTE ] EGP: Full fetch complete (45482 records). [2025-10-30T18:30:05.165003] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-30T18:30:05.165756] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:30:05.165858] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:30:05.165930] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:30:05.166005] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-30T18:30:05.166070] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-30T18:30:05.166105] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-10-30T18:30:05.166147] [DEBUG] [LOCAL ] EGP: No derivative data file found to delete. [2025-10-30T18:30:05.166206] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGP took 32.0s. Estimated remaining: 3h 30m 27s. Rate: 7.9 symbols/min [2025-10-30T18:30:05.311734] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-30T18:30:05.343410] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:05.354228] [DEBUG] [LOCAL ] EHI: Loaded 10560 existing records from primary storage. [2025-10-30T18:30:05.354509] [INFO ] [MAIN ] EHI: Loaded 10560 existing records. [2025-10-30T18:30:05.531634] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:30:05.531874] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-30T18:30:05.531922] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-30T18:30:05.532259] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-30T18:30:05.532314] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-30T18:30:05.894974] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:06.050849] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-30T18:30:06.097509] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-30T18:30:06.675088] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T18:30:06.897487] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-30T18:30:07.440537] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T18:30:07.697459] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-30T18:30:07.721434] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T18:30:08.497544] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-30T18:30:08.636110] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T18:30:09.297531] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-30T18:30:09.919383] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T18:30:10.097514] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-30T18:30:10.304198] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-30T18:30:10.316474] [INFO ] [REMOTE ] EGY: Full fetch complete (60149 records). [2025-10-30T18:30:10.316698] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-30T18:30:10.317343] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:30:10.317427] [FATAL] [MAIN ] EGY: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:30:10.317486] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:30:10.317570] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-30T18:30:10.317672] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-30T18:30:10.317741] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-30T18:30:10.317802] [DEBUG] [LOCAL ] EGY: No derivative data file found to delete. [2025-10-30T18:30:10.317877] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EGY took 30.6s. Estimated remaining: 3h 30m 13s. Rate: 7.9 symbols/min [2025-10-30T18:30:10.487313] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:10.507601] [DEBUG] [LOCAL ] EIC: Loaded 21817 existing records from primary storage. [2025-10-30T18:30:10.507862] [INFO ] [MAIN ] EIC: Loaded 21817 existing records. [2025-10-30T18:30:10.689689] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:30:10.695692] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-30T18:30:10.696186] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-30T18:30:10.696444] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T18:30:10.697272] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-30T18:30:10.699358] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-30T18:30:10.906144] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-30T18:30:11.062916] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:11.491088] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-30T18:30:11.697523] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-30T18:30:12.497505] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-30T18:30:12.608176] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T18:30:13.297591] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-30T18:30:13.816476] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T18:30:13.964065] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T18:30:14.097492] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-30T18:30:14.648303] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T18:30:14.897499] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-30T18:30:15.697549] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-30T18:30:16.035371] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T18:30:16.497538] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-30T18:30:16.565392] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T18:30:17.060583] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-30T18:30:17.297489] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-30T18:30:18.097503] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-30T18:30:18.897540] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-30T18:30:19.108860] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-30T18:30:19.640533] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-30T18:30:19.666810] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-30T18:30:19.697483] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-30T18:30:20.497522] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-30T18:30:20.552490] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T18:30:21.297532] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-30T18:30:21.325124] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T18:30:22.097542] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-30T18:30:22.641040] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:30:22.897493] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-30T18:30:23.120456] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T18:30:23.697457] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-30T18:30:23.919898] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T18:30:24.497582] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-30T18:30:24.547056] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T18:30:25.297498] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-30T18:30:25.796892] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T18:30:25.802614] [INFO ] [REMOTE ] EHAB: Full fetch complete (41048 records). [2025-10-30T18:30:25.802740] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-30T18:30:26.103557] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-30T18:30:26.203272] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-30T18:30:26.203408] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-30T18:30:26.204064] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-30T18:30:26.204174] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-30T18:30:26.205284] [DEBUG] [LOCAL ] EHAB: Trimmed 41048 records to 29129 (keeping 200 days of data) [2025-10-30T18:30:26.331220] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T18:30:26.393821] [DEBUG] [LOCAL ] EHAB: Primary data saved (29129 records). [2025-10-30T18:30:26.393943] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-30T18:30:26.394019] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EHAB took 40.3s. Estimated remaining: 3h 30m 25s. Rate: 7.9 symbols/min [2025-10-30T18:30:26.560477] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:26.560665] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-30T18:30:26.560720] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-30T18:30:26.560838] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-30T18:30:26.560879] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-30T18:30:26.560919] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-30T18:30:26.560949] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-30T18:30:26.911273] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-30T18:30:26.916333] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:27.298891] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T18:30:27.620597] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T18:30:27.697472] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-30T18:30:28.497507] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-30T18:30:28.580236] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T18:30:29.297502] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-30T18:30:30.080812] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-30T18:30:30.097444] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-30T18:30:30.222840] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T18:30:30.897540] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-30T18:30:31.402384] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T18:30:31.697477] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-30T18:30:31.747635] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-30T18:30:31.751631] [INFO ] [REMOTE ] EIC: Full fetch complete (33603 records). [2025-10-30T18:30:31.751736] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-30T18:30:32.127864] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-30T18:30:32.127952] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-30T18:30:32.128586] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-30T18:30:32.128676] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-30T18:30:32.129595] [DEBUG] [LOCAL ] EIC: Trimmed 33603 records to 21909 (keeping 200 days of data) [2025-10-30T18:30:32.260293] [DEBUG] [LOCAL ] EIC: Primary data saved (21909 records). [2025-10-30T18:30:32.260416] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-30T18:30:32.260489] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EIC took 21.9s. Estimated remaining: 3h 30m 14s. Rate: 7.9 symbols/min [2025-10-30T18:30:32.427097] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:32.427227] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-30T18:30:32.427264] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-30T18:30:32.427367] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-30T18:30:32.427408] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-30T18:30:32.427447] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-30T18:30:32.427481] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-30T18:30:32.502709] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-30T18:30:32.788400] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:32.808939] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T18:30:32.974174] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-30T18:30:33.297507] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-30T18:30:33.479824] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.18 seconds). [2025-10-30T18:30:34.097533] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-30T18:30:34.590798] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T18:30:34.897570] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-30T18:30:35.166945] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-30T18:30:35.697485] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-30T18:30:35.924266] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-30T18:30:36.497489] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-30T18:30:36.734712] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-30T18:30:37.297530] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-30T18:30:38.097544] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-30T18:30:38.507705] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-30T18:30:38.569821] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T18:30:38.578464] [INFO ] [REMOTE ] EHC: Full fetch complete (58928 records). [2025-10-30T18:30:38.578582] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-30T18:30:38.915265] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-30T18:30:38.990007] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-30T18:30:38.990144] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-30T18:30:38.991538] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-30T18:30:38.992237] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-30T18:30:38.993801] [DEBUG] [LOCAL ] EHC: Trimmed 58928 records to 40933 (keeping 200 days of data) [2025-10-30T18:30:39.272684] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-30T18:30:39.339959] [DEBUG] [LOCAL ] EHC: Primary data saved (40933 records). [2025-10-30T18:30:39.340154] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-30T18:30:39.340997] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EHC took 35.3s. Estimated remaining: 3h 30m 5s. Rate: 7.9 symbols/min [2025-10-30T18:30:39.575792] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:39.576042] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-30T18:30:39.576102] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-30T18:30:39.576281] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-30T18:30:39.576376] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-30T18:30:39.576448] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-30T18:30:39.576487] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-30T18:30:39.703914] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-30T18:30:40.078764] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:40.082456] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T18:30:40.497505] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-30T18:30:40.887554] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-30T18:30:41.297521] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-30T18:30:41.728801] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-30T18:30:42.097548] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-30T18:30:42.381601] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-30T18:30:42.897498] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-30T18:30:43.587108] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-30T18:30:43.697505] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-30T18:30:44.070892] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-30T18:30:44.497511] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-30T18:30:44.905693] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-30T18:30:45.297476] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-30T18:30:45.700370] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-30T18:30:46.097503] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-30T18:30:46.788893] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-30T18:30:46.791759] [INFO ] [REMOTE ] EHI: Full fetch complete (15775 records). [2025-10-30T18:30:46.791827] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-30T18:30:46.902588] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-30T18:30:47.155374] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-30T18:30:47.155706] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-30T18:30:47.156061] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-30T18:30:47.156103] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-30T18:30:47.156748] [DEBUG] [LOCAL ] EHI: Trimmed 15775 records to 10710 (keeping 200 days of data) [2025-10-30T18:30:47.220602] [DEBUG] [LOCAL ] EHI: Primary data saved (10710 records). [2025-10-30T18:30:47.220756] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-30T18:30:47.220850] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EHI took 42.1s. Estimated remaining: 3h 29m 58s. Rate: 7.9 symbols/min [2025-10-30T18:30:47.295366] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T18:30:47.396794] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:47.414726] [DEBUG] [LOCAL ] EIG: Loaded 19707 existing records from primary storage. [2025-10-30T18:30:47.414963] [INFO ] [MAIN ] EIG: Loaded 19707 existing records. [2025-10-30T18:30:47.606788] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:30:47.607016] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-30T18:30:47.607082] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-30T18:30:47.607621] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-30T18:30:47.607727] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-30T18:30:47.705528] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-30T18:30:47.993825] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:48.036180] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-30T18:30:48.497495] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-30T18:30:48.943082] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-30T18:30:48.944041] [INFO ] [REMOTE ] EICB: Full fetch complete (2640 records). [2025-10-30T18:30:48.944115] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-30T18:30:49.120489] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-30T18:30:49.120708] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:30:49.120782] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:30:49.120852] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-30T18:30:49.120917] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-30T18:30:49.120955] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-30T18:30:49.120995] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-30T18:30:49.121048] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EICB took 16.9s. Estimated remaining: 3h 29m 37s. Rate: 7.9 symbols/min [2025-10-30T18:30:49.295763] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:49.297475] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-30T18:30:49.346605] [DEBUG] [LOCAL ] EIX: Loaded 53336 existing records from primary storage. [2025-10-30T18:30:49.346970] [INFO ] [MAIN ] EIX: Loaded 53336 existing records. [2025-10-30T18:30:49.527778] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:30:49.528005] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-30T18:30:49.528052] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-30T18:30:49.528537] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-30T18:30:49.528594] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-30T18:30:49.622992] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-30T18:30:49.890531] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:50.097546] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-30T18:30:50.897497] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-30T18:30:51.359509] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-30T18:30:51.690548] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-30T18:30:51.700684] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-30T18:30:51.931751] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-30T18:30:52.497501] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-30T18:30:52.818004] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-30T18:30:53.297506] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-30T18:30:53.691006] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-30T18:30:53.691795] [INFO ] [REMOTE ] EICA: Full fetch complete (1170 records). [2025-10-30T18:30:53.691862] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-30T18:30:53.896862] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-30T18:30:53.897136] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:30:53.897226] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:30:53.897320] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-30T18:30:53.897414] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-30T18:30:53.897473] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-30T18:30:53.897535] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-30T18:30:53.897629] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EICA took 27.5s. Estimated remaining: 3h 29m 23s. Rate: 7.9 symbols/min [2025-10-30T18:30:54.074256] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:30:54.101218] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-30T18:30:54.122906] [DEBUG] [LOCAL ] EL: Loaded 53368 existing records from primary storage. [2025-10-30T18:30:54.123202] [INFO ] [MAIN ] EL: Loaded 53368 existing records. [2025-10-30T18:30:54.311994] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:30:54.312262] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-30T18:30:54.312316] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-30T18:30:54.312728] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-30T18:30:54.312785] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-30T18:30:54.631105] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T18:30:54.696515] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:30:54.897514] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-30T18:30:55.360751] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-30T18:30:55.697493] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-30T18:30:56.497482] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-30T18:30:56.559331] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-30T18:30:56.909685] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-30T18:30:57.297489] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-30T18:30:57.637237] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-30T18:30:58.097496] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-30T18:30:58.434151] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T18:30:58.897502] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-30T18:30:59.697491] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-30T18:31:00.347348] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T18:31:00.497496] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-30T18:31:01.081115] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-30T18:31:01.297497] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-30T18:31:01.838976] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-30T18:31:02.097496] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-30T18:31:02.897503] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-30T18:31:03.009575] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-30T18:31:03.447195] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T18:31:03.448949] [INFO ] [REMOTE ] EICC: Full fetch complete (8460 records). [2025-10-30T18:31:03.449016] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-30T18:31:03.449469] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:31:03.449564] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:31:03.449685] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:31:03.449780] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-30T18:31:03.449854] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-30T18:31:03.449891] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-30T18:31:03.449929] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-30T18:31:03.449982] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EICC took 24.1s. Estimated remaining: 3h 29m 19s. Rate: 7.9 symbols/min [2025-10-30T18:31:03.697489] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-30T18:31:04.292844] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-30T18:31:04.497477] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-30T18:31:05.297480] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-30T18:31:05.353715] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-30T18:31:05.905231] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T18:31:06.097465] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-30T18:31:06.128112] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-30T18:31:06.897528] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-30T18:31:07.644197] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-30T18:31:07.697461] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-30T18:31:08.505897] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-30T18:31:08.528621] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-30T18:31:09.054284] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-30T18:31:09.256637] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-30T18:31:09.297723] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-30T18:31:10.097563] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-30T18:31:10.122363] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T18:31:10.897515] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-30T18:31:11.625423] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T18:31:11.697489] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-30T18:31:12.497500] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-30T18:31:12.499430] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-30T18:31:13.140222] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T18:31:13.164362] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T18:31:13.297528] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-30T18:31:14.097504] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-30T18:31:14.763486] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-30T18:31:14.785477] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T18:31:14.897482] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-30T18:31:15.543058] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T18:31:15.697544] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-30T18:31:16.497558] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-30T18:31:17.297558] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-30T18:31:17.337334] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-30T18:31:17.886322] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T18:31:17.991978] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-30T18:31:18.097545] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-30T18:31:18.897590] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-30T18:31:19.625409] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T18:31:19.624942] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-30T18:31:19.697513] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-30T18:31:20.506003] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-30T18:31:20.507874] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T18:31:20.512058] [INFO ] [REMOTE ] EIG: Full fetch complete (27381 records). [2025-10-30T18:31:20.512152] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-30T18:31:20.890243] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-30T18:31:20.890320] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-30T18:31:20.890811] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-30T18:31:20.890871] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-30T18:31:20.891531] [DEBUG] [LOCAL ] EIG: Trimmed 27381 records to 19862 (keeping 200 days of data) [2025-10-30T18:31:21.010509] [DEBUG] [LOCAL ] EIG: Primary data saved (19862 records). [2025-10-30T18:31:21.010671] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-30T18:31:21.010771] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. EIG took 33.8s. Estimated remaining: 3h 29m 35s. Rate: 7.9 symbols/min [2025-10-30T18:31:21.297511] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-30T18:31:22.003981] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-30T18:31:22.097531] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-30T18:31:23.023476] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-30T18:31:23.034866] [INFO ] [REMOTE ] EIX: Full fetch complete (77447 records). [2025-10-30T18:31:23.034984] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-30T18:31:23.419523] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-30T18:31:23.419620] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-30T18:31:23.420468] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-30T18:31:23.420521] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-30T18:31:23.421857] [DEBUG] [LOCAL ] EIX: Trimmed 77447 records to 53726 (keeping 200 days of data) [2025-10-30T18:31:23.732910] [DEBUG] [LOCAL ] EIX: Primary data saved (53726 records). [2025-10-30T18:31:23.733007] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-30T18:31:23.733830] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. EIX took 34.6s. Estimated remaining: 3h 29m 16s. Rate: 7.9 symbols/min [2025-10-30T18:31:24.003534] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-30T18:31:24.015433] [INFO ] [REMOTE ] EL: Full fetch complete (77436 records). [2025-10-30T18:31:24.015573] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-30T18:31:24.418375] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-30T18:31:24.418457] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-30T18:31:24.419331] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-30T18:31:24.419397] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-30T18:31:24.420838] [DEBUG] [LOCAL ] EL: Trimmed 77436 records to 53758 (keeping 200 days of data) [2025-10-30T18:31:24.740064] [DEBUG] [LOCAL ] EL: Primary data saved (53758 records). [2025-10-30T18:31:24.740222] [INFO ] [MAIN ] EL: Full history saved. [2025-10-30T18:31:24.740912] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EL took 30.8s. Estimated remaining: 3h 28m 53s. Rate: 7.9 symbols/min [2025-10-30T18:31:25.370489] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:31:25.376441] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:31:25.423260] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:31:25.445492] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:31:25.445954] [DEBUG] [LOCAL ] ELF: No existing data file found in primary storage. [2025-10-30T18:31:25.446188] [WARN ] [MAIN ] ELF: No existing data found, performing full refresh instead. [2025-10-30T18:31:25.446289] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-30T18:31:25.446327] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-30T18:31:25.446418] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-30T18:31:25.446457] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-30T18:31:25.518451] [DEBUG] [LOCAL ] ELC: Loaded 3421 existing records from primary storage. [2025-10-30T18:31:25.546007] [INFO ] [MAIN ] ELC: Loaded 3421 existing records. [2025-10-30T18:31:25.825535] [DEBUG] [LOCAL ] ELAN: Loaded 53299 existing records from primary storage. [2025-10-30T18:31:25.902744] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:31:25.908015] [INFO ] [MAIN ] ELAN: Loaded 53299 existing records. [2025-10-30T18:31:25.914197] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-30T18:31:25.949536] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-30T18:31:25.990144] [DEBUG] [LOCAL ] ELME: Loaded 39268 existing records from primary storage. [2025-10-30T18:31:26.036677] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-30T18:31:26.041929] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-30T18:31:26.108867] [INFO ] [MAIN ] ELME: Loaded 39268 existing records. [2025-10-30T18:31:26.441156] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:31:26.470845] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:31:26.494065] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-30T18:31:26.521006] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-30T18:31:26.550935] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-30T18:31:26.619914] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-30T18:31:26.619869] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:31:26.630597] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-30T18:31:26.669157] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-30T18:31:26.678531] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-30T18:31:26.714509] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-30T18:31:26.737942] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-30T18:31:27.116287] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:31:27.141318] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-30T18:31:27.574559] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:31:27.595589] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-30T18:31:27.601008] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:31:27.601412] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-30T18:31:27.769321] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T18:31:27.770830] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-30T18:31:28.052175] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-30T18:31:28.053467] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-30T18:31:28.372581] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-30T18:31:28.373954] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-30T18:31:28.411849] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-30T18:31:28.497489] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-30T18:31:28.684188] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-30T18:31:28.852901] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T18:31:28.991967] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T18:31:29.297542] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-30T18:31:30.045263] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-30T18:31:30.097462] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-30T18:31:30.246496] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T18:31:30.469459] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T18:31:30.897498] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-30T18:31:31.157682] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-30T18:31:31.697506] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-30T18:31:32.073201] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-30T18:31:32.497577] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-30T18:31:33.297543] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-30T18:31:34.030708] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T18:31:34.097460] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-30T18:31:34.479962] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T18:31:34.897511] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-30T18:31:35.253978] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-30T18:31:35.697505] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-30T18:31:35.822736] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-30T18:31:35.948047] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-30T18:31:36.497530] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-30T18:31:37.297529] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-30T18:31:37.530675] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T18:31:37.823542] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-30T18:31:37.824971] [INFO ] [REMOTE ] ELC: Full fetch complete (4929 records). [2025-10-30T18:31:37.825039] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-30T18:31:38.102579] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-30T18:31:38.214103] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-30T18:31:38.214179] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-30T18:31:38.214339] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-30T18:31:38.214379] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-30T18:31:38.214791] [DEBUG] [LOCAL ] ELC: Trimmed 4929 records to 3461 (keeping 200 days of data) [2025-10-30T18:31:38.235768] [DEBUG] [LOCAL ] ELC: Primary data saved (3461 records). [2025-10-30T18:31:38.235892] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-30T18:31:38.235974] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELC took 13.5s. Estimated remaining: 3h 28m 59s. Rate: 7.9 symbols/min [2025-10-30T18:31:38.411530] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:31:38.411742] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-30T18:31:38.411788] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-30T18:31:38.411923] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-30T18:31:38.411996] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-30T18:31:38.412053] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-30T18:31:38.412088] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-30T18:31:38.820252] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:31:38.897492] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-30T18:31:39.582122] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T18:31:39.697505] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-30T18:31:39.900554] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-30T18:31:40.489159] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T18:31:40.497462] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-30T18:31:41.257249] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T18:31:41.297468] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-30T18:31:42.097510] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-30T18:31:42.184571] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-30T18:31:42.897547] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-30T18:31:43.456413] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T18:31:43.697500] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-30T18:31:44.053130] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T18:31:44.497509] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-30T18:31:45.138117] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-30T18:31:45.297511] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-30T18:31:45.607542] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T18:31:46.097494] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-30T18:31:46.557099] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T18:31:46.897495] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-30T18:31:47.593778] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T18:31:47.697523] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-30T18:31:47.984483] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T18:31:48.497534] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-30T18:31:49.301544] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-30T18:31:49.320961] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-30T18:31:49.401069] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T18:31:50.097497] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-30T18:31:50.519431] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:31:50.897463] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-30T18:31:51.262497] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T18:31:51.697489] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-30T18:31:51.991262] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T18:31:52.497501] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-30T18:31:53.297473] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-30T18:31:53.381934] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T18:31:53.948850] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T18:31:54.097490] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-30T18:31:54.229104] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T18:31:54.897498] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-30T18:31:55.348403] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:31:55.697492] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-30T18:31:56.497474] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-30T18:31:56.681716] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T18:31:56.692705] [INFO ] [REMOTE ] ELF: Full fetch complete (75447 records). [2025-10-30T18:31:56.692846] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-30T18:31:57.100617] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-30T18:31:57.100753] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-30T18:31:57.101710] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-30T18:31:57.101794] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-30T18:31:57.138220] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T18:31:57.135823] [DEBUG] [LOCAL ] ELF: Trimmed 75447 records to 52015 (keeping 200 days of data) [2025-10-30T18:31:57.315264] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-30T18:31:57.458831] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T18:31:57.485701] [DEBUG] [LOCAL ] ELF: Primary data saved (52015 records). [2025-10-30T18:31:57.485810] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-30T18:31:57.485875] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELF took 32.7s. Estimated remaining: 3h 29m 18s. Rate: 7.9 symbols/min [2025-10-30T18:31:57.650090] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:31:57.650301] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-30T18:31:57.650343] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-30T18:31:57.650417] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-30T18:31:57.650453] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-30T18:31:57.650492] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-30T18:31:57.650523] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-30T18:31:57.994058] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:31:58.097492] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-30T18:31:58.578030] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T18:31:58.854717] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-30T18:31:58.897472] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-30T18:31:59.273111] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T18:31:59.697493] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-30T18:32:00.001105] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T18:32:00.497501] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-30T18:32:01.297519] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-30T18:32:01.609639] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-30T18:32:02.097501] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-30T18:32:02.694372] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-30T18:32:02.710627] [INFO ] [REMOTE ] ELAN: Full fetch complete (77096 records). [2025-10-30T18:32:02.710856] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-30T18:32:02.905878] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-30T18:32:03.131555] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-30T18:32:03.131632] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-30T18:32:03.132539] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-30T18:32:03.132600] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-30T18:32:03.134029] [DEBUG] [LOCAL ] ELAN: Trimmed 77096 records to 53689 (keeping 200 days of data) [2025-10-30T18:32:03.334471] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-30T18:32:03.452374] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T18:32:03.482319] [DEBUG] [LOCAL ] ELAN: Primary data saved (53689 records). [2025-10-30T18:32:03.482445] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-30T18:32:03.483375] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. ELAN took 38.7s. Estimated remaining: 3h 29m 6s. Rate: 7.9 symbols/min [2025-10-30T18:32:03.652366] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:03.652547] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-30T18:32:03.652583] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-30T18:32:03.652741] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-30T18:32:03.652807] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-30T18:32:03.652857] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-30T18:32:03.652889] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-30T18:32:03.704276] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-30T18:32:04.036801] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:04.497513] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-30T18:32:04.940516] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T18:32:04.949737] [INFO ] [REMOTE ] ELME: Full fetch complete (56360 records). [2025-10-30T18:32:04.949866] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-30T18:32:05.302613] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-30T18:32:05.371928] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-30T18:32:05.372012] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-30T18:32:05.372760] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-30T18:32:05.372821] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-30T18:32:05.373979] [DEBUG] [LOCAL ] ELME: Trimmed 56360 records to 39631 (keeping 200 days of data) [2025-10-30T18:32:05.609749] [DEBUG] [LOCAL ] ELME: Primary data saved (39631 records). [2025-10-30T18:32:05.609892] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-30T18:32:05.610994] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELME took 40.9s. Estimated remaining: 3h 28m 46s. Rate: 7.9 symbols/min [2025-10-30T18:32:05.790776] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:05.790950] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-30T18:32:05.790994] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-30T18:32:05.791108] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-30T18:32:05.791151] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-30T18:32:05.791193] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-30T18:32:05.791226] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-30T18:32:06.100309] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-30T18:32:06.190027] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:06.216148] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-30T18:32:06.422235] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T18:32:06.466483] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T18:32:06.897497] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-30T18:32:07.130967] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-30T18:32:07.697541] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-30T18:32:08.505099] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-30T18:32:08.508591] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T18:32:08.513977] [INFO ] [REMOTE ] ELP: Full fetch complete (36630 records). [2025-10-30T18:32:08.514050] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-30T18:32:08.824900] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-30T18:32:08.891297] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-30T18:32:08.891377] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-30T18:32:08.891949] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-30T18:32:08.892012] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-30T18:32:08.893198] [DEBUG] [LOCAL ] ELP: Trimmed 36630 records to 25313 (keeping 200 days of data) [2025-10-30T18:32:09.048760] [DEBUG] [LOCAL ] ELP: Primary data saved (25313 records). [2025-10-30T18:32:09.048848] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-30T18:32:09.048915] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. ELP took 30.8s. Estimated remaining: 3h 28m 29s. Rate: 7.9 symbols/min [2025-10-30T18:32:09.213491] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:09.213707] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-30T18:32:09.213756] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-30T18:32:09.213866] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-30T18:32:09.213908] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-30T18:32:09.213949] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-30T18:32:09.213981] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-30T18:32:09.302605] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-30T18:32:09.562393] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:09.673062] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-30T18:32:10.097497] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-30T18:32:10.897490] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-30T18:32:11.080455] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-10-30T18:32:11.367205] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:32:11.697581] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-30T18:32:11.857502] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T18:32:11.857856] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-30T18:32:11.857942] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:32:11.858014] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-30T18:32:11.858089] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:32:11.858173] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-30T18:32:11.858252] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-30T18:32:11.858303] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-30T18:32:11.858363] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-30T18:32:11.858442] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. EMA took 2.8s. Estimated remaining: 3h 28m 11s. Rate: 7.9 symbols/min [2025-10-30T18:32:12.039014] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:12.059733] [DEBUG] [LOCAL ] EMD: Loaded 20351 existing records from primary storage. [2025-10-30T18:32:12.059938] [INFO ] [MAIN ] EMD: Loaded 20351 existing records. [2025-10-30T18:32:12.241186] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:32:12.241432] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-30T18:32:12.241482] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-30T18:32:12.241769] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-30T18:32:12.241828] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-30T18:32:12.502744] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-30T18:32:12.620841] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:12.927247] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-30T18:32:12.928065] [INFO ] [REMOTE ] ELPC: Full fetch complete (1238 records). [2025-10-30T18:32:12.928134] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-30T18:32:13.112390] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-30T18:32:13.112610] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:32:13.112701] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:32:13.112780] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-30T18:32:13.112844] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-30T18:32:13.112883] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-30T18:32:13.112924] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-30T18:32:13.112980] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. ELPC took 15.6s. Estimated remaining: 3h 27m 49s. Rate: 7.9 symbols/min [2025-10-30T18:32:13.285620] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:13.302045] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-30T18:32:13.315723] [DEBUG] [LOCAL ] EME: Loaded 30390 existing records from primary storage. [2025-10-30T18:32:13.315992] [INFO ] [MAIN ] EME: Loaded 30390 existing records. [2025-10-30T18:32:13.490891] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:32:13.491116] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-30T18:32:13.491164] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-30T18:32:13.491502] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-30T18:32:13.491556] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-30T18:32:13.840254] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:14.097512] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-30T18:32:14.478433] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T18:32:14.897558] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-30T18:32:15.348861] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T18:32:15.697493] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-30T18:32:16.211544] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-30T18:32:16.497537] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-30T18:32:16.969300] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T18:32:17.297489] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-30T18:32:17.748809] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T18:32:18.097473] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-30T18:32:18.878151] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T18:32:18.897460] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-30T18:32:19.351893] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T18:32:19.697567] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-30T18:32:20.148735] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T18:32:20.497562] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-30T18:32:21.173238] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T18:32:21.297508] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-30T18:32:21.690626] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T18:32:22.097544] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-30T18:32:22.539577] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T18:32:22.897494] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-30T18:32:23.182845] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T18:32:23.697538] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-30T18:32:24.280105] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T18:32:24.504942] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-30T18:32:24.509929] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T18:32:25.297500] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-30T18:32:25.918330] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T18:32:26.097494] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-30T18:32:26.570325] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T18:32:26.897551] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-30T18:32:27.343853] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T18:32:27.697582] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-30T18:32:28.454333] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T18:32:28.502041] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-30T18:32:28.507310] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-30T18:32:29.297530] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-30T18:32:29.894954] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T18:32:30.097500] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-30T18:32:30.349184] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T18:32:30.897508] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-30T18:32:31.462548] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-30T18:32:31.697505] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-30T18:32:31.879084] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T18:32:32.497502] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-30T18:32:33.267108] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:32:33.298023] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-30T18:32:33.300576] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T18:32:34.097520] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-30T18:32:34.535132] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T18:32:34.897485] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-30T18:32:35.697485] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-30T18:32:35.811211] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-30T18:32:35.822755] [INFO ] [REMOTE ] ELV: Full fetch complete (73289 records). [2025-10-30T18:32:35.822920] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-30T18:32:36.230474] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-30T18:32:36.230593] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-30T18:32:36.231599] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-30T18:32:36.231740] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-30T18:32:36.233594] [DEBUG] [LOCAL ] ELV: Trimmed 73289 records to 51021 (keeping 200 days of data) [2025-10-30T18:32:36.356773] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T18:32:36.497697] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-30T18:32:36.536528] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-30T18:32:36.614413] [DEBUG] [LOCAL ] ELV: Primary data saved (51021 records). [2025-10-30T18:32:36.614550] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-30T18:32:36.614621] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELV took 31.0s. Estimated remaining: 3h 28m 17s. Rate: 7.9 symbols/min [2025-10-30T18:32:36.782836] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:36.787345] [DEBUG] [LOCAL ] EMF: Loaded 3024 existing records from primary storage. [2025-10-30T18:32:36.787517] [INFO ] [MAIN ] EMF: Loaded 3024 existing records. [2025-10-30T18:32:36.966200] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:32:36.966467] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-30T18:32:36.966520] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-30T18:32:36.966685] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-30T18:32:36.966744] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-30T18:32:37.301145] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-30T18:32:37.328706] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:37.982226] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T18:32:37.993610] [INFO ] [REMOTE ] ELS: Full fetch complete (71099 records). [2025-10-30T18:32:37.993829] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-30T18:32:37.994582] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:32:37.994693] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:32:37.994742] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:32:37.994808] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-30T18:32:37.994872] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-30T18:32:37.994908] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-30T18:32:37.994948] [DEBUG] [LOCAL ] ELS: No derivative data file found to delete. [2025-10-30T18:32:37.995054] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. ELS took 34.5s. Estimated remaining: 3h 27m 55s. Rate: 7.9 symbols/min [2025-10-30T18:32:38.101410] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-30T18:32:38.176270] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:38.176464] [DEBUG] [LOCAL ] EMN: No existing data file found in primary storage. [2025-10-30T18:32:38.176509] [WARN ] [MAIN ] EMN: No existing data found, performing full refresh instead. [2025-10-30T18:32:38.176622] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-30T18:32:38.176711] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-30T18:32:38.176776] [DEBUG] [LOCAL ] EMN: No primary data file found to delete. [2025-10-30T18:32:38.176820] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-30T18:32:38.546506] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:38.704465] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T18:32:38.887912] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-30T18:32:38.897448] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-30T18:32:39.641554] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-30T18:32:39.697506] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-30T18:32:40.445720] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-30T18:32:40.497508] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-30T18:32:41.297476] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-30T18:32:41.850981] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T18:32:41.890469] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T18:32:41.897791] [INFO ] [REMOTE ] EME: Full fetch complete (47118 records). [2025-10-30T18:32:41.897891] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-30T18:32:42.103919] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-30T18:32:42.307416] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-30T18:32:42.307579] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-30T18:32:42.309187] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-30T18:32:42.309430] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-30T18:32:42.310799] [DEBUG] [LOCAL ] EME: Trimmed 47118 records to 30760 (keeping 200 days of data) [2025-10-30T18:32:42.513345] [DEBUG] [LOCAL ] EME: Primary data saved (30760 records). [2025-10-30T18:32:42.513482] [INFO ] [MAIN ] EME: Full history saved. [2025-10-30T18:32:42.513562] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. EME took 29.4s. Estimated remaining: 3h 27m 41s. Rate: 7.9 symbols/min [2025-10-30T18:32:42.703407] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:42.703605] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-10-30T18:32:42.703687] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-10-30T18:32:42.703819] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-30T18:32:42.703884] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-30T18:32:42.703971] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-30T18:32:42.704032] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-30T18:32:42.819282] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-30T18:32:42.897573] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-30T18:32:43.090040] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:43.570464] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T18:32:43.697502] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-30T18:32:44.032357] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-30T18:32:44.497524] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-30T18:32:45.297468] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-30T18:32:45.966176] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-30T18:32:46.016276] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-30T18:32:46.097491] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-30T18:32:46.897535] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-30T18:32:47.274114] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-30T18:32:47.399358] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:32:47.697553] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-30T18:32:48.100382] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T18:32:48.497536] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-30T18:32:49.297485] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-30T18:32:49.341537] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-30T18:32:49.954352] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-30T18:32:50.097497] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-30T18:32:50.617403] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T18:32:50.897497] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-30T18:32:51.697515] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-30T18:32:52.105681] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T18:32:52.110835] [INFO ] [REMOTE ] EMD: Full fetch complete (31931 records). [2025-10-30T18:32:52.110971] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-30T18:32:52.307245] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-30T18:32:52.497747] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-30T18:32:52.498208] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-30T18:32:52.498281] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-30T18:32:52.499485] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-30T18:32:52.499542] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-30T18:32:52.500349] [DEBUG] [LOCAL ] EMD: Trimmed 31931 records to 20579 (keeping 200 days of data) [2025-10-30T18:32:52.623289] [DEBUG] [LOCAL ] EMD: Primary data saved (20579 records). [2025-10-30T18:32:52.623410] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-30T18:32:52.623484] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EMD took 40.8s. Estimated remaining: 3h 27m 39s. Rate: 7.9 symbols/min [2025-10-30T18:32:52.803039] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:52.807223] [DEBUG] [LOCAL ] EMP: Loaded 2802 existing records from primary storage. [2025-10-30T18:32:52.807365] [INFO ] [MAIN ] EMP: Loaded 2802 existing records. [2025-10-30T18:32:52.988356] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:32:52.988622] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-30T18:32:52.988744] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-30T18:32:52.989023] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-30T18:32:52.989079] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-30T18:32:53.302608] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-30T18:32:53.371953] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:53.379542] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-30T18:32:53.919849] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T18:32:54.097510] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-30T18:32:54.897486] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-30T18:32:55.316121] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-30T18:32:55.383122] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T18:32:55.697522] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-30T18:32:56.036758] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T18:32:56.497525] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-30T18:32:57.297487] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-30T18:32:57.757088] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-30T18:32:57.758439] [INFO ] [REMOTE ] EMF: Full fetch complete (5979 records). [2025-10-30T18:32:57.758530] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-30T18:32:58.104433] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-30T18:32:58.112634] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-30T18:32:58.113333] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-30T18:32:58.113559] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-30T18:32:58.113623] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-30T18:32:58.114040] [DEBUG] [LOCAL ] EMF: Trimmed 5979 records to 3054 (keeping 200 days of data) [2025-10-30T18:32:58.134451] [DEBUG] [LOCAL ] EMF: Primary data saved (3054 records). [2025-10-30T18:32:58.134528] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-30T18:32:58.134600] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMF took 21.5s. Estimated remaining: 3h 27m 26s. Rate: 7.9 symbols/min [2025-10-30T18:32:58.304258] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:32:58.352611] [DEBUG] [LOCAL ] EMR: Loaded 53120 existing records from primary storage. [2025-10-30T18:32:58.352944] [INFO ] [MAIN ] EMR: Loaded 53120 existing records. [2025-10-30T18:32:58.460899] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-30T18:32:58.545389] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:32:58.545660] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-30T18:32:58.545724] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-30T18:32:58.546258] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-30T18:32:58.546315] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-30T18:32:58.910832] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-30T18:32:58.910228] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-30T18:32:58.916442] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:32:59.171917] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-30T18:32:59.697501] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-30T18:33:00.497521] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-30T18:33:01.151611] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T18:33:01.297496] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-30T18:33:02.103550] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-30T18:33:02.109913] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-30T18:33:02.346961] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T18:33:02.897517] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-30T18:33:03.226591] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:33:03.697511] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-30T18:33:04.497493] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-30T18:33:05.073383] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-30T18:33:05.308186] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-30T18:33:05.316749] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-30T18:33:05.501269] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-30T18:33:05.773049] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T18:33:06.097512] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-30T18:33:06.897510] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-30T18:33:07.195399] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-30T18:33:07.666699] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-30T18:33:07.697452] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-30T18:33:08.497554] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-30T18:33:08.866617] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-30T18:33:08.867771] [INFO ] [REMOTE ] EMP: Full fetch complete (4007 records). [2025-10-30T18:33:08.867838] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-30T18:33:08.868173] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:33:08.868254] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:33:08.868296] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:33:08.868366] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-30T18:33:08.868428] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-30T18:33:08.868462] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-10-30T18:33:08.868779] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-10-30T18:33:08.868874] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EMP took 16.2s. Estimated remaining: 3h 27m 26s. Rate: 7.9 symbols/min [2025-10-30T18:33:09.051398] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:33:09.128515] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T18:33:09.127138] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-30T18:33:09.140089] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-30T18:33:09.301027] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-30T18:33:09.357187] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:33:09.358320] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-30T18:33:09.358374] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-30T18:33:09.358799] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-30T18:33:09.358856] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-30T18:33:09.716730] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:33:10.097498] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-30T18:33:10.907313] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-30T18:33:10.927287] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-30T18:33:11.342917] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T18:33:11.697513] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-30T18:33:12.264560] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-30T18:33:12.404755] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T18:33:12.497483] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-30T18:33:13.297516] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-30T18:33:14.062932] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-30T18:33:14.097520] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-30T18:33:14.531576] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T18:33:14.897470] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-30T18:33:15.412329] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:33:15.697501] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-30T18:33:16.306782] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T18:33:16.497500] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-30T18:33:17.003628] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:33:17.200595] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-30T18:33:17.297467] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-30T18:33:17.859079] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-30T18:33:18.097485] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-30T18:33:18.897498] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-30T18:33:19.331504] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T18:33:19.570445] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T18:33:19.697520] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-30T18:33:20.497498] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-30T18:33:21.124369] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T18:33:21.297497] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-30T18:33:21.737735] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T18:33:22.044237] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-30T18:33:22.048296] [INFO ] [REMOTE ] EMO: Full fetch complete (17801 records). [2025-10-30T18:33:22.048367] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-30T18:33:22.102739] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-30T18:33:22.410818] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-30T18:33:22.410936] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-30T18:33:22.411368] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-30T18:33:22.411410] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-30T18:33:22.411963] [DEBUG] [LOCAL ] EMO: Trimmed 17801 records to 13434 (keeping 200 days of data) [2025-10-30T18:33:22.491412] [DEBUG] [LOCAL ] EMO: Primary data saved (13434 records). [2025-10-30T18:33:22.491539] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-30T18:33:22.491608] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EMO took 40.0s. Estimated remaining: 3h 27m 31s. Rate: 7.9 symbols/min [2025-10-30T18:33:22.658583] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:33:22.690751] [DEBUG] [LOCAL ] ENIC: Loaded 35977 existing records from primary storage. [2025-10-30T18:33:22.691012] [INFO ] [MAIN ] ENIC: Loaded 35977 existing records. [2025-10-30T18:33:22.869866] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:33:22.870120] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-30T18:33:22.870196] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-30T18:33:22.870501] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-30T18:33:22.870544] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-30T18:33:22.911727] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-30T18:33:23.243324] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:33:23.317680] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T18:33:23.697507] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-30T18:33:24.445504] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-30T18:33:24.497482] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-30T18:33:25.011767] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T18:33:25.297511] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-30T18:33:25.758273] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T18:33:26.097525] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-30T18:33:26.384508] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T18:33:26.897508] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-30T18:33:27.448725] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T18:33:27.697497] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-30T18:33:28.277520] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T18:33:28.497560] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-30T18:33:28.611217] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T18:33:29.297563] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-30T18:33:30.060162] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T18:33:30.097461] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-30T18:33:30.314388] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T18:33:30.897498] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-30T18:33:31.697571] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-30T18:33:31.805320] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-30T18:33:32.497743] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T18:33:32.497811] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-30T18:33:32.510084] [INFO ] [REMOTE ] EMN: Full fetch complete (72561 records). [2025-10-30T18:33:32.510202] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-30T18:33:32.911058] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-30T18:33:32.911149] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-30T18:33:32.912019] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-30T18:33:32.912085] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-30T18:33:32.913494] [DEBUG] [LOCAL ] EMN: Trimmed 72561 records to 51187 (keeping 200 days of data) [2025-10-30T18:33:33.227540] [DEBUG] [LOCAL ] EMN: Primary data saved (51187 records). [2025-10-30T18:33:33.227766] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-30T18:33:33.227932] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. EMN took 55.2s. Estimated remaining: 3h 27m 31s. Rate: 7.9 symbols/min [2025-10-30T18:33:33.307724] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-30T18:33:33.413156] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:33:33.413525] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-30T18:33:33.413734] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-30T18:33:33.413902] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-30T18:33:33.413985] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-30T18:33:33.414213] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-30T18:33:33.414308] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-30T18:33:33.819987] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:33:33.822423] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-30T18:33:33.833730] [INFO ] [REMOTE ] EMR: Full fetch complete (76789 records). [2025-10-30T18:33:33.833832] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-30T18:33:33.834565] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:33:33.834668] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:33:33.834727] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:33:33.834794] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-30T18:33:33.834857] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-30T18:33:33.834892] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-10-30T18:33:33.835070] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-10-30T18:33:33.835606] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. EMR took 35.7s. Estimated remaining: 3h 27m 7s. Rate: 7.9 symbols/min [2025-10-30T18:33:34.007539] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:33:34.007834] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-30T18:33:34.007903] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-30T18:33:34.008052] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-30T18:33:34.008129] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-30T18:33:34.008316] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-30T18:33:34.008382] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-30T18:33:34.101132] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-30T18:33:34.310791] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-30T18:33:34.426713] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:33:34.449130] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T18:33:34.471587] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-30T18:33:34.897513] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-30T18:33:35.197991] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T18:33:35.697501] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-30T18:33:36.497506] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-30T18:33:37.297556] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-30T18:33:37.582370] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-30T18:33:37.594237] [INFO ] [REMOTE ] ENB: Full fetch complete (77663 records). [2025-10-30T18:33:37.594402] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-30T18:33:37.958226] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T18:33:38.023839] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-30T18:33:38.023915] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-30T18:33:38.024783] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-30T18:33:38.024846] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-30T18:33:38.026459] [DEBUG] [LOCAL ] ENB: Trimmed 77663 records to 53901 (keeping 200 days of data) [2025-10-30T18:33:38.114636] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-30T18:33:38.364946] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T18:33:38.383241] [DEBUG] [LOCAL ] ENB: Primary data saved (53901 records). [2025-10-30T18:33:38.383342] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-30T18:33:38.383418] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. ENB took 29.5s. Estimated remaining: 3h 26m 53s. Rate: 7.9 symbols/min [2025-10-30T18:33:38.553149] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:33:38.590320] [DEBUG] [LOCAL ] ENR: Loaded 43550 existing records from primary storage. [2025-10-30T18:33:38.590622] [INFO ] [MAIN ] ENR: Loaded 43550 existing records. [2025-10-30T18:33:38.770889] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:33:38.771087] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-30T18:33:38.771134] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-30T18:33:38.771752] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-30T18:33:38.771825] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-30T18:33:38.908842] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-30T18:33:39.128125] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:33:39.148214] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T18:33:39.697491] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-30T18:33:39.938046] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T18:33:40.497491] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-30T18:33:41.181339] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T18:33:41.297492] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-30T18:33:41.506915] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T18:33:42.097493] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-30T18:33:42.404682] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-30T18:33:42.445314] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T18:33:42.897538] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-30T18:33:43.697503] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-30T18:33:43.917328] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-30T18:33:44.497504] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-30T18:33:44.940014] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T18:33:45.297501] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-30T18:33:45.561241] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T18:33:46.097529] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-30T18:33:46.747892] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-30T18:33:46.783723] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-30T18:33:46.897510] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-30T18:33:47.697530] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-30T18:33:47.950368] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:33:47.992449] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-30T18:33:48.497541] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-30T18:33:49.297504] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-30T18:33:49.617349] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-30T18:33:50.001888] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T18:33:50.009490] [INFO ] [REMOTE ] ENIC: Full fetch complete (51037 records). [2025-10-30T18:33:50.009640] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-30T18:33:50.102686] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-30T18:33:50.409689] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-30T18:33:50.409787] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-30T18:33:50.410530] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-30T18:33:50.410606] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-30T18:33:50.411806] [DEBUG] [LOCAL ] ENIC: Trimmed 51037 records to 36274 (keeping 200 days of data) [2025-10-30T18:33:50.493712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-30T18:33:50.614880] [DEBUG] [LOCAL ] ENIC: Primary data saved (36274 records). [2025-10-30T18:33:50.615020] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-30T18:33:50.615099] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. ENIC took 28.1s. Estimated remaining: 3h 26m 55s. Rate: 7.9 symbols/min [2025-10-30T18:33:50.788776] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:33:50.816606] [DEBUG] [LOCAL ] ENS: Loaded 29479 existing records from primary storage. [2025-10-30T18:33:50.816923] [INFO ] [MAIN ] ENS: Loaded 29479 existing records. [2025-10-30T18:33:50.902723] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-30T18:33:51.003033] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:33:51.003294] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-30T18:33:51.003370] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-30T18:33:51.003630] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-30T18:33:51.003719] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-30T18:33:51.366895] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:33:51.697475] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-30T18:33:52.015044] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T18:33:52.497504] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-30T18:33:52.722025] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-30T18:33:52.959666] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:33:53.297513] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-30T18:33:54.097502] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-30T18:33:54.293185] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T18:33:54.386886] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-30T18:33:54.897485] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-30T18:33:55.697500] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-30T18:33:55.952631] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T18:33:56.497519] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-30T18:33:56.964261] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T18:33:57.297499] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-30T18:33:57.813688] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T18:33:58.097505] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-30T18:33:58.173587] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T18:33:58.596884] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-30T18:33:58.597834] [INFO ] [REMOTE ] ENO: Full fetch complete (2931 records). [2025-10-30T18:33:58.597900] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-30T18:33:58.902604] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-30T18:33:58.961142] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-30T18:33:58.961229] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-30T18:33:58.961364] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-30T18:33:58.961402] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-30T18:33:58.961755] [DEBUG] [LOCAL ] ENO: Trimmed 2931 records to 1555 (keeping 200 days of data) [2025-10-30T18:33:58.971409] [DEBUG] [LOCAL ] ENO: Primary data saved (1555 records). [2025-10-30T18:33:58.971466] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-30T18:33:58.971523] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENO took 25.7s. Estimated remaining: 3h 26m 49s. Rate: 7.9 symbols/min [2025-10-30T18:33:59.141701] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:33:59.164457] [DEBUG] [LOCAL ] ENVA: Loaded 24947 existing records from primary storage. [2025-10-30T18:33:59.164767] [INFO ] [MAIN ] ENVA: Loaded 24947 existing records. [2025-10-30T18:33:59.339135] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:33:59.339348] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-30T18:33:59.339398] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-30T18:33:59.339725] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-30T18:33:59.339785] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-30T18:33:59.690132] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:33:59.697458] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-30T18:33:59.945836] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T18:34:00.497519] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-30T18:34:01.297484] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-30T18:34:01.460159] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-30T18:34:02.097578] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-30T18:34:02.706677] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-30T18:34:02.897494] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-30T18:34:03.643259] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-30T18:34:03.697494] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-30T18:34:03.809968] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-30T18:34:04.263733] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T18:34:04.497551] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-30T18:34:05.297540] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-30T18:34:05.589183] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-30T18:34:05.933310] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T18:34:05.944685] [INFO ] [REMOTE ] ENOV: Full fetch complete (63103 records). [2025-10-30T18:34:05.944936] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-30T18:34:06.099392] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-30T18:34:06.401143] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T18:34:06.466085] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-30T18:34:06.466236] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-30T18:34:06.467161] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-30T18:34:06.467228] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-30T18:34:06.468871] [DEBUG] [LOCAL ] ENOV: Trimmed 63103 records to 44696 (keeping 200 days of data) [2025-10-30T18:34:06.723823] [DEBUG] [LOCAL ] ENOV: Primary data saved (44696 records). [2025-10-30T18:34:06.723951] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-30T18:34:06.724022] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENOV took 32.9s. Estimated remaining: 3h 26m 42s. Rate: 7.9 symbols/min [2025-10-30T18:34:06.891736] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:06.891897] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-30T18:34:06.891933] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-30T18:34:06.892041] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-30T18:34:06.892083] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-30T18:34:06.892124] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-30T18:34:06.892157] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-30T18:34:06.903371] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-30T18:34:07.269715] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:07.420700] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T18:34:07.697532] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-30T18:34:08.055471] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T18:34:08.497518] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-30T18:34:08.894823] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T18:34:09.297521] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-30T18:34:09.739623] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T18:34:10.097464] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-30T18:34:10.128735] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-30T18:34:10.897557] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-30T18:34:11.228056] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T18:34:11.697486] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-30T18:34:11.843492] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T18:34:12.497540] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-30T18:34:13.024286] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T18:34:13.142475] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-30T18:34:13.297503] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-30T18:34:14.097513] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-30T18:34:14.306907] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-30T18:34:14.610176] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T18:34:14.897504] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-30T18:34:15.543257] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-30T18:34:15.697550] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-30T18:34:16.497562] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-30T18:34:17.008987] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T18:34:17.154564] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T18:34:17.164042] [INFO ] [REMOTE ] ENR: Full fetch complete (59910 records). [2025-10-30T18:34:17.164198] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-30T18:34:17.307066] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-30T18:34:17.545206] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-30T18:34:17.545279] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-30T18:34:17.546015] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-30T18:34:17.546077] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-30T18:34:17.547421] [DEBUG] [LOCAL ] ENR: Trimmed 59910 records to 43879 (keeping 200 days of data) [2025-10-30T18:34:17.802990] [DEBUG] [LOCAL ] ENR: Primary data saved (43879 records). [2025-10-30T18:34:17.803193] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-30T18:34:17.803289] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENR took 39.4s. Estimated remaining: 3h 26m 42s. Rate: 7.9 symbols/min [2025-10-30T18:34:17.969074] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:17.969248] [DEBUG] [LOCAL ] EOG: No existing data file found in primary storage. [2025-10-30T18:34:17.969290] [WARN ] [MAIN ] EOG: No existing data found, performing full refresh instead. [2025-10-30T18:34:17.969394] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-30T18:34:17.969454] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-30T18:34:17.969496] [DEBUG] [LOCAL ] EOG: No primary data file found to delete. [2025-10-30T18:34:17.969527] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-30T18:34:18.106687] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-30T18:34:18.323093] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:18.341855] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T18:34:18.897468] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-30T18:34:19.218052] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T18:34:19.697475] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-30T18:34:19.776719] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T18:34:20.497510] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-30T18:34:20.670078] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-30T18:34:21.297494] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-30T18:34:21.319890] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T18:34:22.097514] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-30T18:34:22.300378] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T18:34:22.897516] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-30T18:34:23.697514] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-30T18:34:24.134247] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T18:34:24.182534] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-30T18:34:24.497510] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-30T18:34:24.762620] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T18:34:24.769802] [INFO ] [REMOTE ] ENVA: Full fetch complete (36850 records). [2025-10-30T18:34:24.769926] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-30T18:34:25.172162] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-30T18:34:25.172241] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-30T18:34:25.172816] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-30T18:34:25.172877] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-30T18:34:25.173749] [DEBUG] [LOCAL ] ENVA: Trimmed 36850 records to 25142 (keeping 200 days of data) [2025-10-30T18:34:25.301506] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-30T18:34:25.321523] [DEBUG] [LOCAL ] ENVA: Primary data saved (25142 records). [2025-10-30T18:34:25.321630] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-30T18:34:25.321743] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENVA took 26.4s. Estimated remaining: 3h 26m 34s. Rate: 7.9 symbols/min [2025-10-30T18:34:25.493389] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:25.503865] [DEBUG] [LOCAL ] EOI: Loaded 9916 existing records from primary storage. [2025-10-30T18:34:25.504079] [INFO ] [MAIN ] EOI: Loaded 9916 existing records. [2025-10-30T18:34:25.681769] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:34:25.682107] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-30T18:34:25.682163] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-30T18:34:25.682383] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-30T18:34:25.682453] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-30T18:34:26.050013] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:26.077142] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T18:34:26.098351] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-30T18:34:26.101299] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-30T18:34:26.897494] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-30T18:34:27.697514] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-30T18:34:27.985603] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-30T18:34:28.255995] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T18:34:28.497378] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T18:34:28.497596] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-30T18:34:29.297602] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-30T18:34:29.834458] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T18:34:29.841890] [INFO ] [REMOTE ] ENS: Full fetch complete (42948 records). [2025-10-30T18:34:29.842044] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-30T18:34:29.964992] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T18:34:30.102836] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-30T18:34:30.242035] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-30T18:34:30.242113] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-30T18:34:30.242744] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-30T18:34:30.242816] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-30T18:34:30.243786] [DEBUG] [LOCAL ] ENS: Trimmed 42948 records to 29754 (keeping 200 days of data) [2025-10-30T18:34:30.426785] [DEBUG] [LOCAL ] ENS: Primary data saved (29754 records). [2025-10-30T18:34:30.426914] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-30T18:34:30.426992] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. ENS took 39.8s. Estimated remaining: 3h 26m 21s. Rate: 7.9 symbols/min [2025-10-30T18:34:30.598676] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:30.598863] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-10-30T18:34:30.598903] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-10-30T18:34:30.599013] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-30T18:34:30.599056] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-30T18:34:30.599107] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-30T18:34:30.599144] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-30T18:34:30.928239] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T18:34:30.922288] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-30T18:34:31.005752] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:31.697472] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-30T18:34:31.717461] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T18:34:32.497497] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-30T18:34:33.169376] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-30T18:34:33.297471] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-30T18:34:33.971497] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-30T18:34:34.094830] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-30T18:34:34.098930] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-30T18:34:34.100174] [INFO ] [REMOTE ] EOD: Full fetch complete (20998 records). [2025-10-30T18:34:34.100257] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-30T18:34:34.483913] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-30T18:34:34.484020] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-30T18:34:34.484542] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-30T18:34:34.484591] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-30T18:34:34.485168] [DEBUG] [LOCAL ] EOD: Trimmed 20998 records to 14855 (keeping 200 days of data) [2025-10-30T18:34:34.569365] [DEBUG] [LOCAL ] EOD: Primary data saved (14855 records). [2025-10-30T18:34:34.569508] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-30T18:34:34.569582] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. EOD took 27.8s. Estimated remaining: 3h 26m 6s. Rate: 7.9 symbols/min [2025-10-30T18:34:34.746594] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:34.754447] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T18:34:34.764352] [DEBUG] [LOCAL ] EOT: Loaded 6957 existing records from primary storage. [2025-10-30T18:34:34.764560] [INFO ] [MAIN ] EOT: Loaded 6957 existing records. [2025-10-30T18:34:34.907278] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-30T18:34:34.949445] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:34:34.949754] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-30T18:34:34.949805] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-30T18:34:34.949945] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-30T18:34:34.949983] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-30T18:34:35.316330] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:35.471817] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T18:34:35.697498] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-30T18:34:36.440936] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T18:34:36.497490] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-30T18:34:37.297525] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-30T18:34:37.582453] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T18:34:38.097522] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-30T18:34:38.686402] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T18:34:38.821223] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T18:34:38.897492] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-30T18:34:39.358806] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-30T18:34:39.697514] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-30T18:34:40.205109] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T18:34:40.497525] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-30T18:34:41.297518] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-30T18:34:41.850288] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-30T18:34:42.082998] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-30T18:34:42.097461] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-30T18:34:42.897492] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-30T18:34:43.377670] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T18:34:43.681028] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-30T18:34:43.697466] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-30T18:34:44.497490] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-30T18:34:45.170924] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T18:34:45.242223] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-30T18:34:45.297461] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-30T18:34:46.097479] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-30T18:34:46.682473] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T18:34:46.806703] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T18:34:46.897457] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-30T18:34:47.369749] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-30T18:34:47.697495] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-30T18:34:48.250107] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T18:34:48.497490] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-30T18:34:49.041867] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-30T18:34:49.297493] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-30T18:34:50.097468] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-30T18:34:50.193734] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-30T18:34:50.560533] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T18:34:50.897491] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-30T18:34:51.697479] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-30T18:34:51.709298] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T18:34:51.712191] [INFO ] [REMOTE ] EOI: Full fetch complete (15846 records). [2025-10-30T18:34:51.712264] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-30T18:34:52.085010] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-30T18:34:52.085089] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-30T18:34:52.085509] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-30T18:34:52.085550] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-30T18:34:52.086071] [DEBUG] [LOCAL ] EOI: Trimmed 15846 records to 10008 (keeping 200 days of data) [2025-10-30T18:34:52.147133] [DEBUG] [LOCAL ] EOI: Primary data saved (10008 records). [2025-10-30T18:34:52.147247] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-30T18:34:52.147324] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. EOI took 26.8s. Estimated remaining: 3h 26m 20s. Rate: 7.9 symbols/min [2025-10-30T18:34:52.312540] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:52.335545] [DEBUG] [LOCAL ] EPAC: Loaded 26036 existing records from primary storage. [2025-10-30T18:34:52.335830] [INFO ] [MAIN ] EPAC: Loaded 26036 existing records. [2025-10-30T18:34:52.512148] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-30T18:34:52.518392] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:34:52.519390] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-30T18:34:52.519449] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-30T18:34:52.519700] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-30T18:34:52.519758] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-30T18:34:52.880248] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:53.297484] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-30T18:34:53.328903] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T18:34:53.443374] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-30T18:34:53.455448] [INFO ] [REMOTE ] EOG: Full fetch complete (77469 records). [2025-10-30T18:34:53.455633] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-30T18:34:53.839215] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-30T18:34:53.935809] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-30T18:34:53.935902] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-30T18:34:53.936854] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-30T18:34:53.936919] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-30T18:34:53.938916] [DEBUG] [LOCAL ] EOG: Trimmed 77469 records to 53777 (keeping 200 days of data) [2025-10-30T18:34:54.130664] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-30T18:34:54.296519] [DEBUG] [LOCAL ] EOG: Primary data saved (53777 records). [2025-10-30T18:34:54.296693] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-30T18:34:54.296780] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EOG took 36.5s. Estimated remaining: 3h 26m 0s. Rate: 7.9 symbols/min [2025-10-30T18:34:54.461683] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:54.461863] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-30T18:34:54.461900] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-30T18:34:54.462003] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-30T18:34:54.462044] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-30T18:34:54.462084] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-30T18:34:54.462115] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-30T18:34:54.810110] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:54.897489] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-30T18:34:55.401242] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:34:55.489789] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-30T18:34:55.492030] [INFO ] [REMOTE ] EOT: Full fetch complete (10673 records). [2025-10-30T18:34:55.492099] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-30T18:34:55.707610] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-30T18:34:55.866683] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-30T18:34:55.866769] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-30T18:34:55.867054] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-30T18:34:55.867113] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-30T18:34:55.867531] [DEBUG] [LOCAL ] EOT: Trimmed 10673 records to 7000 (keeping 200 days of data) [2025-10-30T18:34:55.908951] [DEBUG] [LOCAL ] EOT: Primary data saved (7000 records). [2025-10-30T18:34:55.909068] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-30T18:34:55.909150] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOT took 21.3s. Estimated remaining: 3h 25m 40s. Rate: 7.9 symbols/min [2025-10-30T18:34:56.079665] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:34:56.116578] [DEBUG] [LOCAL ] EPC: Loaded 39579 existing records from primary storage. [2025-10-30T18:34:56.116919] [INFO ] [MAIN ] EPC: Loaded 39579 existing records. [2025-10-30T18:34:56.306944] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:34:56.307151] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-30T18:34:56.307198] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-30T18:34:56.307373] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-30T18:34:56.307410] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-30T18:34:56.503347] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-30T18:34:56.679092] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:34:56.694201] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T18:34:57.297493] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-30T18:34:57.957287] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T18:34:58.097473] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-30T18:34:58.739100] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T18:34:58.897492] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-30T18:34:59.233345] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T18:34:59.697564] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-30T18:35:00.078307] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T18:35:00.497538] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-30T18:35:01.297528] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-30T18:35:01.338360] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-30T18:35:02.097560] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-30T18:35:02.509684] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-30T18:35:02.897499] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-30T18:35:03.190447] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-30T18:35:03.697495] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-30T18:35:04.497480] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-30T18:35:04.620453] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-30T18:35:04.748516] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-30T18:35:05.297539] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-30T18:35:05.521528] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-30T18:35:05.695125] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T18:35:06.097512] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-30T18:35:06.460202] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T18:35:06.897496] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-30T18:35:07.292362] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:35:07.697549] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-30T18:35:08.343462] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-30T18:35:08.353052] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T18:35:08.497577] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-30T18:35:09.297510] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-30T18:35:09.685446] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T18:35:10.097515] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-30T18:35:10.561066] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:35:10.897514] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-30T18:35:11.141075] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T18:35:11.659884] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T18:35:11.697536] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-30T18:35:12.497523] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-30T18:35:12.928054] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T18:35:13.297519] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-30T18:35:13.390098] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T18:35:14.097498] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-30T18:35:14.730774] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T18:35:14.897492] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-30T18:35:15.123419] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T18:35:15.697507] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-30T18:35:16.233488] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T18:35:16.372843] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T18:35:16.497470] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-30T18:35:17.151149] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-30T18:35:17.297485] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-30T18:35:18.097502] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-30T18:35:18.760456] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T18:35:18.897507] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-30T18:35:19.486782] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T18:35:19.697525] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-30T18:35:19.995671] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:35:20.497554] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-30T18:35:21.139930] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T18:35:21.148465] [INFO ] [REMOTE ] EPC: Full fetch complete (57448 records). [2025-10-30T18:35:21.148681] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-30T18:35:21.302737] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-30T18:35:21.552296] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-30T18:35:21.552382] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-30T18:35:21.553128] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-30T18:35:21.553191] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-30T18:35:21.554416] [DEBUG] [LOCAL ] EPC: Trimmed 57448 records to 39868 (keeping 200 days of data) [2025-10-30T18:35:21.792525] [DEBUG] [LOCAL ] EPC: Primary data saved (39868 records). [2025-10-30T18:35:21.792717] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-30T18:35:21.792860] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EPC took 25.9s. Estimated remaining: 3h 26m 11s. Rate: 7.8 symbols/min [2025-10-30T18:35:21.969478] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:22.019955] [DEBUG] [LOCAL ] EPD: Loaded 53606 existing records from primary storage. [2025-10-30T18:35:22.020365] [INFO ] [MAIN ] EPD: Loaded 53606 existing records. [2025-10-30T18:35:22.102122] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-30T18:35:22.223353] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:35:22.236068] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-30T18:35:22.236303] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-30T18:35:22.238019] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T18:35:22.238070] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-30T18:35:22.238219] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-30T18:35:22.279387] [INFO ] [REMOTE ] EPAM: Full fetch complete (56882 records). [2025-10-30T18:35:22.297934] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-30T18:35:22.559053] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T18:35:22.622304] [INFO ] [REMOTE ] EOS: Full fetch complete (22855 records). [2025-10-30T18:35:22.705352] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-30T18:35:23.021729] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:35:23.044253] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-30T18:35:23.297359] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-30T18:35:23.297558] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-30T18:35:23.299047] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-30T18:35:23.315751] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-30T18:35:23.416177] [DEBUG] [LOCAL ] EPAM: Trimmed 56882 records to 39250 (keeping 200 days of data) [2025-10-30T18:35:23.442374] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T18:35:23.685829] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-30T18:35:23.700968] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-30T18:35:23.700817] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-30T18:35:23.701554] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-30T18:35:23.755722] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-30T18:35:23.840752] [DEBUG] [LOCAL ] EOS: Trimmed 22855 records to 14451 (keeping 200 days of data) [2025-10-30T18:35:23.843869] [DEBUG] [LOCAL ] EPAM: Primary data saved (39250 records). [2025-10-30T18:35:23.844637] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-30T18:35:23.844795] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EPAM took 29.5s. Estimated remaining: 3h 25m 52s. Rate: 7.9 symbols/min [2025-10-30T18:35:24.121413] [DEBUG] [LOCAL ] EOS: Primary data saved (14451 records). [2025-10-30T18:35:24.122518] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:24.122733] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-30T18:35:24.123248] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EOS took 53.7s. Estimated remaining: 3h 25m 28s. Rate: 7.9 symbols/min [2025-10-30T18:35:24.298398] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:24.326488] [DEBUG] [LOCAL ] EPR: Loaded 43429 existing records from primary storage. [2025-10-30T18:35:24.326954] [INFO ] [MAIN ] EPR: Loaded 43429 existing records. [2025-10-30T18:35:24.534336] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:35:24.536121] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-30T18:35:24.535908] [DEBUG] [LOCAL ] EPRT: Loaded 48379 existing records from primary storage. [2025-10-30T18:35:24.536319] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-30T18:35:24.536723] [INFO ] [MAIN ] EPRT: Loaded 48379 existing records. [2025-10-30T18:35:24.568467] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-30T18:35:24.613515] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-30T18:35:24.884916] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:35:24.885586] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-30T18:35:24.927634] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-30T18:35:24.966208] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-30T18:35:24.981318] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-30T18:35:25.244718] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-30T18:35:25.367903] [INFO ] [REMOTE ] EPAC: Full fetch complete (38546 records). [2025-10-30T18:35:25.371829] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:35:25.374444] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-30T18:35:25.368624] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-30T18:35:25.390540] [FATAL] [VALIDATOR ] EPAC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:35:25.393455] [FATAL] [MAIN ] EPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:35:25.431159] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:35:25.431855] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-30T18:35:25.440857] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-30T18:35:25.478253] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-10-30T18:35:25.500412] [DEBUG] [LOCAL ] EPAC: Deleted derivative data file. [2025-10-30T18:35:25.516474] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPAC took 33.4s. Estimated remaining: 3h 25m 7s. Rate: 7.9 symbols/min [2025-10-30T18:35:25.695421] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-30T18:35:25.693464] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:35:25.715926] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-30T18:35:25.832731] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:25.844196] [DEBUG] [LOCAL ] EQBK: Loaded 11085 existing records from primary storage. [2025-10-30T18:35:25.844431] [INFO ] [MAIN ] EQBK: Loaded 11085 existing records. [2025-10-30T18:35:26.023513] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:35:26.023755] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-30T18:35:26.023809] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-30T18:35:26.024037] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-30T18:35:26.024093] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-30T18:35:26.102748] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-30T18:35:26.381530] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:35:26.897463] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-30T18:35:27.111086] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-30T18:35:27.143386] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T18:35:27.568049] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-30T18:35:27.697483] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-30T18:35:27.728945] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T18:35:28.497543] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-30T18:35:28.722575] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T18:35:29.297502] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-30T18:35:29.796020] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:35:30.097492] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-30T18:35:30.637283] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T18:35:30.897468] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-30T18:35:31.497966] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:35:31.697502] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-30T18:35:32.254336] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T18:35:32.497515] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-30T18:35:33.297541] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-30T18:35:33.425590] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-30T18:35:33.678986] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T18:35:34.097523] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-30T18:35:34.476776] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T18:35:34.551795] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T18:35:34.897499] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-30T18:35:35.697502] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-30T18:35:36.203523] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T18:35:36.237936] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T18:35:36.497546] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-30T18:35:37.297493] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-30T18:35:38.027706] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-30T18:35:38.097465] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-30T18:35:38.212371] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-30T18:35:38.528028] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-30T18:35:38.897489] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-30T18:35:39.440917] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T18:35:39.697502] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-30T18:35:40.497475] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-30T18:35:41.297511] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-30T18:35:41.505563] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-30T18:35:41.957618] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-30T18:35:42.034756] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-30T18:35:42.097452] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-30T18:35:42.897550] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-30T18:35:43.697486] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-30T18:35:43.765190] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-30T18:35:44.481917] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-30T18:35:44.497491] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-30T18:35:45.160869] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:35:45.297497] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-30T18:35:46.097459] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-30T18:35:46.193779] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-30T18:35:46.766574] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T18:35:46.897460] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-30T18:35:47.365509] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T18:35:47.697513] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-30T18:35:48.071524] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-30T18:35:48.418673] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-30T18:35:48.497507] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-30T18:35:49.297511] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-30T18:35:49.883627] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-30T18:35:50.097497] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-30T18:35:50.156041] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-30T18:35:50.897480] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-30T18:35:50.915072] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T18:35:50.919442] [INFO ] [REMOTE ] EQBK: Full fetch complete (15715 records). [2025-10-30T18:35:50.919527] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-30T18:35:51.296229] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-30T18:35:51.296306] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-30T18:35:51.296754] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-30T18:35:51.296818] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-30T18:35:51.297320] [DEBUG] [LOCAL ] EQBK: Trimmed 15715 records to 11167 (keeping 200 days of data) [2025-10-30T18:35:51.368127] [DEBUG] [LOCAL ] EQBK: Primary data saved (11167 records). [2025-10-30T18:35:51.368293] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-30T18:35:51.368417] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EQBK took 25.8s. Estimated remaining: 3h 25m 39s. Rate: 7.8 symbols/min [2025-10-30T18:35:51.536841] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:51.583731] [DEBUG] [LOCAL ] EQH: Loaded 52645 existing records from primary storage. [2025-10-30T18:35:51.584031] [INFO ] [MAIN ] EQH: Loaded 52645 existing records. [2025-10-30T18:35:51.702695] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-30T18:35:51.764942] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:35:51.765150] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-30T18:35:51.765200] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-30T18:35:51.765706] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-30T18:35:51.765761] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-30T18:35:52.141891] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:35:52.263217] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T18:35:52.497494] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-30T18:35:53.297473] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-30T18:35:53.373845] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-30T18:35:54.097489] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-30T18:35:54.157904] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-30T18:35:54.845158] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-30T18:35:54.897458] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-30T18:35:55.697485] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-30T18:35:55.781959] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T18:35:55.797235] [INFO ] [REMOTE ] EPR: Full fetch complete (63342 records). [2025-10-30T18:35:55.797372] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-30T18:35:56.342238] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-30T18:35:56.342478] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-30T18:35:56.344103] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-30T18:35:56.344310] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-30T18:35:56.347114] [DEBUG] [LOCAL ] EPR: Trimmed 63342 records to 43807 (keeping 200 days of data) [2025-10-30T18:35:56.500268] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-30T18:35:56.521975] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-30T18:35:56.546978] [INFO ] [REMOTE ] EPRT: Full fetch complete (69792 records). [2025-10-30T18:35:56.549456] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-30T18:35:57.179684] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-30T18:35:57.181512] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-30T18:35:57.184532] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-30T18:35:57.184637] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-30T18:35:57.217892] [DEBUG] [LOCAL ] EPR: Primary data saved (43807 records). [2025-10-30T18:35:57.218100] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-30T18:35:57.218409] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EPR took 33.4s. Estimated remaining: 3h 25m 27s. Rate: 7.9 symbols/min [2025-10-30T18:35:57.218279] [DEBUG] [LOCAL ] EPRT: Trimmed 69792 records to 48731 (keeping 200 days of data) [2025-10-30T18:35:57.478507] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-30T18:35:57.566077] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-30T18:35:57.565815] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:57.742822] [DEBUG] [LOCAL ] EQNR: Loaded 53037 existing records from primary storage. [2025-10-30T18:35:57.749133] [INFO ] [MAIN ] EQNR: Loaded 53037 existing records. [2025-10-30T18:35:58.008871] [DEBUG] [LOCAL ] EPRT: Primary data saved (48731 records). [2025-10-30T18:35:58.017048] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:35:58.017263] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-30T18:35:58.017352] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-30T18:35:58.017411] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-30T18:35:58.018228] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EPRT took 33.9s. Estimated remaining: 3h 25m 5s. Rate: 7.9 symbols/min [2025-10-30T18:35:58.018270] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-30T18:35:58.029538] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-30T18:35:58.314926] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:58.654471] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:35:58.654986] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-30T18:35:58.703035] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-30T18:35:58.704079] [DEBUG] [LOCAL ] EQR: Loaded 51795 existing records from primary storage. [2025-10-30T18:35:58.715378] [INFO ] [MAIN ] EQR: Loaded 51795 existing records. [2025-10-30T18:35:58.771079] [INFO ] [REMOTE ] EPD: Full fetch complete (77385 records). [2025-10-30T18:35:58.802524] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-30T18:35:58.825711] [FATAL] [VALIDATOR ] EPD: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:35:58.841380] [FATAL] [MAIN ] EPD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:35:58.869268] [WARN ] [MAIN ] EPD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:35:58.899353] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-30T18:35:58.899190] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:35:58.899522] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-30T18:35:58.899666] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-30T18:35:58.899731] [INFO ] [LOCAL ] EPD: Starting deletion of derivative data. [2025-10-30T18:35:58.899864] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-30T18:35:58.900313] [DEBUG] [LOCAL ] EPD: Deleted derivative data file. [2025-10-30T18:35:58.901439] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EPD took 37.1s. Estimated remaining: 3h 24m 43s. Rate: 7.9 symbols/min [2025-10-30T18:35:58.901823] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-30T18:35:58.932625] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-30T18:35:59.185252] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:35:59.268255] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-30T18:35:59.310879] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-30T18:35:59.331448] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-30T18:35:59.331539] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-30T18:35:59.347929] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-30T18:35:59.358500] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-30T18:35:59.525712] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:35:59.569485] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-30T18:35:59.596736] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-30T18:35:59.703810] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-30T18:35:59.849034] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:36:00.377550] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-30T18:36:00.497506] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-30T18:36:01.297500] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-30T18:36:01.932465] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-30T18:36:02.097484] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-30T18:36:02.158577] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-30T18:36:02.897560] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-30T18:36:03.714840] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-30T18:36:03.715840] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-30T18:36:03.949318] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-30T18:36:04.293961] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-30T18:36:04.497486] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-30T18:36:04.538959] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (4.04 seconds). [2025-10-30T18:36:04.579777] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-30T18:36:04.807418] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-30T18:36:05.297552] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-30T18:36:06.097495] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-30T18:36:06.702455] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:36:06.897496] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-30T18:36:07.104210] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-10-30T18:36:07.573996] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T18:36:07.697479] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-30T18:36:07.978705] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-30T18:36:08.497517] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-30T18:36:09.297544] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-30T18:36:10.097500] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-30T18:36:10.291383] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-30T18:36:10.413726] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-30T18:36:10.897486] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-30T18:36:11.016506] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-30T18:36:11.697494] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-30T18:36:12.187319] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T18:36:12.497563] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-30T18:36:12.788909] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-30T18:36:13.297499] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-30T18:36:13.338457] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-30T18:36:13.739276] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-30T18:36:14.097512] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-30T18:36:14.897601] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-30T18:36:15.698601] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-30T18:36:15.703976] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-30T18:36:16.251382] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T18:36:16.472041] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T18:36:16.497463] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-30T18:36:17.297523] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-30T18:36:17.855147] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T18:36:18.097541] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-30T18:36:18.852575] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-30T18:36:18.897457] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-30T18:36:19.461298] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-30T18:36:19.697471] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-30T18:36:20.418867] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T18:36:20.497497] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-30T18:36:21.248320] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-30T18:36:21.297464] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-30T18:36:21.876829] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T18:36:22.097493] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-30T18:36:22.633192] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-30T18:36:22.634170] [INFO ] [REMOTE ] EQS: Full fetch complete (2339 records). [2025-10-30T18:36:22.634237] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-30T18:36:22.816861] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-30T18:36:22.817077] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:36:22.817242] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:36:22.817400] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-30T18:36:22.817579] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-30T18:36:22.817732] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-30T18:36:22.817943] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-30T18:36:22.818063] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EQS took 23.9s. Estimated remaining: 3h 25m 10s. Rate: 7.8 symbols/min [2025-10-30T18:36:22.898607] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-30T18:36:23.044182] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:36:23.050443] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-30T18:36:23.109401] [DEBUG] [LOCAL ] EQT: Loaded 53684 existing records from primary storage. [2025-10-30T18:36:23.109763] [INFO ] [MAIN ] EQT: Loaded 53684 existing records. [2025-10-30T18:36:23.283477] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:36:23.283733] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-30T18:36:23.283806] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-30T18:36:23.284309] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-30T18:36:23.284365] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-30T18:36:23.640398] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:36:23.697559] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-30T18:36:24.497556] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-30T18:36:24.568751] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T18:36:24.581068] [INFO ] [REMOTE ] EQH: Full fetch complete (76198 records). [2025-10-30T18:36:24.581345] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-30T18:36:24.582676] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:36:24.582819] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:36:24.582866] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:36:24.582914] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-30T18:36:24.582982] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-30T18:36:24.583021] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-10-30T18:36:24.583280] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-10-30T18:36:24.584361] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQH took 33.2s. Estimated remaining: 3h 24m 50s. Rate: 7.9 symbols/min [2025-10-30T18:36:25.297614] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-30T18:36:25.443079] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-30T18:36:26.076477] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-30T18:36:26.097470] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-30T18:36:26.897550] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-30T18:36:27.061551] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-30T18:36:27.697522] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-30T18:36:27.766140] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T18:36:27.778312] [INFO ] [REMOTE ] EQR: Full fetch complete (74283 records). [2025-10-30T18:36:27.778492] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-30T18:36:27.779315] [FATAL] [VALIDATOR ] EQR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:36:27.779406] [FATAL] [MAIN ] EQR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:36:27.779449] [WARN ] [MAIN ] EQR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:36:27.779491] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-30T18:36:27.779555] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-10-30T18:36:27.779591] [INFO ] [LOCAL ] EQR: Starting deletion of derivative data. [2025-10-30T18:36:27.779846] [DEBUG] [LOCAL ] EQR: Deleted derivative data file. [2025-10-30T18:36:27.779950] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQR took 29.8s. Estimated remaining: 3h 24m 33s. Rate: 7.9 symbols/min [2025-10-30T18:36:28.190868] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-30T18:36:28.497552] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-30T18:36:29.270500] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:36:29.297524] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-30T18:36:29.842558] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T18:36:30.097495] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-30T18:36:31.141915] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-30T18:36:31.153426] [INFO ] [REMOTE ] EQNR: Full fetch complete (77011 records). [2025-10-30T18:36:31.153558] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-30T18:36:31.549219] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-30T18:36:31.549323] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-30T18:36:31.550247] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-30T18:36:31.550383] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-30T18:36:31.552003] [DEBUG] [LOCAL ] EQNR: Trimmed 77011 records to 53423 (keeping 200 days of data) [2025-10-30T18:36:31.718690] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-30T18:36:31.830268] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-30T18:36:31.931085] [DEBUG] [LOCAL ] EQNR: Primary data saved (53423 records). [2025-10-30T18:36:31.931229] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-30T18:36:31.931306] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQNR took 34.7s. Estimated remaining: 3h 24m 18s. Rate: 7.9 symbols/min [2025-10-30T18:36:33.390103] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-30T18:36:33.401289] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-30T18:36:34.878555] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-30T18:36:34.889297] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-30T18:36:36.793781] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-30T18:36:36.805329] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-30T18:36:38.487802] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-30T18:36:38.499285] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-30T18:36:40.161087] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-30T18:36:40.172334] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-30T18:36:42.455465] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-30T18:36:42.467080] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-30T18:36:42.467202] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-30T18:36:42.852278] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-30T18:36:42.852364] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-30T18:36:42.853315] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-30T18:36:42.853377] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-30T18:36:42.854763] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 54074 (keeping 200 days of data) [2025-10-30T18:36:43.171304] [DEBUG] [LOCAL ] EQT: Primary data saved (54074 records). [2025-10-30T18:36:43.171428] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-30T18:36:43.172047] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQT took 20.4s. Estimated remaining: 3h 24m 18s. Rate: 7.9 symbols/min [2025-10-30T18:36:43.810455] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:36:43.920421] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:36:43.938361] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:36:43.963972] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:36:43.964447] [DEBUG] [LOCAL ] ES: No existing data file found in primary storage. [2025-10-30T18:36:43.964545] [WARN ] [MAIN ] ES: No existing data found, performing full refresh instead. [2025-10-30T18:36:43.965030] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-30T18:36:43.965632] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-30T18:36:43.965831] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-30T18:36:43.965907] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-30T18:36:44.044152] [DEBUG] [LOCAL ] EQV: Loaded 2868 existing records from primary storage. [2025-10-30T18:36:44.060180] [INFO ] [MAIN ] EQV: Loaded 2868 existing records. [2025-10-30T18:36:44.274217] [DEBUG] [LOCAL ] ERO: Loaded 41983 existing records from primary storage. [2025-10-30T18:36:44.350081] [INFO ] [MAIN ] ERO: Loaded 41983 existing records. [2025-10-30T18:36:44.574013] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:36:44.584804] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-30T18:36:44.625717] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-30T18:36:44.675603] [DEBUG] [LOCAL ] ERJ: Loaded 50193 existing records from primary storage. [2025-10-30T18:36:44.717673] [INFO ] [MAIN ] ERJ: Loaded 50193 existing records. [2025-10-30T18:36:44.706320] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:36:44.755794] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-30T18:36:44.744905] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-30T18:36:44.800605] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-30T18:36:44.845636] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:36:44.942607] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-30T18:36:44.980544] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-30T18:36:45.034485] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-30T18:36:45.086947] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-30T18:36:45.081381] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:36:45.112846] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-30T18:36:45.120171] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-30T18:36:45.148458] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-30T18:36:45.176933] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-30T18:36:45.898254] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:36:45.925975] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-30T18:36:46.127702] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:36:46.136878] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-30T18:36:46.166761] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:36:46.167196] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-30T18:36:46.488609] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-30T18:36:46.499125] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-30T18:36:46.753202] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T18:36:46.755461] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-30T18:36:47.137519] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T18:36:47.139184] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-30T18:36:47.359897] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T18:36:47.367515] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-30T18:36:47.540421] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-30T18:36:47.541886] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-30T18:36:47.752613] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T18:36:47.762591] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-30T18:36:47.868985] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T18:36:47.878219] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-30T18:36:47.919586] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T18:36:47.920841] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-30T18:36:48.193801] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-30T18:36:48.195175] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-30T18:36:48.341281] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T18:36:48.349261] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-30T18:36:48.564062] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-30T18:36:48.565562] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-30T18:36:48.903401] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-30T18:36:48.904706] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-30T18:36:49.067795] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T18:36:49.078554] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-30T18:36:49.263071] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-30T18:36:49.297467] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-30T18:36:49.407738] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T18:36:49.441043] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-30T18:36:49.633610] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-30T18:36:50.097494] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-30T18:36:50.677807] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-30T18:36:50.897490] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-30T18:36:51.176234] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T18:36:51.697498] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-30T18:36:52.325497] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T18:36:52.497468] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-30T18:36:52.706312] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T18:36:53.297507] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-30T18:36:53.771751] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-30T18:36:53.773307] [INFO ] [REMOTE ] EQV: Full fetch complete (4852 records). [2025-10-30T18:36:53.773394] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-30T18:36:54.121507] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-30T18:36:54.178636] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-30T18:36:54.191384] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-30T18:36:54.192378] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-30T18:36:54.193145] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-30T18:36:54.193223] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-30T18:36:54.194148] [DEBUG] [LOCAL ] EQV: Trimmed 4852 records to 2933 (keeping 200 days of data) [2025-10-30T18:36:54.212571] [DEBUG] [LOCAL ] EQV: Primary data saved (2933 records). [2025-10-30T18:36:54.212738] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-30T18:36:54.212835] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. EQV took 10.9s. Estimated remaining: 3h 24m 17s. Rate: 7.9 symbols/min [2025-10-30T18:36:54.376383] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:36:54.401398] [DEBUG] [LOCAL ] ESAB: Loaded 25781 existing records from primary storage. [2025-10-30T18:36:54.401662] [INFO ] [MAIN ] ESAB: Loaded 25781 existing records. [2025-10-30T18:36:54.574147] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:36:54.574396] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-30T18:36:54.574443] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-30T18:36:54.574773] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-30T18:36:54.574830] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-30T18:36:54.913185] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-30T18:36:54.923567] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:36:55.527511] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T18:36:55.697499] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-30T18:36:56.137355] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T18:36:56.497501] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-30T18:36:56.738557] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T18:36:57.297491] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-30T18:36:57.645419] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:36:58.097483] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-30T18:36:58.112032] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T18:36:58.897493] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-30T18:36:59.604473] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-30T18:36:59.697490] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-30T18:37:00.161423] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T18:37:00.497540] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-30T18:37:01.170244] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T18:37:01.297572] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-30T18:37:02.097502] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-30T18:37:02.897524] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-30T18:37:03.244709] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-10-30T18:37:03.276712] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T18:37:03.697455] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-30T18:37:03.762607] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-30T18:37:04.148853] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:37:04.497548] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-30T18:37:05.103474] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T18:37:05.297556] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-30T18:37:05.679213] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T18:37:05.982061] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-30T18:37:06.097451] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-30T18:37:06.897474] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-30T18:37:06.957317] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T18:37:07.697503] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-30T18:37:08.123413] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T18:37:08.497469] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-30T18:37:08.521704] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T18:37:09.297501] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-30T18:37:09.932094] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T18:37:10.097474] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-30T18:37:10.239116] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T18:37:10.897482] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-30T18:37:11.708261] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-30T18:37:11.738986] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-30T18:37:11.921439] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T18:37:12.497542] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-30T18:37:13.297480] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-30T18:37:13.407474] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T18:37:13.417856] [INFO ] [REMOTE ] ERO: Full fetch complete (60791 records). [2025-10-30T18:37:13.417988] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-30T18:37:13.799071] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-30T18:37:13.799162] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-30T18:37:13.799932] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-30T18:37:13.799998] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-30T18:37:13.801345] [DEBUG] [LOCAL ] ERO: Trimmed 60791 records to 42273 (keeping 200 days of data) [2025-10-30T18:37:14.041969] [DEBUG] [LOCAL ] ERO: Primary data saved (42273 records). [2025-10-30T18:37:14.042094] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-30T18:37:14.042171] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ERO took 30.9s. Estimated remaining: 3h 24m 35s. Rate: 7.8 symbols/min [2025-10-30T18:37:14.106155] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-30T18:37:14.217880] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:14.234617] [DEBUG] [LOCAL ] ESE: Loaded 16064 existing records from primary storage. [2025-10-30T18:37:14.234905] [INFO ] [MAIN ] ESE: Loaded 16064 existing records. [2025-10-30T18:37:14.424089] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:37:14.424612] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-30T18:37:14.424715] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-30T18:37:14.424980] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-30T18:37:14.425042] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-30T18:37:14.714447] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-30T18:37:14.779701] [INFO ] [REMOTE ] ES: Full fetch complete (76470 records). [2025-10-30T18:37:14.825592] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-30T18:37:14.855337] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:14.919554] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-30T18:37:15.183135] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-30T18:37:15.301582] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-30T18:37:15.301714] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-30T18:37:15.302722] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-30T18:37:15.302805] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-30T18:37:15.320540] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T18:37:15.327106] [DEBUG] [LOCAL ] ES: Trimmed 76470 records to 53051 (keeping 200 days of data) [2025-10-30T18:37:15.327941] [INFO ] [REMOTE ] ESAB: Full fetch complete (36846 records). [2025-10-30T18:37:15.328238] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-30T18:37:15.618289] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T18:37:15.707804] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-30T18:37:16.013799] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-30T18:37:16.019934] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-30T18:37:16.020903] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-30T18:37:16.020989] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-30T18:37:16.056426] [DEBUG] [LOCAL ] ESAB: Trimmed 36846 records to 26058 (keeping 200 days of data) [2025-10-30T18:37:16.062353] [DEBUG] [LOCAL ] ES: Primary data saved (53051 records). [2025-10-30T18:37:16.062722] [INFO ] [MAIN ] ES: Full history saved. [2025-10-30T18:37:16.062812] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ES took 32.9s. Estimated remaining: 3h 24m 16s. Rate: 7.8 symbols/min [2025-10-30T18:37:16.384600] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:16.396042] [DEBUG] [LOCAL ] ESAB: Primary data saved (26058 records). [2025-10-30T18:37:16.396299] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-30T18:37:16.396762] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. ESAB took 22.2s. Estimated remaining: 3h 23m 53s. Rate: 7.9 symbols/min [2025-10-30T18:37:16.497973] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-30T18:37:16.571274] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:16.607260] [DEBUG] [LOCAL ] ESI: Loaded 50570 existing records from primary storage. [2025-10-30T18:37:16.616879] [INFO ] [MAIN ] ESI: Loaded 50570 existing records. [2025-10-30T18:37:16.740462] [DEBUG] [LOCAL ] ESNT: Loaded 37477 existing records from primary storage. [2025-10-30T18:37:16.800073] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T18:37:16.830367] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:37:16.775493] [INFO ] [MAIN ] ESNT: Loaded 37477 existing records. [2025-10-30T18:37:16.834038] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-30T18:37:16.834127] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-30T18:37:16.851942] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-30T18:37:16.870413] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-30T18:37:17.204215] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:37:17.221167] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-30T18:37:17.229292] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-30T18:37:17.287971] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-30T18:37:17.299607] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-30T18:37:17.304842] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-30T18:37:17.545849] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:17.786327] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:18.097474] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-30T18:37:18.147322] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-30T18:37:18.169103] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T18:37:18.173244] [INFO ] [REMOTE ] ERJ: Full fetch complete (73278 records). [2025-10-30T18:37:18.173905] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-30T18:37:18.580939] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-30T18:37:18.581016] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-30T18:37:18.581848] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-30T18:37:18.581909] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-30T18:37:18.583225] [DEBUG] [LOCAL ] ERJ: Trimmed 73278 records to 50568 (keeping 200 days of data) [2025-10-30T18:37:18.877558] [DEBUG] [LOCAL ] ERJ: Primary data saved (50568 records). [2025-10-30T18:37:18.877708] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-30T18:37:18.877796] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. ERJ took 35.7s. Estimated remaining: 3h 23m 34s. Rate: 7.9 symbols/min [2025-10-30T18:37:18.912117] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-30T18:37:19.050405] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:19.088009] [DEBUG] [LOCAL ] ESRT: Loaded 46361 existing records from primary storage. [2025-10-30T18:37:19.088285] [INFO ] [MAIN ] ESRT: Loaded 46361 existing records. [2025-10-30T18:37:19.261515] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:37:19.261764] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-30T18:37:19.261834] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-30T18:37:19.262254] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-30T18:37:19.262313] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-30T18:37:19.635474] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:19.660774] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T18:37:19.697790] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-30T18:37:19.697674] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T18:37:20.497495] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-30T18:37:20.789054] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T18:37:21.226084] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T18:37:21.297493] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-30T18:37:22.097485] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-30T18:37:22.393606] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T18:37:22.784989] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T18:37:22.897466] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-30T18:37:23.697486] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-30T18:37:24.194299] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T18:37:24.497475] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-30T18:37:25.190933] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-30T18:37:25.297513] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-30T18:37:26.097487] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-30T18:37:26.140188] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-30T18:37:26.414788] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:37:26.897503] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-30T18:37:27.359379] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T18:37:27.697543] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-30T18:37:27.977930] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T18:37:28.427332] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T18:37:28.497521] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-30T18:37:29.297470] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-30T18:37:29.703930] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T18:37:30.097543] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-30T18:37:30.429181] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T18:37:30.878217] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T18:37:30.897483] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-30T18:37:31.697546] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-30T18:37:32.065997] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T18:37:32.320052] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T18:37:32.497630] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-30T18:37:33.297518] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-30T18:37:33.843161] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T18:37:34.097509] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-30T18:37:34.423672] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T18:37:34.897480] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-30T18:37:34.928949] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T18:37:34.932427] [INFO ] [REMOTE ] ESE: Full fetch complete (23022 records). [2025-10-30T18:37:34.932535] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-30T18:37:35.303399] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-30T18:37:35.303536] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-30T18:37:35.304043] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-30T18:37:35.304105] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-30T18:37:35.304916] [DEBUG] [LOCAL ] ESE: Trimmed 23022 records to 16164 (keeping 200 days of data) [2025-10-30T18:37:35.406150] [DEBUG] [LOCAL ] ESE: Primary data saved (16164 records). [2025-10-30T18:37:35.406302] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-30T18:37:35.406413] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESE took 21.4s. Estimated remaining: 3h 23m 45s. Rate: 7.9 symbols/min [2025-10-30T18:37:35.574145] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:35.601957] [DEBUG] [LOCAL ] ESS: Loaded 30028 existing records from primary storage. [2025-10-30T18:37:35.602214] [INFO ] [MAIN ] ESS: Loaded 30028 existing records. [2025-10-30T18:37:35.702970] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-30T18:37:35.787738] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:37:35.788026] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-30T18:37:35.788081] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-30T18:37:35.788512] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-30T18:37:35.788597] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-30T18:37:35.974798] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T18:37:36.173757] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:36.497510] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-30T18:37:36.958704] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T18:37:37.297504] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-30T18:37:37.860948] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T18:37:37.869088] [INFO ] [REMOTE ] ESNT: Full fetch complete (56711 records). [2025-10-30T18:37:37.869192] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-30T18:37:38.104766] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-30T18:37:38.259887] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-30T18:37:38.259955] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-30T18:37:38.260694] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-30T18:37:38.260756] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-30T18:37:38.261915] [DEBUG] [LOCAL ] ESNT: Trimmed 56711 records to 37749 (keeping 200 days of data) [2025-10-30T18:37:38.481444] [DEBUG] [LOCAL ] ESNT: Primary data saved (37749 records). [2025-10-30T18:37:38.481571] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-30T18:37:38.482469] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ESNT took 22.1s. Estimated remaining: 3h 23m 28s. Rate: 7.9 symbols/min [2025-10-30T18:37:38.648999] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:38.695402] [DEBUG] [LOCAL ] ESTC: Loaded 50188 existing records from primary storage. [2025-10-30T18:37:38.695760] [INFO ] [MAIN ] ESTC: Loaded 50188 existing records. [2025-10-30T18:37:38.886933] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:37:38.887768] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-30T18:37:38.887917] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-30T18:37:38.888866] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-30T18:37:38.888928] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-30T18:37:38.910317] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-30T18:37:39.036738] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-30T18:37:39.304104] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:39.321590] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T18:37:39.697472] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-30T18:37:40.060932] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:37:40.497558] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-30T18:37:41.078951] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-30T18:37:41.297472] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-30T18:37:42.100959] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-30T18:37:42.106070] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-30T18:37:42.628165] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T18:37:42.897497] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-30T18:37:42.961300] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T18:37:43.697558] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-30T18:37:44.322244] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T18:37:44.497460] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-30T18:37:44.660503] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-30T18:37:45.297494] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-30T18:37:45.811985] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:37:46.097507] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-30T18:37:46.383314] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T18:37:46.897501] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-30T18:37:47.307013] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T18:37:47.697530] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-30T18:37:48.220769] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T18:37:48.497482] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-30T18:37:48.768719] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T18:37:49.297490] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-30T18:37:49.725327] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:37:50.097511] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-30T18:37:50.595101] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T18:37:50.897496] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-30T18:37:51.192979] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T18:37:51.697505] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-30T18:37:52.012498] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T18:37:52.497543] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-30T18:37:53.035545] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:37:53.297497] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-30T18:37:53.968282] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T18:37:53.978493] [INFO ] [REMOTE ] ESRT: Full fetch complete (66786 records). [2025-10-30T18:37:53.978630] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-30T18:37:54.102582] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-30T18:37:54.404333] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-30T18:37:54.404442] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-30T18:37:54.405272] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-30T18:37:54.405418] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-30T18:37:54.406951] [DEBUG] [LOCAL ] ESRT: Trimmed 66786 records to 46721 (keeping 200 days of data) [2025-10-30T18:37:54.511613] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T18:37:54.700351] [DEBUG] [LOCAL ] ESRT: Primary data saved (46721 records). [2025-10-30T18:37:54.700505] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-30T18:37:54.701277] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESRT took 35.8s. Estimated remaining: 3h 23m 39s. Rate: 7.8 symbols/min [2025-10-30T18:37:54.872359] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:54.872511] [DEBUG] [LOCAL ] ET: No existing data file found in primary storage. [2025-10-30T18:37:54.872549] [WARN ] [MAIN ] ET: No existing data found, performing full refresh instead. [2025-10-30T18:37:54.872692] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-30T18:37:54.872748] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-30T18:37:54.872792] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-10-30T18:37:54.872825] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-30T18:37:54.903017] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-30T18:37:55.232546] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:55.311469] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T18:37:55.697497] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-30T18:37:56.364062] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T18:37:56.497504] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-30T18:37:57.228390] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-30T18:37:57.239610] [INFO ] [REMOTE ] ESI: Full fetch complete (73342 records). [2025-10-30T18:37:57.239778] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-30T18:37:57.303800] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-30T18:37:57.641454] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-30T18:37:57.641556] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-30T18:37:57.642824] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-30T18:37:57.642909] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-30T18:37:57.644812] [DEBUG] [LOCAL ] ESI: Trimmed 73342 records to 50958 (keeping 200 days of data) [2025-10-30T18:37:57.977406] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-30T18:37:57.976361] [DEBUG] [LOCAL ] ESI: Primary data saved (50958 records). [2025-10-30T18:37:57.987092] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-30T18:37:57.987848] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ESI took 41.9s. Estimated remaining: 3h 23m 22s. Rate: 7.9 symbols/min [2025-10-30T18:37:58.102551] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-30T18:37:58.160242] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:37:58.173111] [DEBUG] [LOCAL ] ETB: Loaded 11380 existing records from primary storage. [2025-10-30T18:37:58.173317] [INFO ] [MAIN ] ETB: Loaded 11380 existing records. [2025-10-30T18:37:58.354018] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:37:58.354300] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-30T18:37:58.354410] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-30T18:37:58.354589] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-30T18:37:58.354688] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-30T18:37:58.521956] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T18:37:58.758052] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:37:58.897464] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-30T18:37:59.445797] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T18:37:59.558254] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:37:59.697513] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-30T18:38:00.497464] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-30T18:38:00.526812] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T18:38:01.297495] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-30T18:38:02.097523] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-30T18:38:02.897477] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-30T18:38:03.145550] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-30T18:38:03.349425] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T18:38:03.697586] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-30T18:38:04.087065] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-30T18:38:04.195508] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T18:38:04.292459] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-30T18:38:04.497478] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-30T18:38:05.080407] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T18:38:05.297490] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-30T18:38:05.806057] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T18:38:06.097544] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-30T18:38:06.897485] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-30T18:38:07.697457] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-30T18:38:07.771434] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T18:38:07.850175] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-30T18:38:08.362616] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-30T18:38:08.497478] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-30T18:38:09.297528] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-30T18:38:09.968629] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-30T18:38:10.097535] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-30T18:38:10.465098] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-30T18:38:10.636303] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-30T18:38:10.897499] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-30T18:38:11.697526] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-30T18:38:12.361332] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-30T18:38:12.364507] [INFO ] [REMOTE ] ETB: Full fetch complete (18537 records). [2025-10-30T18:38:12.364580] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-30T18:38:12.502639] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-30T18:38:12.737486] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-30T18:38:12.737586] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-30T18:38:12.738135] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-30T18:38:12.738218] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-30T18:38:12.739147] [DEBUG] [LOCAL ] ETB: Trimmed 18537 records to 11473 (keeping 200 days of data) [2025-10-30T18:38:12.820861] [DEBUG] [LOCAL ] ETB: Primary data saved (11473 records). [2025-10-30T18:38:12.821151] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-30T18:38:12.821288] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ETB took 14.8s. Estimated remaining: 3h 23m 29s. Rate: 7.8 symbols/min [2025-10-30T18:38:13.014279] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-30T18:38:13.031790] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:38:13.066751] [DEBUG] [LOCAL ] ETD: Loaded 26554 existing records from primary storage. [2025-10-30T18:38:13.067003] [INFO ] [MAIN ] ETD: Loaded 26554 existing records. [2025-10-30T18:38:13.240798] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:38:13.241040] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-30T18:38:13.241120] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-30T18:38:13.241475] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-30T18:38:13.241552] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-30T18:38:13.305232] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-30T18:38:13.600749] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:38:13.793274] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T18:38:13.800733] [INFO ] [REMOTE ] ESS: Full fetch complete (43593 records). [2025-10-30T18:38:13.800846] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-30T18:38:13.801455] [FATAL] [VALIDATOR ] ESS: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:38:13.801544] [FATAL] [MAIN ] ESS: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:38:13.801618] [WARN ] [MAIN ] ESS: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:38:13.801706] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-30T18:38:13.801774] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-10-30T18:38:13.801819] [INFO ] [LOCAL ] ESS: Starting deletion of derivative data. [2025-10-30T18:38:13.802020] [DEBUG] [LOCAL ] ESS: Deleted derivative data file. [2025-10-30T18:38:13.802121] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ESS took 38.4s. Estimated remaining: 3h 23m 8s. Rate: 7.9 symbols/min [2025-10-30T18:38:14.007542] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:38:14.024280] [DEBUG] [LOCAL ] ETG: Loaded 16082 existing records from primary storage. [2025-10-30T18:38:14.024575] [INFO ] [MAIN ] ETG: Loaded 16082 existing records. [2025-10-30T18:38:14.102587] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-30T18:38:14.234452] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:38:14.234714] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-30T18:38:14.234777] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-30T18:38:14.235022] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-30T18:38:14.235078] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-30T18:38:14.681516] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:38:14.897516] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-30T18:38:15.277276] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-30T18:38:15.611773] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T18:38:15.697457] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-30T18:38:15.720768] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T18:38:16.497503] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-30T18:38:17.297486] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-30T18:38:17.369462] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T18:38:17.380938] [INFO ] [REMOTE ] ESTC: Full fetch complete (72561 records). [2025-10-30T18:38:17.381079] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-30T18:38:17.765889] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-30T18:38:17.765978] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-30T18:38:17.766838] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-30T18:38:17.766901] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-30T18:38:17.768272] [DEBUG] [LOCAL ] ESTC: Trimmed 72561 records to 50555 (keeping 200 days of data) [2025-10-30T18:38:18.063877] [DEBUG] [LOCAL ] ESTC: Primary data saved (50555 records). [2025-10-30T18:38:18.064121] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-30T18:38:18.065018] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ESTC took 39.6s. Estimated remaining: 3h 22m 53s. Rate: 7.9 symbols/min [2025-10-30T18:38:18.107564] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-30T18:38:18.238245] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:38:18.281124] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-30T18:38:18.298439] [DEBUG] [LOCAL ] ETJ: Loaded 15693 existing records from primary storage. [2025-10-30T18:38:18.298700] [INFO ] [MAIN ] ETJ: Loaded 15693 existing records. [2025-10-30T18:38:18.532578] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:38:18.540988] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T18:38:18.540409] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-30T18:38:18.545548] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-30T18:38:18.545848] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-30T18:38:18.545905] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-30T18:38:18.901534] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-30T18:38:18.989021] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:38:19.002407] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-30T18:38:19.534685] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T18:38:19.697472] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-30T18:38:20.479253] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-30T18:38:20.497454] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-30T18:38:21.297507] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-30T18:38:21.590118] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T18:38:21.969446] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T18:38:22.097539] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-30T18:38:22.897554] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-30T18:38:23.084908] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-30T18:38:23.697474] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-30T18:38:23.797305] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T18:38:24.412672] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-30T18:38:24.497521] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-30T18:38:25.237819] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T18:38:25.297522] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-30T18:38:26.097500] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-30T18:38:26.786161] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T18:38:26.897492] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-30T18:38:27.440002] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-30T18:38:27.604333] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-30T18:38:27.697546] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-30T18:38:28.497529] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-30T18:38:28.597439] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T18:38:29.279185] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T18:38:29.297480] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-30T18:38:29.840920] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T18:38:30.097573] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-30T18:38:30.897537] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-30T18:38:31.485113] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-30T18:38:31.697507] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-30T18:38:31.832072] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-30T18:38:32.472639] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T18:38:32.497462] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-30T18:38:33.297470] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-30T18:38:33.437891] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T18:38:34.097490] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-30T18:38:34.865445] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-30T18:38:34.897450] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-30T18:38:35.214236] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-30T18:38:35.703482] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-30T18:38:35.706236] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T18:38:36.487826] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-30T18:38:36.491723] [INFO ] [REMOTE ] ETG: Full fetch complete (24340 records). [2025-10-30T18:38:36.491806] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-30T18:38:36.502896] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-30T18:38:36.851610] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-30T18:38:36.851711] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-30T18:38:36.852175] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-30T18:38:36.852217] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-30T18:38:36.852809] [DEBUG] [LOCAL ] ETG: Trimmed 24340 records to 16220 (keeping 200 days of data) [2025-10-30T18:38:36.946218] [DEBUG] [LOCAL ] ETG: Primary data saved (16220 records). [2025-10-30T18:38:36.946359] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-30T18:38:36.946455] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETG took 23.1s. Estimated remaining: 3h 23m 9s. Rate: 7.8 symbols/min [2025-10-30T18:38:37.110780] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:38:37.156596] [DEBUG] [LOCAL ] ETN: Loaded 52486 existing records from primary storage. [2025-10-30T18:38:37.156911] [INFO ] [MAIN ] ETN: Loaded 52486 existing records. [2025-10-30T18:38:37.298639] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-30T18:38:37.341767] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:38:37.342228] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-30T18:38:37.342304] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-30T18:38:37.342964] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-30T18:38:37.343023] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-30T18:38:37.641971] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T18:38:37.722754] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:38:38.097495] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-30T18:38:38.897511] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-30T18:38:39.238805] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T18:38:39.244339] [INFO ] [REMOTE ] ETD: Full fetch complete (38464 records). [2025-10-30T18:38:39.244440] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-30T18:38:39.587875] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T18:38:39.632140] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-30T18:38:39.632256] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-30T18:38:39.633100] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-30T18:38:39.633166] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-30T18:38:39.634098] [DEBUG] [LOCAL ] ETD: Trimmed 38464 records to 26876 (keeping 200 days of data) [2025-10-30T18:38:39.721200] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-30T18:38:39.774989] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-30T18:38:39.830436] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-30T18:38:39.835273] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-30T18:38:39.972044] [DEBUG] [LOCAL ] ETD: Primary data saved (26876 records). [2025-10-30T18:38:39.989503] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-30T18:38:39.989628] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ETD took 27.2s. Estimated remaining: 3h 22m 51s. Rate: 7.8 symbols/min [2025-10-30T18:38:40.371441] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:38:40.422323] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-30T18:38:40.422480] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-30T18:38:40.423427] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-30T18:38:40.423559] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-30T18:38:40.427769] [DEBUG] [LOCAL ] ETO: Loaded 6656 existing records from primary storage. [2025-10-30T18:38:40.428175] [INFO ] [MAIN ] ETO: Loaded 6656 existing records. [2025-10-30T18:38:40.491803] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54179 (keeping 200 days of data) [2025-10-30T18:38:40.503168] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-30T18:38:40.701432] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:38:40.706888] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-30T18:38:40.709853] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-30T18:38:40.714661] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-30T18:38:40.717076] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-30T18:38:41.337665] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-30T18:38:41.335374] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:38:41.337959] [INFO ] [MAIN ] ET: Full history saved. [2025-10-30T18:38:41.338921] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ET took 46.6s. Estimated remaining: 3h 22m 31s. Rate: 7.9 symbols/min [2025-10-30T18:38:41.339366] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T18:38:41.343565] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-30T18:38:41.545147] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:38:41.594141] [DEBUG] [LOCAL ] ETR: Loaded 53168 existing records from primary storage. [2025-10-30T18:38:41.605987] [INFO ] [MAIN ] ETR: Loaded 53168 existing records. [2025-10-30T18:38:41.707370] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-30T18:38:41.816189] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:38:41.816395] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-30T18:38:41.816455] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-30T18:38:41.817146] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-30T18:38:41.817203] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-30T18:38:42.102497] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-30T18:38:42.228190] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T18:38:42.234367] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:38:42.837852] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-30T18:38:42.897476] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-30T18:38:43.508192] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T18:38:43.697495] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-30T18:38:44.497524] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-30T18:38:45.297882] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-30T18:38:45.300631] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T18:38:45.372050] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-30T18:38:46.097501] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-30T18:38:46.531414] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-30T18:38:46.897497] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-30T18:38:46.943349] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-30T18:38:47.697497] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-30T18:38:47.782910] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T18:38:47.786487] [INFO ] [REMOTE ] ETJ: Full fetch complete (25004 records). [2025-10-30T18:38:47.786556] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-30T18:38:48.151066] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-30T18:38:48.165203] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-30T18:38:48.165281] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-30T18:38:48.165780] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-30T18:38:48.165840] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-30T18:38:48.166549] [DEBUG] [LOCAL ] ETJ: Trimmed 25004 records to 15781 (keeping 200 days of data) [2025-10-30T18:38:48.261309] [DEBUG] [LOCAL ] ETJ: Primary data saved (15781 records). [2025-10-30T18:38:48.261458] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-30T18:38:48.261541] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETJ took 30.2s. Estimated remaining: 3h 22m 22s. Rate: 7.9 symbols/min [2025-10-30T18:38:48.430236] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:38:48.478296] [DEBUG] [LOCAL ] ETSY: Loaded 53556 existing records from primary storage. [2025-10-30T18:38:48.478618] [INFO ] [MAIN ] ETSY: Loaded 53556 existing records. [2025-10-30T18:38:48.507322] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-30T18:38:48.671894] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:38:48.672164] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-30T18:38:48.672217] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-30T18:38:48.672795] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-30T18:38:48.672850] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-30T18:38:49.022675] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:38:49.128084] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T18:38:49.297492] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-30T18:38:50.097496] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-30T18:38:50.610115] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T18:38:50.752454] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T18:38:50.897526] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-30T18:38:51.697507] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-30T18:38:52.497506] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-30T18:38:52.681899] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-30T18:38:53.152386] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T18:38:53.297494] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-30T18:38:53.969083] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-30T18:38:54.097493] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-30T18:38:54.797961] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T18:38:54.897489] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-30T18:38:55.399098] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T18:38:55.697510] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-30T18:38:56.497500] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-30T18:38:56.729194] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-30T18:38:57.216076] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-30T18:38:57.297459] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-30T18:38:58.061852] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-30T18:38:58.097468] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-30T18:38:58.660244] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T18:38:58.897502] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-30T18:38:59.466503] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T18:38:59.697472] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-30T18:39:00.081781] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T18:39:00.497465] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-30T18:39:00.606763] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-30T18:39:01.297522] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-30T18:39:02.097509] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-30T18:39:02.897516] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-30T18:39:03.372125] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-30T18:39:03.697480] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-30T18:39:03.746452] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-10-30T18:39:03.793016] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-30T18:39:03.848382] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-30T18:39:04.111154] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-30T18:39:04.497502] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-30T18:39:05.297509] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-30T18:39:05.865386] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-30T18:39:06.097497] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-30T18:39:06.576997] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T18:39:06.728929] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T18:39:06.897502] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-30T18:39:07.697555] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-30T18:39:08.333028] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-30T18:39:08.334913] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T18:39:08.337741] [INFO ] [REMOTE ] ETO: Full fetch complete (9674 records). [2025-10-30T18:39:08.348385] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-30T18:39:08.498752] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-30T18:39:08.713174] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-30T18:39:08.713239] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-30T18:39:08.713534] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-30T18:39:08.713577] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-30T18:39:08.714173] [DEBUG] [LOCAL ] ETO: Trimmed 9674 records to 6676 (keeping 200 days of data) [2025-10-30T18:39:08.754250] [DEBUG] [LOCAL ] ETO: Primary data saved (6676 records). [2025-10-30T18:39:08.754361] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-30T18:39:08.754437] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETO took 28.7s. Estimated remaining: 3h 22m 40s. Rate: 7.8 symbols/min [2025-10-30T18:39:08.922470] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:08.941906] [DEBUG] [LOCAL ] ETV: Loaded 21300 existing records from primary storage. [2025-10-30T18:39:08.942161] [INFO ] [MAIN ] ETV: Loaded 21300 existing records. [2025-10-30T18:39:09.112790] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:09.112973] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-30T18:39:09.113021] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-30T18:39:09.113273] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-30T18:39:09.113330] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-30T18:39:09.306492] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-30T18:39:09.465019] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:09.959984] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:39:10.097511] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-30T18:39:10.897463] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-30T18:39:10.984056] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-30T18:39:11.118872] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-30T18:39:11.697492] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-30T18:39:12.173870] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:39:12.497513] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-30T18:39:13.124766] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T18:39:13.297473] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-30T18:39:14.097504] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-30T18:39:14.286517] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-30T18:39:14.897464] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-30T18:39:15.058794] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-30T18:39:15.070422] [INFO ] [REMOTE ] ETSY: Full fetch complete (77665 records). [2025-10-30T18:39:15.070570] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-30T18:39:15.463195] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-30T18:39:15.463306] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-30T18:39:15.464360] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-30T18:39:15.464479] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-30T18:39:15.465972] [DEBUG] [LOCAL ] ETSY: Trimmed 77665 records to 53946 (keeping 200 days of data) [2025-10-30T18:39:15.707326] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-30T18:39:15.725808] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T18:39:15.739981] [INFO ] [REMOTE ] ETN: Full fetch complete (76589 records). [2025-10-30T18:39:15.741955] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-30T18:39:15.982379] [DEBUG] [LOCAL ] ETSY: Primary data saved (53946 records). [2025-10-30T18:39:15.987789] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-30T18:39:16.014515] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETSY took 27.8s. Estimated remaining: 3h 22m 32s. Rate: 7.8 symbols/min [2025-10-30T18:39:16.177607] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-30T18:39:16.415463] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:16.464095] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-30T18:39:16.464467] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-30T18:39:16.465621] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-30T18:39:16.465787] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-30T18:39:16.479150] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-30T18:39:16.490478] [DEBUG] [LOCAL ] ETN: Trimmed 76589 records to 52870 (keeping 200 days of data) [2025-10-30T18:39:16.546676] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-30T18:39:16.564696] [DEBUG] [LOCAL ] ETW: Loaded 24420 existing records from primary storage. [2025-10-30T18:39:16.590687] [INFO ] [MAIN ] ETW: Loaded 24420 existing records. [2025-10-30T18:39:16.809961] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:16.869865] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-30T18:39:16.870204] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-30T18:39:16.895148] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-30T18:39:16.895486] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-30T18:39:17.317758] [DEBUG] [LOCAL ] ETN: Primary data saved (52870 records). [2025-10-30T18:39:17.330039] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-30T18:39:17.305921] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-30T18:39:17.340500] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETN took 40.4s. Estimated remaining: 3h 22m 11s. Rate: 7.8 symbols/min [2025-10-30T18:39:17.401615] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:17.541621] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:17.548369] [DEBUG] [LOCAL ] ETX: Loaded 5349 existing records from primary storage. [2025-10-30T18:39:17.548572] [INFO ] [MAIN ] ETX: Loaded 5349 existing records. [2025-10-30T18:39:17.727346] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:17.727564] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-30T18:39:17.727612] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-30T18:39:17.727798] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-30T18:39:17.727850] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-30T18:39:18.099242] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-30T18:39:18.103944] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:18.233831] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T18:39:18.252932] [INFO ] [REMOTE ] ETR: Full fetch complete (77272 records). [2025-10-30T18:39:18.258265] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-30T18:39:18.258736] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-30T18:39:18.648154] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-30T18:39:18.648228] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-30T18:39:18.649098] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-30T18:39:18.649160] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-30T18:39:18.650500] [DEBUG] [LOCAL ] ETR: Trimmed 77272 records to 53558 (keeping 200 days of data) [2025-10-30T18:39:18.925077] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-30T18:39:18.975004] [DEBUG] [LOCAL ] ETR: Primary data saved (53558 records). [2025-10-30T18:39:18.975136] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-30T18:39:18.975976] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETR took 37.6s. Estimated remaining: 3h 21m 52s. Rate: 7.9 symbols/min [2025-10-30T18:39:19.145315] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:19.166238] [DEBUG] [LOCAL ] ETY: Loaded 21658 existing records from primary storage. [2025-10-30T18:39:19.166491] [INFO ] [MAIN ] ETY: Loaded 21658 existing records. [2025-10-30T18:39:19.358515] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:19.359730] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:39:19.364753] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-30T18:39:19.365281] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-30T18:39:19.365796] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-30T18:39:19.365880] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-30T18:39:19.646807] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-30T18:39:19.700704] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-30T18:39:19.730452] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:20.121087] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T18:39:20.497574] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-30T18:39:21.297465] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-30T18:39:21.475482] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T18:39:22.097483] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-30T18:39:22.563391] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:39:22.654950] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T18:39:22.897471] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-30T18:39:23.647083] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T18:39:23.697477] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-30T18:39:24.027754] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T18:39:24.497493] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-30T18:39:25.287127] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T18:39:25.297450] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-30T18:39:26.097471] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-30T18:39:26.169474] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-30T18:39:26.770504] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-30T18:39:26.897485] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-30T18:39:27.652063] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T18:39:27.697467] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-30T18:39:28.471291] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-30T18:39:28.497461] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-30T18:39:29.297466] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-30T18:39:29.484478] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T18:39:29.490778] [INFO ] [REMOTE ] ETV: Full fetch complete (31833 records). [2025-10-30T18:39:29.490880] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-30T18:39:29.953752] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-30T18:39:29.953831] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-30T18:39:29.954398] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-30T18:39:29.954442] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-30T18:39:29.955248] [DEBUG] [LOCAL ] ETV: Trimmed 31833 records to 21462 (keeping 200 days of data) [2025-10-30T18:39:30.087213] [DEBUG] [LOCAL ] ETV: Primary data saved (21462 records). [2025-10-30T18:39:30.087333] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-30T18:39:30.087412] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETV took 21.3s. Estimated remaining: 3h 21m 51s. Rate: 7.9 symbols/min [2025-10-30T18:39:30.102603] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-30T18:39:30.269716] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:30.285695] [DEBUG] [LOCAL ] EVC: Loaded 17352 existing records from primary storage. [2025-10-30T18:39:30.285917] [INFO ] [MAIN ] EVC: Loaded 17352 existing records. [2025-10-30T18:39:30.455491] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T18:39:30.491223] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:30.491432] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-30T18:39:30.491479] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-30T18:39:30.491892] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-30T18:39:30.491949] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-30T18:39:30.598855] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T18:39:30.849089] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:30.897466] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-30T18:39:31.205856] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-30T18:39:31.697503] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-30T18:39:32.497578] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-30T18:39:32.955331] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:39:33.297474] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-30T18:39:33.328993] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-30T18:39:34.097476] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-30T18:39:34.127292] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T18:39:34.602787] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T18:39:34.897501] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-30T18:39:35.687016] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-30T18:39:35.697449] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-30T18:39:36.500340] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-30T18:39:36.502252] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T18:39:37.297467] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-30T18:39:37.321069] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-30T18:39:37.936078] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T18:39:38.097468] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-30T18:39:38.897475] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-30T18:39:38.963691] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T18:39:39.354875] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T18:39:39.697540] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-30T18:39:40.497533] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-30T18:39:40.844942] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T18:39:41.297504] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-30T18:39:41.367704] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T18:39:41.916908] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T18:39:42.097484] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-30T18:39:42.897475] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-30T18:39:42.977056] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T18:39:43.697476] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-30T18:39:43.829991] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T18:39:44.061311] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T18:39:44.497505] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-30T18:39:45.284319] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-30T18:39:45.297464] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-30T18:39:46.097475] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-30T18:39:46.142821] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T18:39:46.897459] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-30T18:39:46.990928] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T18:39:47.697483] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-30T18:39:47.743078] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T18:39:48.317958] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T18:39:48.497498] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-30T18:39:49.297467] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-30T18:39:49.393236] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-30T18:39:49.803529] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-30T18:39:49.805173] [INFO ] [REMOTE ] ETX: Full fetch complete (6840 records). [2025-10-30T18:39:49.805243] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-30T18:39:50.102738] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-30T18:39:50.190131] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-30T18:39:50.190205] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-30T18:39:50.190391] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-30T18:39:50.190437] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-30T18:39:50.190854] [DEBUG] [LOCAL ] ETX: Trimmed 6840 records to 5365 (keeping 200 days of data) [2025-10-30T18:39:50.223109] [DEBUG] [LOCAL ] ETX: Primary data saved (5365 records). [2025-10-30T18:39:50.223194] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-30T18:39:50.223268] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETX took 32.9s. Estimated remaining: 3h 22m 9s. Rate: 7.8 symbols/min [2025-10-30T18:39:50.393755] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:50.423616] [DEBUG] [LOCAL ] EVEX: Loaded 33559 existing records from primary storage. [2025-10-30T18:39:50.423895] [INFO ] [MAIN ] EVEX: Loaded 33559 existing records. [2025-10-30T18:39:50.598565] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:50.598812] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-30T18:39:50.598860] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-30T18:39:50.600046] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-30T18:39:50.600102] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-30T18:39:50.904683] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-30T18:39:50.949240] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T18:39:51.001313] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:51.656198] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T18:39:51.697495] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-30T18:39:52.497476] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-30T18:39:52.545159] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T18:39:53.297502] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-30T18:39:53.323371] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T18:39:53.328478] [INFO ] [REMOTE ] EVC: Full fetch complete (27998 records). [2025-10-30T18:39:53.328602] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-30T18:39:53.780089] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-30T18:39:53.780394] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-30T18:39:53.780917] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-30T18:39:53.780980] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-30T18:39:53.781615] [DEBUG] [LOCAL ] EVC: Trimmed 27998 records to 17424 (keeping 200 days of data) [2025-10-30T18:39:53.880999] [DEBUG] [LOCAL ] EVC: Primary data saved (17424 records). [2025-10-30T18:39:53.881133] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-30T18:39:53.881235] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. EVC took 23.8s. Estimated remaining: 3h 21m 53s. Rate: 7.8 symbols/min [2025-10-30T18:39:54.058885] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:54.068263] [DEBUG] [LOCAL ] EVF: Loaded 9374 existing records from primary storage. [2025-10-30T18:39:54.068478] [INFO ] [MAIN ] EVF: Loaded 9374 existing records. [2025-10-30T18:39:54.102687] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-30T18:39:54.255309] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:54.255534] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-30T18:39:54.255591] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-30T18:39:54.256048] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-30T18:39:54.256107] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-30T18:39:54.632873] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T18:39:54.645502] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:54.897504] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-30T18:39:55.158310] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T18:39:55.163275] [INFO ] [REMOTE ] ETY: Full fetch complete (33650 records). [2025-10-30T18:39:55.163369] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-30T18:39:55.534460] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-30T18:39:55.534547] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-30T18:39:55.535145] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-30T18:39:55.535244] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-30T18:39:55.536082] [DEBUG] [LOCAL ] ETY: Trimmed 33650 records to 21795 (keeping 200 days of data) [2025-10-30T18:39:55.668943] [DEBUG] [LOCAL ] ETY: Primary data saved (21795 records). [2025-10-30T18:39:55.682191] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-30T18:39:55.682312] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. ETY took 36.7s. Estimated remaining: 3h 21m 33s. Rate: 7.8 symbols/min [2025-10-30T18:39:55.704475] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-30T18:39:55.695111] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T18:39:55.862790] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:55.869699] [DEBUG] [LOCAL ] EVG: Loaded 5753 existing records from primary storage. [2025-10-30T18:39:55.869893] [INFO ] [MAIN ] EVG: Loaded 5753 existing records. [2025-10-30T18:39:56.059510] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:56.059770] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-30T18:39:56.059822] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-30T18:39:56.060051] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-30T18:39:56.060117] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-30T18:39:56.420515] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:56.497464] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-30T18:39:56.628480] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-30T18:39:57.297469] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-30T18:39:57.307371] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-30T18:39:58.097547] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-30T18:39:58.248553] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-30T18:39:58.254263] [INFO ] [REMOTE ] ETW: Full fetch complete (36400 records). [2025-10-30T18:39:58.254337] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-30T18:39:58.622919] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-30T18:39:58.623011] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-30T18:39:58.623580] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-30T18:39:58.623635] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-30T18:39:58.624404] [DEBUG] [LOCAL ] ETW: Trimmed 36400 records to 24618 (keeping 200 days of data) [2025-10-30T18:39:58.767449] [DEBUG] [LOCAL ] ETW: Primary data saved (24618 records). [2025-10-30T18:39:58.767561] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-30T18:39:58.767636] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. ETW took 42.7s. Estimated remaining: 3h 21m 17s. Rate: 7.9 symbols/min [2025-10-30T18:39:58.914469] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-30T18:39:58.940031] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:39:58.956766] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T18:39:59.000006] [DEBUG] [LOCAL ] EVH: Loaded 49524 existing records from primary storage. [2025-10-30T18:39:59.000285] [INFO ] [MAIN ] EVH: Loaded 49524 existing records. [2025-10-30T18:39:59.174464] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:39:59.174692] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-30T18:39:59.174749] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-30T18:39:59.175581] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-30T18:39:59.175637] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-30T18:39:59.528121] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T18:39:59.532273] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:39:59.697478] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-30T18:40:00.497521] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-30T18:40:01.297473] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-30T18:40:01.418327] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-30T18:40:01.686953] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T18:40:02.097506] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-30T18:40:02.889402] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-30T18:40:02.897441] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-30T18:40:03.329486] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:40:03.697467] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-30T18:40:03.805239] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T18:40:04.148459] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T18:40:04.497503] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-30T18:40:05.297494] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-30T18:40:05.892035] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-30T18:40:05.987867] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-30T18:40:06.097483] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-30T18:40:06.897494] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-30T18:40:07.285832] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T18:40:07.697492] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-30T18:40:07.941695] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T18:40:08.084486] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-30T18:40:08.497505] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-30T18:40:09.025959] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-30T18:40:09.297487] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-30T18:40:09.747111] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-30T18:40:10.097506] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-30T18:40:10.573257] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-30T18:40:10.897505] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-30T18:40:11.606759] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-30T18:40:11.697516] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-30T18:40:12.497505] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-30T18:40:12.952526] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-30T18:40:12.984770] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-30T18:40:13.297508] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-30T18:40:13.678309] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-30T18:40:14.097498] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-30T18:40:14.514313] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-30T18:40:14.897521] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-30T18:40:15.697551] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-30T18:40:16.015034] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-30T18:40:16.187865] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T18:40:16.497522] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-30T18:40:17.297498] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-30T18:40:17.717315] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T18:40:18.097489] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-30T18:40:18.499231] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T18:40:18.710168] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-30T18:40:18.712150] [INFO ] [REMOTE ] EVG: Full fetch complete (8137 records). [2025-10-30T18:40:18.712221] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-30T18:40:18.902623] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-30T18:40:19.074243] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-30T18:40:19.074324] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-30T18:40:19.074544] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-30T18:40:19.074585] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-30T18:40:19.075005] [DEBUG] [LOCAL ] EVG: Trimmed 8137 records to 5813 (keeping 200 days of data) [2025-10-30T18:40:19.109401] [DEBUG] [LOCAL ] EVG: Primary data saved (5813 records). [2025-10-30T18:40:19.109515] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-30T18:40:19.109614] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. EVG took 23.4s. Estimated remaining: 3h 21m 34s. Rate: 7.8 symbols/min [2025-10-30T18:40:19.275929] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:40:19.290493] [DEBUG] [LOCAL ] EVN: Loaded 10843 existing records from primary storage. [2025-10-30T18:40:19.290819] [INFO ] [MAIN ] EVN: Loaded 10843 existing records. [2025-10-30T18:40:19.475954] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:40:19.476182] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-30T18:40:19.476230] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-30T18:40:19.476572] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-30T18:40:19.476628] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-30T18:40:19.704594] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-30T18:40:19.883967] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:40:20.193692] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T18:40:20.415477] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T18:40:20.497532] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-30T18:40:20.887581] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T18:40:21.297513] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-30T18:40:22.097590] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-30T18:40:22.642915] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T18:40:22.652936] [INFO ] [REMOTE ] EVEX: Full fetch complete (44504 records). [2025-10-30T18:40:22.653066] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-30T18:40:22.908852] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-30T18:40:23.049305] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-30T18:40:23.049388] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-30T18:40:23.050069] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-30T18:40:23.050132] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-30T18:40:23.051159] [DEBUG] [LOCAL ] EVEX: Trimmed 44504 records to 33878 (keeping 200 days of data) [2025-10-30T18:40:23.238985] [DEBUG] [LOCAL ] EVEX: Primary data saved (33878 records). [2025-10-30T18:40:23.239125] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-30T18:40:23.239225] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVEX took 33.0s. Estimated remaining: 3h 21m 20s. Rate: 7.8 symbols/min [2025-10-30T18:40:23.416294] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:40:23.416521] [DEBUG] [LOCAL ] EVR: No existing data file found in primary storage. [2025-10-30T18:40:23.416571] [WARN ] [MAIN ] EVR: No existing data found, performing full refresh instead. [2025-10-30T18:40:23.416710] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-30T18:40:23.416758] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-30T18:40:23.416800] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-10-30T18:40:23.416831] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-30T18:40:23.702522] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-30T18:40:23.770120] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:40:23.808562] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-30T18:40:24.043418] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T18:40:24.459051] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-30T18:40:24.497459] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-30T18:40:25.142793] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T18:40:25.145594] [INFO ] [REMOTE ] EVF: Full fetch complete (12943 records). [2025-10-30T18:40:25.145726] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-30T18:40:25.311604] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-30T18:40:25.534125] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-30T18:40:25.534200] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-30T18:40:25.534517] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-30T18:40:25.534556] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-30T18:40:25.535041] [DEBUG] [LOCAL ] EVF: Trimmed 12943 records to 9414 (keeping 200 days of data) [2025-10-30T18:40:25.587999] [DEBUG] [LOCAL ] EVF: Primary data saved (9414 records). [2025-10-30T18:40:25.588109] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-30T18:40:25.588250] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVF took 31.7s. Estimated remaining: 3h 21m 2s. Rate: 7.8 symbols/min [2025-10-30T18:40:25.761849] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:40:25.771428] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-30T18:40:25.787501] [DEBUG] [LOCAL ] EVT: Loaded 16180 existing records from primary storage. [2025-10-30T18:40:25.787742] [INFO ] [MAIN ] EVT: Loaded 16180 existing records. [2025-10-30T18:40:25.970273] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:40:25.970509] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-30T18:40:25.970557] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-30T18:40:25.971029] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-30T18:40:25.971088] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-30T18:40:26.102604] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-30T18:40:26.335885] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:40:26.582198] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-30T18:40:26.897503] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-30T18:40:27.697509] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-30T18:40:28.271037] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-30T18:40:28.305756] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T18:40:28.497502] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-30T18:40:28.980751] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T18:40:29.297544] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-30T18:40:29.998972] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T18:40:30.097491] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-30T18:40:30.897559] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-30T18:40:31.382021] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T18:40:31.582119] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-30T18:40:31.697495] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-30T18:40:32.497521] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-30T18:40:32.557288] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T18:40:33.297579] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-30T18:40:33.568843] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T18:40:33.747829] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-30T18:40:34.097494] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-30T18:40:34.811294] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-30T18:40:34.897497] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-30T18:40:35.435570] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-30T18:40:35.697530] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-30T18:40:36.497466] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-30T18:40:36.952223] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T18:40:37.297522] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-30T18:40:37.879223] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T18:40:37.909301] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T18:40:38.097509] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-30T18:40:38.743394] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-30T18:40:38.897495] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-30T18:40:39.605865] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T18:40:39.609016] [INFO ] [REMOTE ] EVN: Full fetch complete (16710 records). [2025-10-30T18:40:39.609090] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-30T18:40:39.702740] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-30T18:40:39.984272] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-30T18:40:39.984365] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-30T18:40:39.984750] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-30T18:40:39.984812] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-30T18:40:39.985317] [DEBUG] [LOCAL ] EVN: Trimmed 16710 records to 10947 (keeping 200 days of data) [2025-10-30T18:40:40.050125] [DEBUG] [LOCAL ] EVN: Primary data saved (10947 records). [2025-10-30T18:40:40.050258] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-30T18:40:40.050340] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVN took 20.9s. Estimated remaining: 3h 21m 7s. Rate: 7.8 symbols/min [2025-10-30T18:40:40.248036] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:40:40.271637] [DEBUG] [LOCAL ] EVTC: Loaded 26600 existing records from primary storage. [2025-10-30T18:40:40.271935] [INFO ] [MAIN ] EVTC: Loaded 26600 existing records. [2025-10-30T18:40:40.452838] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:40:40.453042] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-30T18:40:40.453091] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-30T18:40:40.453598] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-30T18:40:40.453686] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-30T18:40:40.508893] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-30T18:40:40.813999] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:40:41.081462] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T18:40:41.243527] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T18:40:41.297521] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-30T18:40:42.097507] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-30T18:40:42.638568] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:40:42.897545] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-30T18:40:43.242772] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T18:40:43.697508] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-30T18:40:44.361202] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T18:40:44.498677] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-30T18:40:44.503583] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T18:40:45.297559] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-30T18:40:45.614575] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:40:46.097513] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-30T18:40:46.767512] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T18:40:46.778346] [INFO ] [REMOTE ] EVH: Full fetch complete (71940 records). [2025-10-30T18:40:46.778471] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-30T18:40:46.902590] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-30T18:40:47.176001] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-30T18:40:47.176117] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-30T18:40:47.177106] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-30T18:40:47.177199] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-30T18:40:47.194752] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T18:40:47.201028] [DEBUG] [LOCAL ] EVH: Trimmed 71940 records to 49885 (keeping 200 days of data) [2025-10-30T18:40:47.482591] [DEBUG] [LOCAL ] EVH: Primary data saved (49885 records). [2025-10-30T18:40:47.482795] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-30T18:40:47.483722] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVH took 48.7s. Estimated remaining: 3h 20m 59s. Rate: 7.8 symbols/min [2025-10-30T18:40:47.649229] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:40:47.687584] [DEBUG] [LOCAL ] EVTL: Loaded 42274 existing records from primary storage. [2025-10-30T18:40:47.687885] [INFO ] [MAIN ] EVTL: Loaded 42274 existing records. [2025-10-30T18:40:47.708100] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-30T18:40:47.871128] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:40:47.871719] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-30T18:40:47.871815] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-30T18:40:47.872524] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-30T18:40:47.872582] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-30T18:40:48.197356] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T18:40:48.254892] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:40:48.497488] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-30T18:40:48.723232] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T18:40:49.297492] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-30T18:40:49.918082] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-30T18:40:49.952185] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T18:40:50.097471] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-30T18:40:50.769755] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-30T18:40:50.897498] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-30T18:40:51.697479] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-30T18:40:51.761226] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T18:40:52.497492] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-30T18:40:52.824719] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T18:40:53.297472] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-30T18:40:53.332536] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:40:53.336263] [INFO ] [REMOTE ] EVT: Full fetch complete (24766 records). [2025-10-30T18:40:53.336398] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-30T18:40:53.728939] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-30T18:40:53.729018] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-30T18:40:53.729484] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-30T18:40:53.729523] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-30T18:40:53.730260] [DEBUG] [LOCAL ] EVT: Trimmed 24766 records to 16338 (keeping 200 days of data) [2025-10-30T18:40:53.831911] [DEBUG] [LOCAL ] EVT: Primary data saved (16338 records). [2025-10-30T18:40:53.832071] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-30T18:40:53.832170] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVT took 28.2s. Estimated remaining: 3h 20m 49s. Rate: 7.8 symbols/min [2025-10-30T18:40:54.016170] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:40:54.040461] [DEBUG] [LOCAL ] EVTR: Loaded 25634 existing records from primary storage. [2025-10-30T18:40:54.040729] [INFO ] [MAIN ] EVTR: Loaded 25634 existing records. [2025-10-30T18:40:54.100681] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-30T18:40:54.236785] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:40:54.237592] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-30T18:40:54.237760] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-30T18:40:54.244214] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-30T18:40:54.254016] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-30T18:40:54.260208] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T18:40:54.639894] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:40:54.897572] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-30T18:40:55.220490] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:40:55.697517] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-30T18:40:55.878951] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T18:40:56.497512] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-30T18:40:56.762371] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T18:40:57.213201] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-30T18:40:57.297544] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-30T18:40:58.097476] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-30T18:40:58.154523] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-30T18:40:58.897550] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-30T18:40:58.924797] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T18:40:59.697508] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-30T18:40:59.788434] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-30T18:41:00.497530] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-30T18:41:01.032240] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T18:41:01.297560] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-30T18:41:01.836869] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T18:41:02.097551] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-30T18:41:02.897809] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-30T18:41:03.115442] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-30T18:41:03.143554] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:41:03.697470] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-30T18:41:04.080992] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T18:41:04.087437] [INFO ] [REMOTE ] EVR: Full fetch complete (50144 records). [2025-10-30T18:41:04.087548] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-30T18:41:04.088228] [FATAL] [VALIDATOR ] EVR: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:41:04.088331] [FATAL] [MAIN ] EVR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:41:04.088408] [WARN ] [MAIN ] EVR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:41:04.088483] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-30T18:41:04.088575] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-10-30T18:41:04.088630] [INFO ] [LOCAL ] EVR: Starting deletion of derivative data. [2025-10-30T18:41:04.088719] [DEBUG] [LOCAL ] EVR: No derivative data file found to delete. [2025-10-30T18:41:04.088784] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EVR took 40.8s. Estimated remaining: 3h 20m 47s. Rate: 7.8 symbols/min [2025-10-30T18:41:04.292382] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:04.343416] [DEBUG] [LOCAL ] EW: Loaded 53387 existing records from primary storage. [2025-10-30T18:41:04.343763] [INFO ] [MAIN ] EW: Loaded 53387 existing records. [2025-10-30T18:41:04.501471] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-30T18:41:04.534859] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T18:41:04.580912] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:04.586242] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-30T18:41:04.586307] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-30T18:41:04.587370] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-30T18:41:04.587430] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-30T18:41:04.978032] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:41:05.297493] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-30T18:41:05.543329] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T18:41:06.097503] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-30T18:41:06.516138] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:41:06.897508] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-30T18:41:07.142021] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T18:41:07.148676] [INFO ] [REMOTE ] EVTC: Full fetch complete (38510 records). [2025-10-30T18:41:07.148780] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-30T18:41:07.560572] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-30T18:41:07.560697] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-30T18:41:07.561292] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-30T18:41:07.561335] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-30T18:41:07.562209] [DEBUG] [LOCAL ] EVTC: Trimmed 38510 records to 26818 (keeping 200 days of data) [2025-10-30T18:41:07.700257] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-30T18:41:07.727286] [DEBUG] [LOCAL ] EVTC: Primary data saved (26818 records). [2025-10-30T18:41:07.727457] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-30T18:41:07.727705] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVTC took 27.7s. Estimated remaining: 3h 20m 31s. Rate: 7.8 symbols/min [2025-10-30T18:41:07.818602] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T18:41:07.915524] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:07.945462] [DEBUG] [LOCAL ] EXG: Loaded 32854 existing records from primary storage. [2025-10-30T18:41:07.945741] [INFO ] [MAIN ] EXG: Loaded 32854 existing records. [2025-10-30T18:41:08.118153] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:08.118351] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-30T18:41:08.118397] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-30T18:41:08.119014] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-30T18:41:08.119072] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-30T18:41:08.463142] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:41:08.497514] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-30T18:41:09.215721] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-30T18:41:09.297495] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-30T18:41:10.059636] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T18:41:10.097467] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-30T18:41:10.423600] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T18:41:10.897519] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-30T18:41:11.668053] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T18:41:11.697451] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-30T18:41:12.473952] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T18:41:12.497467] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-30T18:41:13.233686] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-30T18:41:13.297468] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-30T18:41:13.869446] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T18:41:14.097511] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-30T18:41:14.904840] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-30T18:41:14.911182] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T18:41:14.924878] [INFO ] [REMOTE ] EVTL: Full fetch complete (55948 records). [2025-10-30T18:41:14.925029] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-30T18:41:15.268617] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T18:41:15.413339] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-30T18:41:15.413418] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-30T18:41:15.414191] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-30T18:41:15.414311] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-30T18:41:15.415519] [DEBUG] [LOCAL ] EVTL: Trimmed 55948 records to 42652 (keeping 200 days of data) [2025-10-30T18:41:15.675297] [DEBUG] [LOCAL ] EVTL: Primary data saved (42652 records). [2025-10-30T18:41:15.675434] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-30T18:41:15.676398] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EVTL took 28.2s. Estimated remaining: 3h 20m 24s. Rate: 7.8 symbols/min [2025-10-30T18:41:15.702620] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-30T18:41:15.853931] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:15.854094] [DEBUG] [LOCAL ] EXK: No existing data file found in primary storage. [2025-10-30T18:41:15.854132] [WARN ] [MAIN ] EXK: No existing data found, performing full refresh instead. [2025-10-30T18:41:15.854240] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-30T18:41:15.854282] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-30T18:41:15.854324] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-10-30T18:41:15.854357] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-30T18:41:16.206963] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:41:16.277803] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T18:41:16.497508] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-30T18:41:16.876369] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T18:41:17.297460] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-30T18:41:17.372257] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-30T18:41:18.097526] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-30T18:41:18.339373] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-30T18:41:18.897575] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-30T18:41:19.697485] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-30T18:41:19.801976] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T18:41:20.341636] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T18:41:20.497469] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-30T18:41:20.591149] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T18:41:21.297560] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-30T18:41:21.852632] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T18:41:22.010332] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T18:41:22.097538] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-30T18:41:22.897473] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-30T18:41:22.925767] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-30T18:41:23.697477] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-30T18:41:23.800115] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T18:41:24.497497] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-30T18:41:25.107928] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T18:41:25.297507] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-30T18:41:25.605815] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T18:41:26.097498] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-30T18:41:26.715227] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T18:41:26.897525] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-30T18:41:27.615802] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T18:41:27.697540] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-30T18:41:28.233128] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T18:41:28.497592] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-30T18:41:28.829618] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T18:41:29.297497] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-30T18:41:30.097583] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-30T18:41:30.897489] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-30T18:41:30.948599] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-30T18:41:31.111494] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-30T18:41:31.197308] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T18:41:31.697517] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-30T18:41:31.957602] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T18:41:32.497508] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-30T18:41:33.297472] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-30T18:41:33.417276] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-30T18:41:33.518315] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-30T18:41:33.526216] [INFO ] [REMOTE ] EVTR: Full fetch complete (34742 records). [2025-10-30T18:41:33.526326] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-30T18:41:33.906286] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-30T18:41:33.906382] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-30T18:41:33.907004] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-30T18:41:33.907065] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-30T18:41:33.907805] [DEBUG] [LOCAL ] EVTR: Trimmed 34742 records to 25899 (keeping 200 days of data) [2025-10-30T18:41:34.057999] [DEBUG] [LOCAL ] EVTR: Primary data saved (25899 records). [2025-10-30T18:41:34.058119] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-30T18:41:34.058192] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EVTR took 40.2s. Estimated remaining: 3h 20m 38s. Rate: 7.8 symbols/min [2025-10-30T18:41:34.102614] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-30T18:41:34.226024] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:34.251570] [DEBUG] [LOCAL ] EXP: Loaded 28758 existing records from primary storage. [2025-10-30T18:41:34.251839] [INFO ] [MAIN ] EXP: Loaded 28758 existing records. [2025-10-30T18:41:34.423238] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:34.423423] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-30T18:41:34.423487] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-30T18:41:34.424126] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-30T18:41:34.424209] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-30T18:41:34.776497] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:41:34.810518] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T18:41:34.897449] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-30T18:41:35.106866] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T18:41:35.697504] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-30T18:41:36.185270] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T18:41:36.497508] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-30T18:41:37.297513] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-30T18:41:37.468303] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-30T18:41:37.480107] [INFO ] [REMOTE ] EW: Full fetch complete (77506 records). [2025-10-30T18:41:37.480257] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-30T18:41:37.894081] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-30T18:41:37.894203] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-30T18:41:37.895408] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-30T18:41:37.895516] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-30T18:41:37.897985] [DEBUG] [LOCAL ] EW: Trimmed 77506 records to 53777 (keeping 200 days of data) [2025-10-30T18:41:38.109630] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-30T18:41:38.151770] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-30T18:41:38.273739] [DEBUG] [LOCAL ] EW: Primary data saved (53777 records). [2025-10-30T18:41:38.279983] [INFO ] [MAIN ] EW: Full history saved. [2025-10-30T18:41:38.289840] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EW took 34.2s. Estimated remaining: 3h 20m 23s. Rate: 7.8 symbols/min [2025-10-30T18:41:38.327095] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T18:41:38.477789] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:38.520004] [DEBUG] [LOCAL ] EXPD: Loaded 47368 existing records from primary storage. [2025-10-30T18:41:38.520329] [INFO ] [MAIN ] EXPD: Loaded 47368 existing records. [2025-10-30T18:41:38.711525] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:38.711787] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-30T18:41:38.711838] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-30T18:41:38.712621] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-30T18:41:38.712720] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-30T18:41:38.903499] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-30T18:41:39.074368] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:41:39.417579] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-30T18:41:39.697506] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-30T18:41:40.300982] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T18:41:40.308569] [INFO ] [REMOTE ] EXG: Full fetch complete (49190 records). [2025-10-30T18:41:40.308730] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-30T18:41:40.500784] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-30T18:41:40.701203] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-30T18:41:40.701278] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-30T18:41:40.701953] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-30T18:41:40.702014] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-30T18:41:40.702988] [DEBUG] [LOCAL ] EXG: Trimmed 49190 records to 33101 (keeping 200 days of data) [2025-10-30T18:41:40.895155] [DEBUG] [LOCAL ] EXG: Primary data saved (33101 records). [2025-10-30T18:41:40.895287] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-30T18:41:40.895368] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EXG took 33.2s. Estimated remaining: 3h 20m 6s. Rate: 7.8 symbols/min [2025-10-30T18:41:41.297470] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-30T18:41:41.374073] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-30T18:41:41.572367] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T18:41:42.097528] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-30T18:41:42.900786] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-30T18:41:42.984126] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-30T18:41:43.050626] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-30T18:41:43.697490] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-30T18:41:44.065143] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T18:41:44.497493] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-30T18:41:44.796967] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T18:41:45.297513] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-30T18:41:45.910037] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T18:41:46.097483] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-30T18:41:46.897498] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-30T18:41:47.477242] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T18:41:47.697472] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-30T18:41:47.752685] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-30T18:41:47.765128] [INFO ] [REMOTE ] EXK: Full fetch complete (76903 records). [2025-10-30T18:41:47.765271] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-30T18:41:48.173767] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-30T18:41:48.174339] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-30T18:41:48.175025] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T18:41:48.175948] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-30T18:41:48.182892] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-30T18:41:48.184272] [DEBUG] [LOCAL ] EXK: Trimmed 76903 records to 53573 (keeping 200 days of data) [2025-10-30T18:41:48.482240] [DEBUG] [LOCAL ] EXK: Primary data saved (53573 records). [2025-10-30T18:41:48.482389] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-30T18:41:48.482490] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EXK took 32.8s. Estimated remaining: 3h 19m 58s. Rate: 7.8 symbols/min [2025-10-30T18:41:48.497466] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-30T18:41:48.875585] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T18:41:49.297487] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-30T18:41:49.533705] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T18:41:50.097496] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-30T18:41:50.424826] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T18:41:50.897477] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-30T18:41:51.035115] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T18:41:51.697483] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-30T18:41:52.523401] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-30T18:41:52.534164] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-30T18:41:52.679091] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T18:41:53.297541] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-30T18:41:53.647860] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T18:41:54.097500] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-30T18:41:54.357762] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T18:41:54.367048] [INFO ] [REMOTE ] EXP: Full fetch complete (42961 records). [2025-10-30T18:41:54.367202] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-30T18:41:54.745813] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-30T18:41:54.746116] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-30T18:41:54.746809] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-30T18:41:54.746870] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-30T18:41:54.747762] [DEBUG] [LOCAL ] EXP: Trimmed 42961 records to 29030 (keeping 200 days of data) [2025-10-30T18:41:54.923750] [DEBUG] [LOCAL ] EXP: Primary data saved (29030 records). [2025-10-30T18:41:54.923876] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-30T18:41:54.923963] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXP took 20.9s. Estimated remaining: 3h 19m 48s. Rate: 7.8 symbols/min [2025-10-30T18:41:55.475414] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T18:41:55.485768] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-30T18:41:56.920535] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T18:41:56.930738] [INFO ] [REMOTE ] EXPD: Full fetch complete (69197 records). [2025-10-30T18:41:56.930897] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-30T18:41:57.375186] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-30T18:41:57.375279] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-30T18:41:57.376139] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-30T18:41:57.376202] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-30T18:41:57.377538] [DEBUG] [LOCAL ] EXPD: Trimmed 69197 records to 47710 (keeping 200 days of data) [2025-10-30T18:41:57.664118] [DEBUG] [LOCAL ] EXPD: Primary data saved (47710 records). [2025-10-30T18:41:57.664270] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-30T18:41:57.664376] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. EXPD took 19.4s. Estimated remaining: 3h 19m 30s. Rate: 7.8 symbols/min [2025-10-30T18:41:58.232745] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:58.317447] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:58.364745] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:58.388990] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:41:58.434941] [DEBUG] [LOCAL ] EXR: Loaded 45153 existing records from primary storage. [2025-10-30T18:41:58.449285] [INFO ] [MAIN ] EXR: Loaded 45153 existing records. [2025-10-30T18:41:58.613407] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-30T18:41:58.598789] [DEBUG] [LOCAL ] FAF: Loaded 41147 existing records from primary storage. [2025-10-30T18:41:58.630396] [DEBUG] [LOCAL ] FBIN: Loaded 50142 existing records from primary storage. [2025-10-30T18:41:58.659857] [INFO ] [MAIN ] FBIN: Loaded 50142 existing records. [2025-10-30T18:41:58.659995] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-30T18:41:58.685051] [INFO ] [MAIN ] FAF: Loaded 41147 existing records. [2025-10-30T18:41:58.810953] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:58.833176] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-30T18:41:58.878725] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-30T18:41:58.950135] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-30T18:41:59.027729] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-30T18:41:59.233838] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:59.261563] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-30T18:41:59.292693] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-30T18:41:59.348209] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-30T18:41:59.339328] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:59.367095] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-30T18:41:59.403914] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:41:59.485072] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-30T18:41:59.448461] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-30T18:41:59.501468] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-30T18:41:59.501388] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-30T18:41:59.566565] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-30T18:41:59.590863] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-30T18:41:59.669368] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-30T18:41:59.760690] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-30T18:42:00.227566] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:00.291484] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-30T18:42:00.444702] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:00.486190] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-30T18:42:00.783812] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:00.798197] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-30T18:42:00.822087] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:00.822465] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-30T18:42:02.070416] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-30T18:42:02.080283] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-30T18:42:02.105238] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T18:42:02.113117] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-30T18:42:02.646720] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-30T18:42:02.659873] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-30T18:42:03.137125] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T18:42:03.144186] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-30T18:42:03.348898] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T18:42:03.358810] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-30T18:42:03.605981] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-30T18:42:03.617285] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-30T18:42:03.882448] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T18:42:03.892105] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-30T18:42:04.343939] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:42:04.497465] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-30T18:42:04.644425] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T18:42:05.169500] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T18:42:05.297465] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-30T18:42:05.367164] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-30T18:42:06.036254] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T18:42:06.097506] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-30T18:42:06.551051] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T18:42:06.897510] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-30T18:42:07.174297] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T18:42:07.697498] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-30T18:42:08.277350] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T18:42:08.497509] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-30T18:42:09.297510] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-30T18:42:09.826069] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T18:42:09.890023] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-30T18:42:10.097494] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-30T18:42:10.782446] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-30T18:42:10.897507] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-30T18:42:11.261297] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T18:42:11.697523] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-30T18:42:12.125198] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T18:42:12.497497] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-30T18:42:12.771127] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T18:42:13.297503] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-30T18:42:14.097484] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-30T18:42:14.497759] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T18:42:14.577619] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-30T18:42:14.897513] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-30T18:42:15.612483] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-30T18:42:15.697459] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-30T18:42:16.061032] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T18:42:16.497514] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-30T18:42:17.187934] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T18:42:17.297460] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-30T18:42:18.097555] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-30T18:42:18.472581] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-30T18:42:18.682371] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T18:42:18.897522] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-30T18:42:19.477317] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T18:42:19.485918] [INFO ] [REMOTE ] FAF: Full fetch complete (58442 records). [2025-10-30T18:42:19.486060] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-30T18:42:19.702965] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-30T18:42:19.877381] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-30T18:42:19.877456] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-30T18:42:19.878191] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-30T18:42:19.878251] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-30T18:42:19.879403] [DEBUG] [LOCAL ] FAF: Trimmed 58442 records to 41446 (keeping 200 days of data) [2025-10-30T18:42:20.125339] [DEBUG] [LOCAL ] FAF: Primary data saved (41446 records). [2025-10-30T18:42:20.125469] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-30T18:42:20.126599] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. FAF took 22.5s. Estimated remaining: 3h 19m 52s. Rate: 7.8 symbols/min [2025-10-30T18:42:20.313994] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:42:20.340026] [DEBUG] [LOCAL ] FBK: Loaded 27011 existing records from primary storage. [2025-10-30T18:42:20.340266] [INFO ] [MAIN ] FBK: Loaded 27011 existing records. [2025-10-30T18:42:20.515540] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:42:20.516166] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-30T18:42:20.510797] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-30T18:42:20.517311] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-30T18:42:20.517588] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-30T18:42:20.517686] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-30T18:42:20.910553] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:20.940550] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-30T18:42:21.190350] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T18:42:21.297539] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-30T18:42:21.923038] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T18:42:22.097469] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-30T18:42:22.897518] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-30T18:42:23.223444] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-30T18:42:23.677283] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-30T18:42:23.687840] [INFO ] [REMOTE ] FBIN: Full fetch complete (72804 records). [2025-10-30T18:42:23.687997] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-30T18:42:23.702783] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-30T18:42:24.077087] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-30T18:42:24.077204] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-30T18:42:24.078147] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-30T18:42:24.078211] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-30T18:42:24.079810] [DEBUG] [LOCAL ] FBIN: Trimmed 72804 records to 50513 (keeping 200 days of data) [2025-10-30T18:42:24.385985] [DEBUG] [LOCAL ] FBIN: Primary data saved (50513 records). [2025-10-30T18:42:24.386126] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-30T18:42:24.386240] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. FBIN took 26.7s. Estimated remaining: 3h 19m 37s. Rate: 7.8 symbols/min [2025-10-30T18:42:24.498885] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-30T18:42:24.567854] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-30T18:42:24.586728] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:42:24.636321] [DEBUG] [LOCAL ] FBP: Loaded 45384 existing records from primary storage. [2025-10-30T18:42:24.636665] [INFO ] [MAIN ] FBP: Loaded 45384 existing records. [2025-10-30T18:42:24.812789] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:42:24.813030] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-30T18:42:24.813080] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-30T18:42:24.813847] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-30T18:42:24.813904] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-30T18:42:25.165396] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:25.297475] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-30T18:42:25.414372] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T18:42:25.731504] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-30T18:42:26.097505] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-30T18:42:26.504183] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T18:42:26.897509] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-30T18:42:27.697539] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-30T18:42:28.106199] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T18:42:28.152316] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-30T18:42:28.285071] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-30T18:42:28.497536] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-30T18:42:29.305118] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-30T18:42:29.309001] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T18:42:30.097505] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-30T18:42:30.263257] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T18:42:30.897500] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-30T18:42:31.697495] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-30T18:42:32.123490] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:42:32.316690] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-30T18:42:32.330117] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-30T18:42:32.330280] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-30T18:42:32.504292] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-30T18:42:32.739624] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-30T18:42:32.739736] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-30T18:42:32.740675] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-30T18:42:32.740740] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-30T18:42:32.742156] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-30T18:42:33.079716] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-30T18:42:33.079971] [INFO ] [MAIN ] F: Full history saved. [2025-10-30T18:42:33.080117] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. F took 35.4s. Estimated remaining: 3h 19m 32s. Rate: 7.8 symbols/min [2025-10-30T18:42:33.249764] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:42:33.277759] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-30T18:42:33.288200] [INFO ] [REMOTE ] EXR: Full fetch complete (66081 records). [2025-10-30T18:42:33.288452] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-30T18:42:33.302574] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-30T18:42:33.588373] [DEBUG] [LOCAL ] FBRT: Loaded 34662 existing records from primary storage. [2025-10-30T18:42:33.622923] [INFO ] [MAIN ] FBRT: Loaded 34662 existing records. [2025-10-30T18:42:33.830583] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-30T18:42:33.841126] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-30T18:42:33.912760] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:42:33.907268] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-30T18:42:33.913157] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-30T18:42:33.919190] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-30T18:42:33.913253] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-30T18:42:33.930804] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T18:42:33.930907] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-30T18:42:33.937564] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-30T18:42:34.008700] [DEBUG] [LOCAL ] EXR: Trimmed 66081 records to 45539 (keeping 200 days of data) [2025-10-30T18:42:34.106823] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-30T18:42:34.541749] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:34.609577] [DEBUG] [LOCAL ] EXR: Primary data saved (45539 records). [2025-10-30T18:42:34.609772] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-30T18:42:34.610537] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. EXR took 36.9s. Estimated remaining: 3h 19m 12s. Rate: 7.8 symbols/min [2025-10-30T18:42:34.790258] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:42:34.824328] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-30T18:42:34.841126] [DEBUG] [LOCAL ] FC: Loaded 13843 existing records from primary storage. [2025-10-30T18:42:34.841326] [INFO ] [MAIN ] FC: Loaded 13843 existing records. [2025-10-30T18:42:34.909352] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-30T18:42:35.028144] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:42:35.028629] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-30T18:42:35.033935] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-30T18:42:35.040367] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-30T18:42:35.040860] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-30T18:42:35.040788] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T18:42:35.398741] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:35.697492] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-30T18:42:35.926699] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T18:42:36.497499] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-30T18:42:36.723715] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T18:42:37.297516] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-30T18:42:37.419500] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T18:42:37.909636] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T18:42:38.097499] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-30T18:42:38.795944] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T18:42:38.897509] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-30T18:42:39.697539] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-30T18:42:40.071157] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-30T18:42:40.497463] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-30T18:42:40.682856] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T18:42:41.297551] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-30T18:42:41.392439] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-30T18:42:42.018268] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-30T18:42:42.097481] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-30T18:42:42.610945] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T18:42:42.897491] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-30T18:42:43.697493] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-30T18:42:44.082140] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T18:42:44.497490] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-30T18:42:44.522316] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-30T18:42:45.037834] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T18:42:45.297498] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-30T18:42:46.097487] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-30T18:42:46.475546] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-30T18:42:46.895900] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T18:42:46.901760] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-30T18:42:47.695065] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-30T18:42:47.699449] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-30T18:42:48.497463] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-30T18:42:48.668778] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T18:42:49.081102] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T18:42:49.297501] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-30T18:42:49.998996] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T18:42:50.097501] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-30T18:42:50.833604] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-30T18:42:50.836879] [INFO ] [REMOTE ] FC: Full fetch complete (21597 records). [2025-10-30T18:42:50.836953] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-30T18:42:50.902590] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-30T18:42:51.203751] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-30T18:42:51.203831] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-30T18:42:51.204284] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-30T18:42:51.204345] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-30T18:42:51.204968] [DEBUG] [LOCAL ] FC: Trimmed 21597 records to 13920 (keeping 200 days of data) [2025-10-30T18:42:51.283188] [DEBUG] [LOCAL ] FC: Primary data saved (13920 records). [2025-10-30T18:42:51.283313] [INFO ] [MAIN ] FC: Full history saved. [2025-10-30T18:42:51.283390] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FC took 16.7s. Estimated remaining: 3h 19m 22s. Rate: 7.8 symbols/min [2025-10-30T18:42:51.449438] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:42:51.449618] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-10-30T18:42:51.449684] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-10-30T18:42:51.449820] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-30T18:42:51.449893] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-30T18:42:51.449951] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-30T18:42:51.449984] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-30T18:42:51.706164] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-30T18:42:51.830213] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:52.140573] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T18:42:52.497497] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-30T18:42:52.976123] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T18:42:52.983156] [INFO ] [REMOTE ] FBK: Full fetch complete (35682 records). [2025-10-30T18:42:52.983257] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-30T18:42:53.302584] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-30T18:42:53.363134] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-30T18:42:53.363204] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-30T18:42:53.363850] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-30T18:42:53.363912] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-30T18:42:53.364804] [DEBUG] [LOCAL ] FBK: Trimmed 35682 records to 27216 (keeping 200 days of data) [2025-10-30T18:42:53.525038] [DEBUG] [LOCAL ] FBK: Primary data saved (27216 records). [2025-10-30T18:42:53.525175] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-30T18:42:53.525253] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBK took 33.4s. Estimated remaining: 3h 19m 4s. Rate: 7.8 symbols/min [2025-10-30T18:42:53.700311] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:42:53.724804] [DEBUG] [LOCAL ] FCN: Loaded 25831 existing records from primary storage. [2025-10-30T18:42:53.725040] [INFO ] [MAIN ] FCN: Loaded 25831 existing records. [2025-10-30T18:42:53.903958] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:42:53.904183] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-30T18:42:53.904231] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-30T18:42:53.904464] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-30T18:42:53.904520] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-30T18:42:54.098950] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-30T18:42:54.284950] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:42:54.310596] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-30T18:42:54.475723] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:42:54.897488] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-30T18:42:55.485581] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:42:55.697530] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-30T18:42:55.945699] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:42:56.497477] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-30T18:42:56.523162] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T18:42:57.297492] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-30T18:42:57.622370] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T18:42:58.038179] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T18:42:58.097465] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-30T18:42:58.897490] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-30T18:42:59.098565] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T18:42:59.697496] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-30T18:43:00.313459] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T18:43:00.323702] [INFO ] [REMOTE ] FBP: Full fetch complete (66816 records). [2025-10-30T18:43:00.323825] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-30T18:43:00.497498] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-30T18:43:00.718428] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-30T18:43:00.718528] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-30T18:43:00.719435] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-30T18:43:00.719500] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-30T18:43:00.720963] [DEBUG] [LOCAL ] FBP: Trimmed 66816 records to 45731 (keeping 200 days of data) [2025-10-30T18:43:01.011516] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T18:43:01.024847] [DEBUG] [LOCAL ] FBP: Primary data saved (45731 records). [2025-10-30T18:43:01.025231] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-30T18:43:01.025322] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FBP took 36.6s. Estimated remaining: 3h 18m 56s. Rate: 7.8 symbols/min [2025-10-30T18:43:01.204898] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:01.238339] [DEBUG] [LOCAL ] FCPT: Loaded 36500 existing records from primary storage. [2025-10-30T18:43:01.238612] [INFO ] [MAIN ] FCPT: Loaded 36500 existing records. [2025-10-30T18:43:01.306267] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-30T18:43:01.428723] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:43:01.428894] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-30T18:43:01.428941] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-30T18:43:01.429435] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-30T18:43:01.429474] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-30T18:43:01.805108] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:02.097505] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-30T18:43:02.246998] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T18:43:02.271631] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-30T18:43:02.897548] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-30T18:43:03.439728] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:43:03.697497] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-30T18:43:03.890944] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T18:43:04.497485] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-30T18:43:04.603831] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-30T18:43:05.297476] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-30T18:43:05.323896] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T18:43:06.097484] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-30T18:43:06.583369] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T18:43:06.897520] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-30T18:43:07.211081] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T18:43:07.697494] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-30T18:43:07.912606] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T18:43:08.497490] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-30T18:43:08.805384] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T18:43:09.297513] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-30T18:43:09.550575] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:43:10.097542] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-30T18:43:10.612601] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T18:43:10.897520] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-30T18:43:11.332302] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:43:11.697516] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-30T18:43:11.767853] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T18:43:12.497517] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-30T18:43:12.784420] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T18:43:13.260984] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-30T18:43:13.297470] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-30T18:43:14.087258] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-30T18:43:14.097456] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-30T18:43:14.897491] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-30T18:43:15.193608] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-30T18:43:15.697502] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-30T18:43:15.963845] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T18:43:16.497493] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-30T18:43:16.945308] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:43:17.297532] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-30T18:43:17.467908] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T18:43:18.097505] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-30T18:43:18.348191] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T18:43:18.897501] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-30T18:43:19.428767] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T18:43:19.435062] [INFO ] [REMOTE ] FCN: Full fetch complete (36993 records). [2025-10-30T18:43:19.435156] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-30T18:43:19.708165] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-30T18:43:19.849509] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-30T18:43:19.849621] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-30T18:43:19.850470] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-30T18:43:19.850537] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-30T18:43:19.851463] [DEBUG] [LOCAL ] FCN: Trimmed 36993 records to 26029 (keeping 200 days of data) [2025-10-30T18:43:20.024436] [DEBUG] [LOCAL ] FCN: Primary data saved (26029 records). [2025-10-30T18:43:20.024572] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-30T18:43:20.024673] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FCN took 26.5s. Estimated remaining: 3h 19m 10s. Rate: 7.8 symbols/min [2025-10-30T18:43:20.221320] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:20.221750] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-30T18:43:20.221854] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-30T18:43:20.222037] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-30T18:43:20.222082] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-30T18:43:20.222212] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-30T18:43:20.222304] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-30T18:43:20.359751] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T18:43:20.409735] [INFO ] [REMOTE ] FCF: Full fetch complete (57950 records). [2025-10-30T18:43:20.418293] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-30T18:43:20.497851] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-30T18:43:20.916251] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:21.089743] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-30T18:43:21.097588] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-30T18:43:21.110965] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-30T18:43:21.111125] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-30T18:43:21.115320] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T18:43:21.124113] [DEBUG] [LOCAL ] FCF: Trimmed 57950 records to 38840 (keeping 200 days of data) [2025-10-30T18:43:21.318803] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-30T18:43:21.351829] [DEBUG] [LOCAL ] FCF: Primary data saved (38840 records). [2025-10-30T18:43:21.351952] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-30T18:43:21.352024] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FCF took 30.1s. Estimated remaining: 3h 18m 50s. Rate: 7.8 symbols/min [2025-10-30T18:43:21.519842] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:21.533581] [DEBUG] [LOCAL ] FCT: Loaded 14480 existing records from primary storage. [2025-10-30T18:43:21.533856] [INFO ] [MAIN ] FCT: Loaded 14480 existing records. [2025-10-30T18:43:21.707768] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:43:21.708025] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-30T18:43:21.708073] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-30T18:43:21.708387] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-30T18:43:21.708444] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-30T18:43:21.864122] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T18:43:22.100923] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:22.101011] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-30T18:43:22.104590] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T18:43:22.113468] [INFO ] [REMOTE ] FBRT: Full fetch complete (49663 records). [2025-10-30T18:43:22.113561] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-30T18:43:22.407240] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-30T18:43:22.496076] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-30T18:43:22.496153] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-30T18:43:22.496883] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-30T18:43:22.496945] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-30T18:43:22.497926] [DEBUG] [LOCAL ] FBRT: Trimmed 49663 records to 35046 (keeping 200 days of data) [2025-10-30T18:43:22.706920] [DEBUG] [LOCAL ] FBRT: Primary data saved (35046 records). [2025-10-30T18:43:22.707060] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-30T18:43:22.707990] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FBRT took 49.6s. Estimated remaining: 3h 18m 31s. Rate: 7.8 symbols/min [2025-10-30T18:43:22.891761] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:22.897547] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-30T18:43:22.943881] [DEBUG] [LOCAL ] FCX: Loaded 53702 existing records from primary storage. [2025-10-30T18:43:22.944210] [INFO ] [MAIN ] FCX: Loaded 53702 existing records. [2025-10-30T18:43:23.133075] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:43:23.133272] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-30T18:43:23.133319] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-30T18:43:23.134410] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-30T18:43:23.134467] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-30T18:43:23.216458] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-30T18:43:23.502462] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:23.697506] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-30T18:43:24.497565] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-30T18:43:25.274617] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-30T18:43:25.297459] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-30T18:43:25.469000] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-30T18:43:26.097527] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-30T18:43:26.897504] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-30T18:43:27.022561] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-30T18:43:27.123746] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-30T18:43:27.240801] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T18:43:27.697505] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-30T18:43:28.497495] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-30T18:43:28.808401] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T18:43:29.297555] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-30T18:43:29.813140] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T18:43:30.097504] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-30T18:43:30.462608] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-30T18:43:30.614812] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T18:43:30.897506] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-30T18:43:31.571626] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-30T18:43:31.697546] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-30T18:43:32.171926] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T18:43:32.497515] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-30T18:43:33.297509] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-30T18:43:33.617211] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T18:43:33.677320] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T18:43:33.685461] [INFO ] [REMOTE ] FCPT: Full fetch complete (53794 records). [2025-10-30T18:43:33.685568] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-30T18:43:34.073525] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-30T18:43:34.073605] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-30T18:43:34.074364] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-30T18:43:34.074426] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-30T18:43:34.075671] [DEBUG] [LOCAL ] FCPT: Trimmed 53794 records to 36785 (keeping 200 days of data) [2025-10-30T18:43:34.130359] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-30T18:43:34.300333] [DEBUG] [LOCAL ] FCPT: Primary data saved (36785 records). [2025-10-30T18:43:34.300476] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-30T18:43:34.300554] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCPT took 33.3s. Estimated remaining: 3h 18m 30s. Rate: 7.8 symbols/min [2025-10-30T18:43:34.469782] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:34.497520] [DEBUG] [LOCAL ] FDP: Loaded 29454 existing records from primary storage. [2025-10-30T18:43:34.497820] [INFO ] [MAIN ] FDP: Loaded 29454 existing records. [2025-10-30T18:43:34.682277] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:43:34.682580] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-30T18:43:34.682699] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-30T18:43:34.683052] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-30T18:43:34.683103] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-30T18:43:34.861864] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T18:43:34.906976] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-30T18:43:35.080209] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:35.697524] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-30T18:43:36.386405] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-30T18:43:36.497492] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-30T18:43:36.982625] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-30T18:43:37.040209] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T18:43:37.297507] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-30T18:43:38.097501] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-30T18:43:38.820177] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T18:43:38.897503] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-30T18:43:39.172762] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-30T18:43:39.300004] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T18:43:39.697530] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-30T18:43:39.926994] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-30T18:43:40.497495] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-30T18:43:40.739611] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-30T18:43:41.297503] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-30T18:43:42.097468] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-30T18:43:42.134211] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T18:43:42.897496] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-30T18:43:43.172162] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-30T18:43:43.643147] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-30T18:43:43.697460] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-30T18:43:44.497501] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-30T18:43:45.102107] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-30T18:43:45.102844] [INFO ] [REMOTE ] FCRX: Full fetch complete (1614 records). [2025-10-30T18:43:45.102912] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-30T18:43:45.279697] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-30T18:43:45.279903] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:43:45.279970] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:43:45.280019] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-30T18:43:45.280076] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-30T18:43:45.280111] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-30T18:43:45.280179] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-30T18:43:45.280233] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCRX took 25.3s. Estimated remaining: 3h 18m 29s. Rate: 7.8 symbols/min [2025-10-30T18:43:45.302633] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-30T18:43:45.455444] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:45.455774] [DEBUG] [LOCAL ] FDS: No existing data file found in primary storage. [2025-10-30T18:43:45.455828] [WARN ] [MAIN ] FDS: No existing data found, performing full refresh instead. [2025-10-30T18:43:45.455936] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-30T18:43:45.455978] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-30T18:43:45.456018] [DEBUG] [LOCAL ] FDS: No primary data file found to delete. [2025-10-30T18:43:45.456050] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-30T18:43:45.831283] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:45.872700] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-30T18:43:46.097506] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-30T18:43:46.310360] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T18:43:46.897464] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-30T18:43:47.364622] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:43:47.628105] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T18:43:47.697481] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-30T18:43:48.497526] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-30T18:43:49.206153] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-30T18:43:49.297501] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-30T18:43:49.639331] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T18:43:50.097511] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-30T18:43:50.899160] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-30T18:43:50.902870] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-30T18:43:50.924811] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T18:43:50.930035] [INFO ] [REMOTE ] FCT: Full fetch complete (21214 records). [2025-10-30T18:43:50.930237] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-30T18:43:51.283590] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-30T18:43:51.283689] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-30T18:43:51.284129] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-30T18:43:51.284170] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-30T18:43:51.284765] [DEBUG] [LOCAL ] FCT: Trimmed 21214 records to 14574 (keeping 200 days of data) [2025-10-30T18:43:51.369541] [DEBUG] [LOCAL ] FCT: Primary data saved (14574 records). [2025-10-30T18:43:51.369695] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-30T18:43:51.369783] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FCT took 30.0s. Estimated remaining: 3h 18m 18s. Rate: 7.8 symbols/min [2025-10-30T18:43:51.556886] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:51.604348] [DEBUG] [LOCAL ] FDX: Loaded 50976 existing records from primary storage. [2025-10-30T18:43:51.604669] [INFO ] [MAIN ] FDX: Loaded 50976 existing records. [2025-10-30T18:43:51.702879] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-30T18:43:51.797742] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:43:51.798026] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-30T18:43:51.798099] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-30T18:43:51.803999] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-30T18:43:51.810781] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-30T18:43:51.811302] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T18:43:52.170596] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:52.497435] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-30T18:43:53.297552] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-30T18:43:53.472965] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T18:43:54.107395] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-30T18:43:54.110993] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-30T18:43:54.123332] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-30T18:43:54.123450] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-30T18:43:54.514015] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-30T18:43:54.514091] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-30T18:43:54.514971] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-30T18:43:54.515032] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-30T18:43:54.516461] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54092 (keeping 200 days of data) [2025-10-30T18:43:54.849010] [DEBUG] [LOCAL ] FCX: Primary data saved (54092 records). [2025-10-30T18:43:54.849221] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-30T18:43:54.850379] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FCX took 32.1s. Estimated remaining: 3h 18m 3s. Rate: 7.8 symbols/min [2025-10-30T18:43:54.902368] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-30T18:43:55.058585] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:43:55.056084] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-30T18:43:55.114185] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T18:43:55.138376] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-30T18:43:55.138730] [INFO ] [MAIN ] FE: Loaded 53430 existing records. [2025-10-30T18:43:55.313597] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:43:55.313851] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-30T18:43:55.313899] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-30T18:43:55.314376] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-30T18:43:55.314416] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-30T18:43:55.665959] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:43:55.697454] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-30T18:43:55.832524] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T18:43:56.497491] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-30T18:43:57.302586] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-30T18:43:57.320382] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-30T18:43:57.493762] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T18:43:58.097465] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-30T18:43:58.223976] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T18:43:58.897553] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-30T18:43:59.394587] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:43:59.697510] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-30T18:43:59.873195] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T18:44:00.497528] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-30T18:44:01.004170] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T18:44:01.297537] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-30T18:44:01.883353] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T18:44:02.097600] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-30T18:44:02.519237] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T18:44:02.897500] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-30T18:44:03.583852] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T18:44:03.697487] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-30T18:44:04.436860] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-30T18:44:04.497483] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-30T18:44:04.629406] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T18:44:05.297563] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-30T18:44:06.026730] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T18:44:06.097517] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-30T18:44:06.292114] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T18:44:06.299125] [INFO ] [REMOTE ] FDP: Full fetch complete (42920 records). [2025-10-30T18:44:06.299361] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-30T18:44:06.729625] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-30T18:44:06.729768] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-30T18:44:06.730919] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-30T18:44:06.730988] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-30T18:44:06.732471] [DEBUG] [LOCAL ] FDP: Trimmed 42920 records to 29681 (keeping 200 days of data) [2025-10-30T18:44:06.897598] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-30T18:44:06.909459] [DEBUG] [LOCAL ] FDP: Primary data saved (29681 records). [2025-10-30T18:44:06.909717] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-30T18:44:06.909810] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FDP took 32.6s. Estimated remaining: 3h 18m 4s. Rate: 7.8 symbols/min [2025-10-30T18:44:07.090620] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:44:07.090880] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-30T18:44:07.090934] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-30T18:44:07.091064] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-30T18:44:07.091121] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-30T18:44:07.091165] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-30T18:44:07.091198] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-30T18:44:07.468860] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:44:07.547982] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T18:44:07.697515] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-30T18:44:08.335275] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T18:44:08.497556] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-30T18:44:09.096994] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-30T18:44:09.302586] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-30T18:44:09.318253] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-30T18:44:09.595029] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T18:44:10.097501] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-30T18:44:10.897515] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-30T18:44:11.083370] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-30T18:44:11.697543] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-30T18:44:12.044902] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-30T18:44:12.279831] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T18:44:12.497532] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-30T18:44:13.297572] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-30T18:44:13.609081] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T18:44:14.097503] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-30T18:44:14.398619] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-30T18:44:14.522009] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:44:14.897520] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-30T18:44:15.697546] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-30T18:44:16.263043] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T18:44:16.272133] [INFO ] [REMOTE ] FDS: Full fetch complete (40176 records). [2025-10-30T18:44:16.272243] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-30T18:44:16.502732] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-30T18:44:16.657059] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-30T18:44:16.657142] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-30T18:44:16.657776] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-30T18:44:16.657839] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-30T18:44:16.658681] [DEBUG] [LOCAL ] FDS: Trimmed 40176 records to 28767 (keeping 200 days of data) [2025-10-30T18:44:16.836240] [DEBUG] [LOCAL ] FDS: Primary data saved (28767 records). [2025-10-30T18:44:16.836393] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-30T18:44:16.836479] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FDS took 31.6s. Estimated remaining: 3h 18m 0s. Rate: 7.8 symbols/min [2025-10-30T18:44:16.909582] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-30T18:44:17.012510] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:44:17.012721] [DEBUG] [LOCAL ] FERG: No existing data file found in primary storage. [2025-10-30T18:44:17.012771] [WARN ] [MAIN ] FERG: No existing data found, performing full refresh instead. [2025-10-30T18:44:17.012883] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-30T18:44:17.012947] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-30T18:44:17.012991] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-10-30T18:44:17.013023] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-30T18:44:17.302577] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-30T18:44:17.387833] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:44:17.529185] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-30T18:44:17.651358] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-30T18:44:18.097498] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-30T18:44:18.897544] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-30T18:44:19.530012] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T18:44:19.697529] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-30T18:44:20.299686] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T18:44:20.497521] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-30T18:44:20.818342] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-30T18:44:21.092408] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T18:44:21.297529] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-30T18:44:22.097541] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-30T18:44:22.442192] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T18:44:22.742170] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T18:44:22.897519] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-30T18:44:23.697512] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-30T18:44:24.398370] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-30T18:44:24.497508] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-30T18:44:24.829781] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-30T18:44:25.012848] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T18:44:25.297492] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-30T18:44:26.097554] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-30T18:44:26.498770] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-30T18:44:26.499578] [INFO ] [REMOTE ] FENG: Full fetch complete (2253 records). [2025-10-30T18:44:26.499666] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-30T18:44:26.680882] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T18:44:26.681474] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:44:26.681598] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:44:26.681772] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-30T18:44:26.681871] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-30T18:44:26.681930] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-30T18:44:26.681975] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-30T18:44:26.682048] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FENG took 19.8s. Estimated remaining: 3h 17m 57s. Rate: 7.8 symbols/min [2025-10-30T18:44:26.854131] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:44:26.867282] [DEBUG] [LOCAL ] FET: Loaded 13007 existing records from primary storage. [2025-10-30T18:44:26.867521] [INFO ] [MAIN ] FET: Loaded 13007 existing records. [2025-10-30T18:44:26.898802] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-30T18:44:27.079313] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:44:27.079946] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-30T18:44:27.080322] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-30T18:44:27.081961] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-30T18:44:27.092422] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-30T18:44:27.092514] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-30T18:44:27.466960] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:44:27.697495] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-30T18:44:28.497476] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-30T18:44:28.569837] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-30T18:44:28.569438] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-30T18:44:28.584117] [INFO ] [REMOTE ] FDX: Full fetch complete (74066 records). [2025-10-30T18:44:28.584277] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-30T18:44:28.976108] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-30T18:44:28.976184] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-30T18:44:28.977127] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-30T18:44:28.977189] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-30T18:44:28.978501] [DEBUG] [LOCAL ] FDX: Trimmed 74066 records to 51324 (keeping 200 days of data) [2025-10-30T18:44:29.293511] [DEBUG] [LOCAL ] FDX: Primary data saved (51324 records). [2025-10-30T18:44:29.293673] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-30T18:44:29.294546] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FDX took 37.9s. Estimated remaining: 3h 17m 39s. Rate: 7.8 symbols/min [2025-10-30T18:44:29.306895] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-30T18:44:29.476329] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:44:29.501902] [DEBUG] [LOCAL ] FF: Loaded 22942 existing records from primary storage. [2025-10-30T18:44:29.502203] [INFO ] [MAIN ] FF: Loaded 22942 existing records. [2025-10-30T18:44:29.704602] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:44:29.704964] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-30T18:44:29.705087] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-30T18:44:29.705381] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-30T18:44:29.705485] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-30T18:44:30.066845] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-30T18:44:30.131580] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:44:30.101445] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-30T18:44:30.686523] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-30T18:44:30.735369] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T18:44:30.897481] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-30T18:44:31.697508] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-30T18:44:32.055828] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T18:44:32.190830] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T18:44:32.497502] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-30T18:44:33.297550] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-30T18:44:34.070547] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:44:34.097460] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-30T18:44:34.649163] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T18:44:34.897544] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-30T18:44:35.564863] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T18:44:35.576825] [INFO ] [REMOTE ] FE: Full fetch complete (77502 records). [2025-10-30T18:44:35.576993] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-30T18:44:35.702442] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-30T18:44:35.913965] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T18:44:36.014886] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-30T18:44:36.014972] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-30T18:44:36.016028] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-30T18:44:36.016093] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-30T18:44:36.017623] [DEBUG] [LOCAL ] FE: Trimmed 77502 records to 53820 (keeping 200 days of data) [2025-10-30T18:44:36.338148] [DEBUG] [LOCAL ] FE: Primary data saved (53820 records). [2025-10-30T18:44:36.338284] [INFO ] [MAIN ] FE: Full history saved. [2025-10-30T18:44:36.338362] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FE took 41.5s. Estimated remaining: 3h 17m 31s. Rate: 7.8 symbols/min [2025-10-30T18:44:36.518977] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-30T18:44:36.493319] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T18:44:36.518867] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:44:36.530107] [DEBUG] [LOCAL ] FFA: Loaded 5201 existing records from primary storage. [2025-10-30T18:44:36.530309] [INFO ] [MAIN ] FFA: Loaded 5201 existing records. [2025-10-30T18:44:36.711367] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:44:36.711586] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-30T18:44:36.711633] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-30T18:44:36.711845] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-30T18:44:36.711917] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-30T18:44:37.063924] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:44:37.297503] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-30T18:44:37.837032] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T18:44:37.853147] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T18:44:38.097487] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-30T18:44:38.692569] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T18:44:38.897495] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-30T18:44:39.697472] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-30T18:44:39.792391] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T18:44:40.497465] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-30T18:44:40.559004] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-30T18:44:41.297503] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-30T18:44:41.992829] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T18:44:42.057802] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-30T18:44:42.097472] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-30T18:44:42.718987] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T18:44:42.897523] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-30T18:44:43.339772] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-30T18:44:43.697525] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-30T18:44:44.497545] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-30T18:44:45.090755] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:44:45.297544] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-30T18:44:45.825850] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T18:44:45.851505] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T18:44:46.097523] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-30T18:44:46.897520] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-30T18:44:47.440445] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T18:44:47.601742] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-30T18:44:47.697536] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-30T18:44:48.226082] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T18:44:48.497519] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-30T18:44:49.297504] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-30T18:44:49.313964] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T18:44:49.318107] [INFO ] [REMOTE ] FET: Full fetch complete (18758 records). [2025-10-30T18:44:49.318200] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-30T18:44:49.722471] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-30T18:44:49.722620] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-30T18:44:49.723775] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-30T18:44:49.723871] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-30T18:44:49.725012] [DEBUG] [LOCAL ] FET: Trimmed 18758 records to 13130 (keeping 200 days of data) [2025-10-30T18:44:49.811952] [DEBUG] [LOCAL ] FET: Primary data saved (13130 records). [2025-10-30T18:44:49.812137] [INFO ] [MAIN ] FET: Full history saved. [2025-10-30T18:44:49.812238] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FET took 23.1s. Estimated remaining: 3h 17m 34s. Rate: 7.8 symbols/min [2025-10-30T18:44:49.985261] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:44:50.004580] [DEBUG] [LOCAL ] FFC: Loaded 16185 existing records from primary storage. [2025-10-30T18:44:50.004952] [INFO ] [MAIN ] FFC: Loaded 16185 existing records. [2025-10-30T18:44:50.103732] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-30T18:44:50.203682] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:44:50.203974] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-30T18:44:50.204087] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-30T18:44:50.204351] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-30T18:44:50.204411] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-30T18:44:50.579514] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:44:50.782141] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T18:44:50.794869] [INFO ] [REMOTE ] FERG: Full fetch complete (71097 records). [2025-10-30T18:44:50.795126] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-30T18:44:50.902593] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-30T18:44:51.146301] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T18:44:51.250772] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-30T18:44:51.250904] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-30T18:44:51.252267] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-30T18:44:51.252338] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-30T18:44:51.254383] [DEBUG] [LOCAL ] FERG: Trimmed 71097 records to 48834 (keeping 200 days of data) [2025-10-30T18:44:51.593168] [DEBUG] [LOCAL ] FERG: Primary data saved (48834 records). [2025-10-30T18:44:51.593379] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-30T18:44:51.593482] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FERG took 34.8s. Estimated remaining: 3h 17m 15s. Rate: 7.8 symbols/min [2025-10-30T18:44:51.702067] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-30T18:44:51.776244] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:44:51.813088] [DEBUG] [LOCAL ] FFWM: Loaded 35440 existing records from primary storage. [2025-10-30T18:44:51.813473] [INFO ] [MAIN ] FFWM: Loaded 35440 existing records. [2025-10-30T18:44:52.057960] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:44:52.058517] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-30T18:44:52.058611] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-30T18:44:52.059281] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-30T18:44:52.059349] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-30T18:44:52.193737] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T18:44:52.472960] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:44:52.497495] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-30T18:44:52.571724] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T18:44:52.987402] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T18:44:53.297574] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-30T18:44:54.087612] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-30T18:44:54.097538] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-30T18:44:54.806968] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T18:44:54.897540] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-30T18:44:55.274962] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-30T18:44:55.697511] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-30T18:44:56.102808] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T18:44:56.497493] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-30T18:44:57.297554] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-30T18:44:57.624434] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T18:44:57.676766] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T18:44:58.097559] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-30T18:44:58.897494] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-30T18:44:59.062942] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T18:44:59.590912] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T18:44:59.697483] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-30T18:45:00.384703] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T18:45:00.497472] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-30T18:45:01.297538] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-30T18:45:01.765295] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T18:45:02.097546] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-30T18:45:02.760015] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T18:45:02.897540] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-30T18:45:03.357396] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-30T18:45:03.697564] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-30T18:45:04.350565] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T18:45:04.497541] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-30T18:45:04.736022] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-30T18:45:05.217076] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T18:45:05.297571] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-30T18:45:06.097505] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-30T18:45:06.312326] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T18:45:06.776491] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T18:45:06.780435] [INFO ] [REMOTE ] FFA: Full fetch complete (8646 records). [2025-10-30T18:45:06.780744] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-30T18:45:06.902859] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-30T18:45:07.370462] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-30T18:45:07.370574] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-30T18:45:07.371100] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-30T18:45:07.371178] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-30T18:45:07.371897] [DEBUG] [LOCAL ] FFA: Trimmed 8646 records to 5274 (keeping 200 days of data) [2025-10-30T18:45:07.413819] [DEBUG] [LOCAL ] FFA: Primary data saved (5274 records). [2025-10-30T18:45:07.413983] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-30T18:45:07.414084] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FFA took 31.1s. Estimated remaining: 3h 17m 23s. Rate: 7.8 symbols/min [2025-10-30T18:45:07.628670] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:45:07.647885] [DEBUG] [LOCAL ] FG: Loaded 20410 existing records from primary storage. [2025-10-30T18:45:07.648197] [INFO ] [MAIN ] FG: Loaded 20410 existing records. [2025-10-30T18:45:07.704316] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-30T18:45:07.850430] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:45:07.850725] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-30T18:45:07.850780] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-30T18:45:07.851408] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-30T18:45:07.851466] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-30T18:45:08.271079] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:45:08.274630] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T18:45:08.497495] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-30T18:45:08.577235] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T18:45:09.297503] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-30T18:45:09.651270] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T18:45:09.872104] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-30T18:45:10.097545] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-30T18:45:10.877497] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T18:45:10.897461] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-30T18:45:11.602313] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T18:45:11.697505] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-30T18:45:12.464748] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-30T18:45:12.497470] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-30T18:45:13.302233] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-30T18:45:13.304725] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-30T18:45:13.310108] [INFO ] [REMOTE ] FFC: Full fetch complete (24357 records). [2025-10-30T18:45:13.310222] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-30T18:45:13.310781] [FATAL] [VALIDATOR ] FFC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:45:13.310859] [FATAL] [MAIN ] FFC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:45:13.310902] [WARN ] [MAIN ] FFC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:45:13.310969] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-30T18:45:13.311042] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-10-30T18:45:13.311096] [INFO ] [LOCAL ] FFC: Starting deletion of derivative data. [2025-10-30T18:45:13.311277] [DEBUG] [LOCAL ] FFC: Deleted derivative data file. [2025-10-30T18:45:13.311429] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FFC took 23.5s. Estimated remaining: 3h 17m 12s. Rate: 7.8 symbols/min [2025-10-30T18:45:13.486478] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:45:13.486683] [DEBUG] [LOCAL ] FGN: No existing data file found in primary storage. [2025-10-30T18:45:13.486736] [WARN ] [MAIN ] FGN: No existing data found, performing full refresh instead. [2025-10-30T18:45:13.486843] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-30T18:45:13.486886] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-30T18:45:13.486928] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-30T18:45:13.486960] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-30T18:45:13.854891] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:45:13.968288] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T18:45:14.097507] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-30T18:45:14.772798] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T18:45:14.777298] [INFO ] [REMOTE ] FF: Full fetch complete (35901 records). [2025-10-30T18:45:14.777381] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-30T18:45:14.777869] [FATAL] [VALIDATOR ] FF: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T18:45:14.777963] [FATAL] [MAIN ] FF: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:45:14.778036] [WARN ] [MAIN ] FF: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:45:14.778125] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-30T18:45:14.778208] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-10-30T18:45:14.778244] [INFO ] [LOCAL ] FF: Starting deletion of derivative data. [2025-10-30T18:45:14.778390] [DEBUG] [LOCAL ] FF: Deleted derivative data file. [2025-10-30T18:45:14.778456] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FF took 45.5s. Estimated remaining: 3h 16m 53s. Rate: 7.8 symbols/min [2025-10-30T18:45:14.902608] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-30T18:45:14.955576] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:45:14.955768] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-30T18:45:14.955862] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-30T18:45:14.955980] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-30T18:45:14.956033] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-30T18:45:14.956089] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-30T18:45:14.956133] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-30T18:45:15.322883] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:45:15.697515] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-30T18:45:15.885561] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T18:45:16.320089] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-30T18:45:16.497510] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-30T18:45:16.819665] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-30T18:45:17.297526] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-30T18:45:18.097498] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-30T18:45:18.454696] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T18:45:18.770336] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-30T18:45:18.897483] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-30T18:45:19.326574] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T18:45:19.697506] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-30T18:45:20.152720] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-30T18:45:20.497513] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-30T18:45:21.297493] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-30T18:45:21.558489] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T18:45:22.097505] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-30T18:45:22.297724] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T18:45:22.897495] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-30T18:45:23.600137] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T18:45:23.609542] [INFO ] [REMOTE ] FFWM: Full fetch complete (52311 records). [2025-10-30T18:45:23.609819] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-30T18:45:23.713067] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-30T18:45:23.779676] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T18:45:24.071538] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-30T18:45:24.071626] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-30T18:45:24.072427] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-30T18:45:24.072479] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-30T18:45:24.073680] [DEBUG] [LOCAL ] FFWM: Trimmed 52311 records to 35801 (keeping 200 days of data) [2025-10-30T18:45:24.247071] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T18:45:24.279401] [DEBUG] [LOCAL ] FFWM: Primary data saved (35801 records). [2025-10-30T18:45:24.279537] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-30T18:45:24.280411] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FFWM took 32.7s. Estimated remaining: 3h 16m 48s. Rate: 7.8 symbols/min [2025-10-30T18:45:24.450230] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:45:24.450414] [DEBUG] [LOCAL ] FHI: No existing data file found in primary storage. [2025-10-30T18:45:24.450450] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-10-30T18:45:24.450560] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-30T18:45:24.450601] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-30T18:45:24.450662] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-30T18:45:24.450718] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-30T18:45:24.502702] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-30T18:45:24.794679] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:45:24.893771] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-30T18:45:25.297523] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-30T18:45:25.700847] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T18:45:26.097502] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-30T18:45:26.897481] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-30T18:45:27.595723] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T18:45:27.697511] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-30T18:45:27.729171] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T18:45:28.243322] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T18:45:28.497499] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-30T18:45:29.297478] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-30T18:45:29.457118] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T18:45:30.097485] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-30T18:45:30.440183] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T18:45:30.810631] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T18:45:30.897490] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-30T18:45:31.697485] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-30T18:45:31.860537] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T18:45:32.039985] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T18:45:32.497521] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-30T18:45:33.035837] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T18:45:33.297494] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-30T18:45:34.097516] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-30T18:45:34.350221] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T18:45:34.354759] [INFO ] [REMOTE ] FG: Full fetch complete (29064 records). [2025-10-30T18:45:34.354867] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-30T18:45:34.734271] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-30T18:45:34.734372] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-30T18:45:34.734994] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-30T18:45:34.735058] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-30T18:45:34.735873] [DEBUG] [LOCAL ] FG: Trimmed 29064 records to 20510 (keeping 200 days of data) [2025-10-30T18:45:34.854847] [DEBUG] [LOCAL ] FG: Primary data saved (20510 records). [2025-10-30T18:45:34.854963] [INFO ] [MAIN ] FG: Full history saved. [2025-10-30T18:45:34.855034] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FG took 27.4s. Estimated remaining: 3h 16m 46s. Rate: 7.8 symbols/min [2025-10-30T18:45:34.909791] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-30T18:45:35.026197] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:45:35.026467] [DEBUG] [LOCAL ] FHN: No existing data file found in primary storage. [2025-10-30T18:45:35.026515] [WARN ] [MAIN ] FHN: No existing data found, performing full refresh instead. [2025-10-30T18:45:35.026622] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-30T18:45:35.026697] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-30T18:45:35.026752] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-10-30T18:45:35.026786] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-30T18:45:35.330625] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-30T18:45:35.400955] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:45:35.427941] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T18:45:35.697517] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-30T18:45:36.497538] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-30T18:45:36.851176] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-30T18:45:36.917906] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T18:45:37.297500] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-30T18:45:37.755347] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-30T18:45:38.097502] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-30T18:45:38.897486] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-30T18:45:39.332223] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-30T18:45:39.334537] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T18:45:39.697503] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-30T18:45:40.105441] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-30T18:45:40.497494] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-30T18:45:40.914561] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-30T18:45:40.915672] [INFO ] [REMOTE ] FGN: Full fetch complete (5383 records). [2025-10-30T18:45:40.915743] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-30T18:45:41.275350] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-30T18:45:41.275427] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-30T18:45:41.275593] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-30T18:45:41.275632] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-30T18:45:41.276031] [DEBUG] [LOCAL ] FGN: Trimmed 5383 records to 3461 (keeping 200 days of data) [2025-10-30T18:45:41.297572] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-30T18:45:41.297811] [DEBUG] [LOCAL ] FGN: Primary data saved (3461 records). [2025-10-30T18:45:41.297938] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-30T18:45:41.298780] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FGN took 28.0s. Estimated remaining: 3h 16m 36s. Rate: 7.8 symbols/min [2025-10-30T18:45:41.486536] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:45:41.539147] [DEBUG] [LOCAL ] FI: Loaded 53575 existing records from primary storage. [2025-10-30T18:45:41.539540] [INFO ] [MAIN ] FI: Loaded 53575 existing records. [2025-10-30T18:45:41.728536] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:45:41.728757] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-30T18:45:41.728808] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-30T18:45:41.729462] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-30T18:45:41.729501] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-30T18:45:41.835295] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T18:45:42.102696] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-30T18:45:42.138862] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:45:42.897501] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-30T18:45:43.180168] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-30T18:45:43.697500] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-30T18:45:44.225580] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T18:45:44.497508] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-30T18:45:44.623988] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T18:45:45.297494] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-30T18:45:45.799166] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T18:45:45.857842] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T18:45:46.097489] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-30T18:45:46.651697] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T18:45:46.653279] [INFO ] [REMOTE ] FGSN: Full fetch complete (8199 records). [2025-10-30T18:45:46.653353] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-30T18:45:46.831506] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-30T18:45:46.831783] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:45:46.831891] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:45:46.831977] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-30T18:45:46.832055] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-30T18:45:46.832108] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-30T18:45:46.832163] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-30T18:45:46.832236] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FGSN took 32.1s. Estimated remaining: 3h 16m 25s. Rate: 7.8 symbols/min [2025-10-30T18:45:46.902748] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-30T18:45:47.004552] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:45:47.025725] [DEBUG] [LOCAL ] FICO: Loaded 21851 existing records from primary storage. [2025-10-30T18:45:47.025967] [INFO ] [MAIN ] FICO: Loaded 21851 existing records. [2025-10-30T18:45:47.201892] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:45:47.202106] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-30T18:45:47.202169] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-30T18:45:47.202603] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-30T18:45:47.202735] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-30T18:45:47.545508] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:45:47.697503] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-30T18:45:48.184539] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T18:45:48.497492] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-30T18:45:49.297472] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-30T18:45:49.365911] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-30T18:45:49.592761] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:45:50.097550] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-30T18:45:50.488095] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T18:45:50.897480] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-30T18:45:51.543692] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T18:45:51.697522] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-30T18:45:52.193802] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T18:45:52.497537] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-30T18:45:53.297469] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-30T18:45:53.350152] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-30T18:45:53.378448] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T18:45:54.097482] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-30T18:45:54.783759] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T18:45:54.897473] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-30T18:45:55.697473] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-30T18:45:55.939443] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-30T18:45:56.323849] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T18:45:56.497469] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-30T18:45:56.598541] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T18:45:57.297506] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-30T18:45:57.873699] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T18:45:58.097479] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-30T18:45:58.154284] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T18:45:58.811034] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-30T18:45:58.897521] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-30T18:45:59.697573] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-30T18:45:59.956082] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-30T18:46:00.497507] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-30T18:46:01.297517] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-30T18:46:01.682540] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-30T18:46:01.691161] [INFO ] [REMOTE ] FHI: Full fetch complete (57285 records). [2025-10-30T18:46:01.691348] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-30T18:46:02.110119] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-30T18:46:02.106982] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-30T18:46:02.110392] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-30T18:46:02.111702] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-30T18:46:02.112616] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-30T18:46:02.114197] [DEBUG] [LOCAL ] FHI: Trimmed 57285 records to 39508 (keeping 200 days of data) [2025-10-30T18:46:02.353021] [DEBUG] [LOCAL ] FHI: Primary data saved (39508 records). [2025-10-30T18:46:02.353280] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-30T18:46:02.353521] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FHI took 38.1s. Estimated remaining: 3h 16m 31s. Rate: 7.8 symbols/min [2025-10-30T18:46:02.530280] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:02.530497] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-30T18:46:02.530550] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-30T18:46:02.530719] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-30T18:46:02.530853] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-30T18:46:02.530948] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-30T18:46:02.531081] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-30T18:46:02.682500] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-30T18:46:02.903840] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-30T18:46:02.957151] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:03.319798] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T18:46:03.697501] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-30T18:46:04.297397] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-30T18:46:04.341878] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T18:46:04.497470] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-30T18:46:04.533127] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T18:46:05.297502] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-30T18:46:05.956074] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T18:46:06.097487] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-30T18:46:06.281568] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.18 seconds). [2025-10-30T18:46:06.514478] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T18:46:06.897500] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-30T18:46:07.133144] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-30T18:46:07.697492] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-30T18:46:08.497483] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-30T18:46:08.654553] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T18:46:08.754618] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-30T18:46:09.297541] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-30T18:46:10.097520] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-30T18:46:10.676965] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T18:46:10.897475] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-30T18:46:10.987782] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-30T18:46:11.697525] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-30T18:46:12.314012] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T18:46:12.497564] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-30T18:46:12.778866] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-30T18:46:12.784732] [INFO ] [REMOTE ] FICO: Full fetch complete (30354 records). [2025-10-30T18:46:12.784825] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-30T18:46:13.164207] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-30T18:46:13.164291] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-30T18:46:13.164846] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-30T18:46:13.164906] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-30T18:46:13.165663] [DEBUG] [LOCAL ] FICO: Trimmed 30354 records to 21987 (keeping 200 days of data) [2025-10-30T18:46:13.300804] [DEBUG] [LOCAL ] FICO: Primary data saved (21987 records). [2025-10-30T18:46:13.300922] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-30T18:46:13.301038] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FICO took 26.5s. Estimated remaining: 3h 16m 30s. Rate: 7.8 symbols/min [2025-10-30T18:46:13.299743] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-30T18:46:13.473607] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:13.518139] [DEBUG] [LOCAL ] FIGS: Loaded 48272 existing records from primary storage. [2025-10-30T18:46:13.518488] [INFO ] [MAIN ] FIGS: Loaded 48272 existing records. [2025-10-30T18:46:13.677482] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T18:46:13.739197] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:46:13.739402] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-30T18:46:13.739449] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-30T18:46:13.739866] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-30T18:46:13.739923] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-30T18:46:14.098015] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-30T18:46:14.097914] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:14.331559] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-30T18:46:14.442939] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-30T18:46:14.454503] [INFO ] [REMOTE ] FI: Full fetch complete (77511 records). [2025-10-30T18:46:14.454637] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-30T18:46:14.865325] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-30T18:46:14.865434] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-30T18:46:14.866336] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-30T18:46:14.866419] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-30T18:46:14.868050] [DEBUG] [LOCAL ] FI: Trimmed 77511 records to 53965 (keeping 200 days of data) [2025-10-30T18:46:14.919817] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-30T18:46:15.192701] [DEBUG] [LOCAL ] FI: Primary data saved (53965 records). [2025-10-30T18:46:15.192853] [INFO ] [MAIN ] FI: Full history saved. [2025-10-30T18:46:15.192949] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FI took 33.9s. Estimated remaining: 3h 16m 11s. Rate: 7.8 symbols/min [2025-10-30T18:46:15.375681] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:15.411425] [DEBUG] [LOCAL ] FIHL: Loaded 38551 existing records from primary storage. [2025-10-30T18:46:15.411741] [INFO ] [MAIN ] FIHL: Loaded 38551 existing records. [2025-10-30T18:46:15.600934] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:46:15.601146] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-30T18:46:15.601196] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-30T18:46:15.601926] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-30T18:46:15.601982] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-30T18:46:15.702717] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-30T18:46:15.978971] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:16.497479] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-30T18:46:16.667139] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T18:46:16.667444] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-30T18:46:16.667533] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:46:16.667610] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-30T18:46:16.667695] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:46:16.667768] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-30T18:46:16.667834] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-30T18:46:16.667871] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-30T18:46:16.667910] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-30T18:46:16.667956] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FIG took 14.3s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-30T18:46:16.856513] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:16.888872] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-30T18:46:16.906224] [INFO ] [REMOTE ] FHN: Full fetch complete (77482 records). [2025-10-30T18:46:16.910007] [DEBUG] [LOCAL ] FINS: Loaded 8139 existing records from primary storage. [2025-10-30T18:46:16.910269] [INFO ] [MAIN ] FINS: Loaded 8139 existing records. [2025-10-30T18:46:16.910104] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-30T18:46:17.309823] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-30T18:46:17.293541] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:46:17.354503] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-30T18:46:17.382712] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-30T18:46:17.397597] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-30T18:46:17.399488] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T18:46:17.417795] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-30T18:46:17.756021] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-30T18:46:17.759240] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-30T18:46:17.817752] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-30T18:46:17.853569] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-30T18:46:17.921126] [DEBUG] [LOCAL ] FHN: Trimmed 77482 records to 53786 (keeping 200 days of data) [2025-10-30T18:46:17.981121] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:18.098700] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-30T18:46:18.349474] [DEBUG] [LOCAL ] FHN: Primary data saved (53786 records). [2025-10-30T18:46:18.349773] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-30T18:46:18.349875] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FHN took 43.5s. Estimated remaining: 3h 15m 34s. Rate: 7.8 symbols/min [2025-10-30T18:46:18.541979] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:18.561338] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T18:46:18.611886] [DEBUG] [LOCAL ] FINV: Loaded 45192 existing records from primary storage. [2025-10-30T18:46:18.612358] [INFO ] [MAIN ] FINV: Loaded 45192 existing records. [2025-10-30T18:46:18.805639] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:46:18.805949] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-30T18:46:18.806001] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-30T18:46:18.806960] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-30T18:46:18.807021] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-30T18:46:18.902717] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-30T18:46:19.188502] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:19.311055] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T18:46:19.468474] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-30T18:46:19.697535] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-30T18:46:20.089879] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T18:46:20.497507] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-30T18:46:21.297524] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-30T18:46:21.780616] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T18:46:22.097498] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-30T18:46:22.168180] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T18:46:22.897512] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-30T18:46:23.319121] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-30T18:46:23.320667] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:46:23.697501] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-30T18:46:24.497508] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-30T18:46:24.941892] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T18:46:25.039594] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T18:46:25.297545] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-30T18:46:26.097501] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-30T18:46:26.528125] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T18:46:26.897549] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-30T18:46:27.159180] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T18:46:27.380688] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T18:46:27.697536] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-30T18:46:28.497496] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-30T18:46:28.791942] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T18:46:29.297538] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-30T18:46:29.560992] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T18:46:29.872026] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-30T18:46:30.097469] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-30T18:46:30.542993] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-30T18:46:30.897500] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-30T18:46:31.697498] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-30T18:46:32.084060] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T18:46:32.318128] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-30T18:46:32.497489] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-30T18:46:32.936921] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-30T18:46:33.297493] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-30T18:46:34.097492] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-30T18:46:34.457659] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T18:46:34.897489] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-30T18:46:35.305927] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T18:46:35.697496] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-30T18:46:36.109388] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T18:46:36.497511] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-30T18:46:36.819903] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:46:37.297499] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-30T18:46:37.746401] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T18:46:38.097495] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-30T18:46:38.628673] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T18:46:38.897500] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-30T18:46:39.417368] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-30T18:46:39.419223] [INFO ] [REMOTE ] FINS: Full fetch complete (11484 records). [2025-10-30T18:46:39.419292] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-30T18:46:39.699687] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-30T18:46:39.801399] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-30T18:46:39.801549] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-30T18:46:39.801903] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-30T18:46:39.802089] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-30T18:46:39.827804] [DEBUG] [LOCAL ] FINS: Trimmed 11484 records to 8197 (keeping 200 days of data) [2025-10-30T18:46:39.829556] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-30T18:46:39.862261] [INFO ] [REMOTE ] FIGS: Full fetch complete (70620 records). [2025-10-30T18:46:39.866854] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-30T18:46:40.044504] [DEBUG] [LOCAL ] FINS: Primary data saved (8197 records). [2025-10-30T18:46:40.053120] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-30T18:46:40.055063] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FINS took 23.4s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-30T18:46:40.414482] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:40.451331] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-30T18:46:40.451410] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-30T18:46:40.452244] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-30T18:46:40.452362] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-30T18:46:40.453903] [DEBUG] [LOCAL ] FIGS: Trimmed 70620 records to 48575 (keeping 200 days of data) [2025-10-30T18:46:40.497822] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-30T18:46:40.588996] [DEBUG] [LOCAL ] FIS: Loaded 53323 existing records from primary storage. [2025-10-30T18:46:40.591326] [INFO ] [MAIN ] FIS: Loaded 53323 existing records. [2025-10-30T18:46:40.866995] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:46:40.867314] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-30T18:46:40.867467] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-30T18:46:40.868950] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-30T18:46:40.869052] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-30T18:46:41.104535] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T18:46:41.303052] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-30T18:46:41.319165] [DEBUG] [LOCAL ] FIGS: Primary data saved (48575 records). [2025-10-30T18:46:41.347220] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-30T18:46:41.348042] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FIGS took 28.0s. Estimated remaining: 3h 15m 33s. Rate: 7.8 symbols/min [2025-10-30T18:46:41.346185] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:41.524084] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:41.550871] [DEBUG] [LOCAL ] FIX: Loaded 28221 existing records from primary storage. [2025-10-30T18:46:41.551189] [INFO ] [MAIN ] FIX: Loaded 28221 existing records. [2025-10-30T18:46:41.756609] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:46:41.758780] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T18:46:41.759114] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-30T18:46:41.766828] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-30T18:46:41.767925] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-30T18:46:41.767994] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-30T18:46:42.112224] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-30T18:46:42.116828] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:42.588321] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T18:46:42.897513] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-30T18:46:43.174202] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T18:46:43.697508] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-30T18:46:44.110244] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T18:46:44.497486] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-30T18:46:45.027316] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T18:46:45.297488] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-30T18:46:45.604889] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T18:46:46.097495] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-30T18:46:46.521286] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T18:46:46.897568] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-30T18:46:47.302505] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T18:46:47.697547] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-30T18:46:48.299393] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:46:48.497495] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-30T18:46:48.904493] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T18:46:49.297506] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-30T18:46:49.927885] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T18:46:50.097498] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-30T18:46:50.465210] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:46:50.897528] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-30T18:46:51.520215] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-30T18:46:51.697562] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-30T18:46:52.035212] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T18:46:52.497524] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-30T18:46:53.079478] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T18:46:53.090773] [INFO ] [REMOTE ] FINV: Full fetch complete (65200 records). [2025-10-30T18:46:53.091002] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-30T18:46:53.302588] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-30T18:46:53.502909] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-30T18:46:53.503002] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-30T18:46:53.503858] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-30T18:46:53.503921] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-30T18:46:53.505278] [DEBUG] [LOCAL ] FINV: Trimmed 65200 records to 45574 (keeping 200 days of data) [2025-10-30T18:46:53.787272] [DEBUG] [LOCAL ] FINV: Primary data saved (45574 records). [2025-10-30T18:46:53.787571] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-30T18:46:53.788498] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FINV took 35.4s. Estimated remaining: 3h 15m 34s. Rate: 7.8 symbols/min [2025-10-30T18:46:53.967778] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:46:53.967997] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-30T18:46:53.968224] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-30T18:46:53.968379] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-30T18:46:53.968555] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-30T18:46:53.968637] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-30T18:46:53.968717] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-30T18:46:54.119458] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-30T18:46:54.148220] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-30T18:46:54.403726] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:46:54.476945] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:46:54.897563] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-30T18:46:55.042065] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T18:46:55.042416] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-30T18:46:55.042514] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:46:55.042567] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-30T18:46:55.042628] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:46:55.042721] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-30T18:46:55.042786] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-30T18:46:55.042821] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-30T18:46:55.042860] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-30T18:46:55.042907] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FIXT took 1.3s. Estimated remaining: 3h 15m 14s. Rate: 7.8 symbols/min [2025-10-30T18:46:55.219845] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T18:46:55.697499] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-30T18:46:56.497555] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-30T18:46:57.113313] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T18:46:57.297521] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-30T18:46:57.685344] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T18:46:57.693479] [INFO ] [REMOTE ] FIHL: Full fetch complete (56391 records). [2025-10-30T18:46:57.693594] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-30T18:46:58.080246] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-30T18:46:58.080384] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-30T18:46:58.081205] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-30T18:46:58.081312] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-30T18:46:58.082567] [DEBUG] [LOCAL ] FIHL: Trimmed 56391 records to 38824 (keeping 200 days of data) [2025-10-30T18:46:58.137511] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-30T18:46:58.317200] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T18:46:58.349012] [DEBUG] [LOCAL ] FIHL: Primary data saved (38824 records). [2025-10-30T18:46:58.349162] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-30T18:46:58.349249] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FIHL took 43.2s. Estimated remaining: 3h 14m 59s. Rate: 7.8 symbols/min [2025-10-30T18:46:58.897501] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-30T18:46:59.419480] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T18:46:59.697552] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-30T18:46:59.946338] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-30T18:47:00.497519] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-30T18:47:01.237442] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T18:47:01.297503] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-30T18:47:03.646730] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-30T18:47:03.658085] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-30T18:47:05.140091] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T18:47:05.151574] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-30T18:47:05.559258] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (5.06 seconds). [2025-10-30T18:47:05.565706] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-30T18:47:06.510927] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T18:47:06.517351] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-30T18:47:06.700631] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T18:47:06.712355] [INFO ] [REMOTE ] FIS: Full fetch complete (77410 records). [2025-10-30T18:47:06.712479] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-30T18:47:07.118636] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-30T18:47:07.118757] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-30T18:47:07.119779] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-30T18:47:07.119865] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-30T18:47:07.121426] [DEBUG] [LOCAL ] FIS: Trimmed 77410 records to 53713 (keeping 200 days of data) [2025-10-30T18:47:07.457696] [DEBUG] [LOCAL ] FIS: Primary data saved (53713 records). [2025-10-30T18:47:07.457866] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-30T18:47:07.458706] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIS took 27.4s. Estimated remaining: 3h 14m 54s. Rate: 7.8 symbols/min [2025-10-30T18:47:07.688530] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-30T18:47:07.695358] [INFO ] [REMOTE ] FIX: Full fetch complete (45724 records). [2025-10-30T18:47:07.695514] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-30T18:47:08.074209] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-30T18:47:08.074286] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-30T18:47:08.074932] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-30T18:47:08.074993] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-30T18:47:08.075899] [DEBUG] [LOCAL ] FIX: Trimmed 45724 records to 28476 (keeping 200 days of data) [2025-10-30T18:47:08.248275] [DEBUG] [LOCAL ] FIX: Primary data saved (28476 records). [2025-10-30T18:47:08.248405] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-30T18:47:08.248482] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FIX took 26.9s. Estimated remaining: 3h 14m 33s. Rate: 7.8 symbols/min [2025-10-30T18:47:08.895787] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:08.898352] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:08.934010] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:08.995369] [DEBUG] [LOCAL ] FLC: Loaded 5050 existing records from primary storage. [2025-10-30T18:47:08.995808] [INFO ] [MAIN ] FLC: Loaded 5050 existing records. [2025-10-30T18:47:08.991822] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:09.229205] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:09.229527] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-30T18:47:09.229585] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-30T18:47:09.229865] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-30T18:47:09.229919] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-30T18:47:09.366395] [DEBUG] [LOCAL ] FLO: Loaded 52090 existing records from primary storage. [2025-10-30T18:47:09.380715] [DEBUG] [LOCAL ] FLNG: Loaded 32775 existing records from primary storage. [2025-10-30T18:47:09.381193] [INFO ] [MAIN ] FLO: Loaded 52090 existing records. [2025-10-30T18:47:09.387816] [DEBUG] [LOCAL ] FLG: Loaded 53311 existing records from primary storage. [2025-10-30T18:47:09.393157] [INFO ] [MAIN ] FLNG: Loaded 32775 existing records. [2025-10-30T18:47:09.476809] [INFO ] [MAIN ] FLG: Loaded 53311 existing records. [2025-10-30T18:47:10.008898] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:10.041358] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:10.041870] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-30T18:47:10.057707] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-30T18:47:10.041756] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-30T18:47:10.098571] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-30T18:47:10.098707] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-30T18:47:10.103903] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-30T18:47:10.175282] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-30T18:47:10.190692] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:10.269987] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-30T18:47:10.236390] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-30T18:47:10.278222] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:10.296555] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-30T18:47:10.310796] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-30T18:47:10.345694] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-30T18:47:10.296502] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-30T18:47:11.063902] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:11.097787] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-30T18:47:11.214676] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:11.230500] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-30T18:47:11.241067] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T18:47:11.262342] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-30T18:47:11.304961] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:11.305282] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-30T18:47:11.657108] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T18:47:11.658616] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-30T18:47:12.092260] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T18:47:12.094185] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-30T18:47:12.213141] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T18:47:12.220225] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-30T18:47:12.486053] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T18:47:12.497132] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-30T18:47:12.611673] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-30T18:47:12.614078] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-30T18:47:12.951242] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-30T18:47:13.035887] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-30T18:47:13.238840] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T18:47:13.297497] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-30T18:47:13.484784] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T18:47:14.097534] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-30T18:47:14.137894] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T18:47:14.497436] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T18:47:14.897549] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-30T18:47:15.697470] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-30T18:47:15.897495] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T18:47:16.497504] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-30T18:47:17.240828] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-30T18:47:17.297463] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-30T18:47:17.698565] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T18:47:18.097545] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-30T18:47:18.478849] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T18:47:18.897554] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-30T18:47:19.385718] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-30T18:47:19.697495] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-30T18:47:20.108483] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T18:47:20.243427] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T18:47:20.497496] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-30T18:47:21.297500] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-30T18:47:21.594001] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T18:47:22.097496] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-30T18:47:22.579913] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T18:47:22.897510] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-30T18:47:23.199486] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T18:47:23.697575] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-30T18:47:24.148336] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-30T18:47:24.245348] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T18:47:24.497504] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-30T18:47:25.297539] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-30T18:47:25.837918] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T18:47:26.097494] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-30T18:47:26.529300] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-30T18:47:26.533057] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T18:47:26.897492] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-30T18:47:27.697486] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-30T18:47:28.015331] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T18:47:28.497498] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-30T18:47:29.046457] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T18:47:29.077125] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-30T18:47:29.078724] [INFO ] [REMOTE ] FLC: Full fetch complete (7808 records). [2025-10-30T18:47:29.078792] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-30T18:47:29.303218] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-30T18:47:29.436242] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-30T18:47:29.436316] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-30T18:47:29.436541] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-30T18:47:29.436599] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-30T18:47:29.437009] [DEBUG] [LOCAL ] FLC: Trimmed 7808 records to 5093 (keeping 200 days of data) [2025-10-30T18:47:29.467173] [DEBUG] [LOCAL ] FLC: Primary data saved (5093 records). [2025-10-30T18:47:29.467272] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-30T18:47:29.467361] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FLC took 21.2s. Estimated remaining: 3h 14m 50s. Rate: 7.8 symbols/min [2025-10-30T18:47:29.635472] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:29.635637] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-30T18:47:29.635713] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-30T18:47:29.635831] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-30T18:47:29.635876] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-30T18:47:29.635951] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-30T18:47:29.636001] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-30T18:47:29.981512] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:30.097479] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-30T18:47:30.732912] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T18:47:30.756841] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-30T18:47:30.897491] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-30T18:47:31.697494] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-30T18:47:32.497484] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-30T18:47:32.610231] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T18:47:32.618713] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-30T18:47:32.631166] [INFO ] [REMOTE ] FLO: Full fetch complete (75413 records). [2025-10-30T18:47:32.631309] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-30T18:47:33.017930] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-30T18:47:33.018006] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-30T18:47:33.018880] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-30T18:47:33.018942] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-30T18:47:33.020246] [DEBUG] [LOCAL ] FLO: Trimmed 75413 records to 52480 (keeping 200 days of data) [2025-10-30T18:47:33.307876] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-30T18:47:33.329852] [DEBUG] [LOCAL ] FLO: Primary data saved (52480 records). [2025-10-30T18:47:33.330020] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-30T18:47:33.331207] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLO took 25.1s. Estimated remaining: 3h 14m 36s. Rate: 7.8 symbols/min [2025-10-30T18:47:33.518366] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:33.566523] [DEBUG] [LOCAL ] FLR: Loaded 53239 existing records from primary storage. [2025-10-30T18:47:33.566841] [INFO ] [MAIN ] FLR: Loaded 53239 existing records. [2025-10-30T18:47:33.745787] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:33.746099] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-30T18:47:33.746181] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-30T18:47:33.746887] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-30T18:47:33.746947] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-30T18:47:34.083849] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-30T18:47:34.116872] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-30T18:47:34.159815] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:34.395266] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T18:47:34.897495] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-30T18:47:35.056263] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T18:47:35.697498] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-30T18:47:36.160533] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:47:36.371295] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-30T18:47:36.497488] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-30T18:47:37.297477] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-30T18:47:37.508152] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T18:47:37.514874] [INFO ] [REMOTE ] FLNG: Full fetch complete (49523 records). [2025-10-30T18:47:37.514979] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-30T18:47:37.903673] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-30T18:47:37.903756] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-30T18:47:37.904414] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-30T18:47:37.904455] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-30T18:47:37.905389] [DEBUG] [LOCAL ] FLNG: Trimmed 49523 records to 33002 (keeping 200 days of data) [2025-10-30T18:47:38.097167] [DEBUG] [LOCAL ] FLNG: Primary data saved (33002 records). [2025-10-30T18:47:38.097288] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-30T18:47:38.097369] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLNG took 29.8s. Estimated remaining: 3h 14m 23s. Rate: 7.8 symbols/min [2025-10-30T18:47:38.097483] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-30T18:47:38.269539] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:38.311001] [DEBUG] [LOCAL ] FLS: Loaded 50402 existing records from primary storage. [2025-10-30T18:47:38.311287] [INFO ] [MAIN ] FLS: Loaded 50402 existing records. [2025-10-30T18:47:38.488769] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:38.489083] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-30T18:47:38.489204] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-30T18:47:38.490057] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-30T18:47:38.490115] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-30T18:47:38.858128] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-30T18:47:38.877237] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:38.897451] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-30T18:47:39.111206] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T18:47:39.697476] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-30T18:47:40.055526] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T18:47:40.497502] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-30T18:47:40.811403] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T18:47:41.297474] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-30T18:47:41.346945] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T18:47:42.097488] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-30T18:47:42.603698] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T18:47:42.897490] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-30T18:47:43.406480] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T18:47:43.697493] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-30T18:47:44.005154] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T18:47:44.497490] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-30T18:47:45.070383] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T18:47:45.297486] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-30T18:47:46.003724] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-30T18:47:46.097515] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-30T18:47:46.767868] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-30T18:47:46.897492] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-30T18:47:46.917735] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T18:47:47.697522] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-30T18:47:48.246902] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T18:47:48.497503] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-30T18:47:48.894347] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T18:47:49.297494] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-30T18:47:49.753369] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T18:47:50.097479] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-30T18:47:50.723181] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T18:47:50.897521] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-30T18:47:51.704318] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-30T18:47:51.740031] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T18:47:51.753436] [INFO ] [REMOTE ] FLG: Full fetch complete (77418 records). [2025-10-30T18:47:51.753667] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-30T18:47:52.184551] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-30T18:47:52.184721] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-30T18:47:52.186152] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-30T18:47:52.186257] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-30T18:47:52.188710] [DEBUG] [LOCAL ] FLG: Trimmed 77418 records to 53697 (keeping 200 days of data) [2025-10-30T18:47:52.456819] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T18:47:52.498702] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-30T18:47:52.601059] [DEBUG] [LOCAL ] FLG: Primary data saved (53697 records). [2025-10-30T18:47:52.601437] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-30T18:47:52.601629] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLG took 44.3s. Estimated remaining: 3h 14m 28s. Rate: 7.8 symbols/min [2025-10-30T18:47:52.788219] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:52.808429] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:47:52.864543] [DEBUG] [LOCAL ] FLUT: Loaded 50592 existing records from primary storage. [2025-10-30T18:47:52.865306] [INFO ] [MAIN ] FLUT: Loaded 50592 existing records. [2025-10-30T18:47:53.107389] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:53.107713] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-30T18:47:53.107775] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-30T18:47:53.109023] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-30T18:47:53.109086] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-30T18:47:53.297838] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-30T18:47:53.514239] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:47:53.819805] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-30T18:47:54.097574] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-30T18:47:54.803727] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-30T18:47:54.897539] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-30T18:47:55.397850] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T18:47:55.697526] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-30T18:47:56.108925] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T18:47:56.352262] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-30T18:47:56.497528] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-30T18:47:57.297571] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-30T18:47:58.097483] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-30T18:47:58.244586] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-30T18:47:58.897558] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-30T18:47:59.126721] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-30T18:47:59.133675] [INFO ] [REMOTE ] FLOC: Full fetch complete (42302 records). [2025-10-30T18:47:59.133842] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-30T18:47:59.336053] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T18:47:59.336707] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:47:59.336782] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:47:59.336858] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-30T18:47:59.336930] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-30T18:47:59.336968] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-30T18:47:59.337010] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-30T18:47:59.337078] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLOC took 29.9s. Estimated remaining: 3h 14m 18s. Rate: 7.8 symbols/min [2025-10-30T18:47:59.548146] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:47:59.550336] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T18:47:59.580364] [DEBUG] [LOCAL ] FLXR: Loaded 21799 existing records from primary storage. [2025-10-30T18:47:59.580620] [INFO ] [MAIN ] FLXR: Loaded 21799 existing records. [2025-10-30T18:47:59.702695] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-30T18:47:59.762575] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:47:59.762800] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-30T18:47:59.762855] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-30T18:47:59.763208] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-30T18:47:59.763267] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-30T18:48:00.114846] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:00.474908] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-30T18:48:00.486638] [INFO ] [REMOTE ] FLR: Full fetch complete (76944 records). [2025-10-30T18:48:00.486872] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-30T18:48:00.507683] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-30T18:48:00.875734] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-30T18:48:00.875831] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-30T18:48:00.876801] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-30T18:48:00.876886] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-30T18:48:00.878345] [DEBUG] [LOCAL ] FLR: Trimmed 76944 records to 53628 (keeping 200 days of data) [2025-10-30T18:48:01.184463] [DEBUG] [LOCAL ] FLR: Primary data saved (53628 records). [2025-10-30T18:48:01.184602] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-30T18:48:01.185609] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLR took 27.9s. Estimated remaining: 3h 14m 0s. Rate: 7.8 symbols/min [2025-10-30T18:48:01.302821] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-30T18:48:01.357098] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:01.404806] [DEBUG] [LOCAL ] FMC: Loaded 51837 existing records from primary storage. [2025-10-30T18:48:01.405119] [INFO ] [MAIN ] FMC: Loaded 51837 existing records. [2025-10-30T18:48:01.582723] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:01.582941] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-30T18:48:01.583016] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-30T18:48:01.584007] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-30T18:48:01.584077] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-30T18:48:01.721776] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-30T18:48:01.979483] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:02.097485] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-30T18:48:02.897532] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-30T18:48:03.522883] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (3.02 seconds). [2025-10-30T18:48:03.580631] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-30T18:48:03.619106] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-30T18:48:03.697477] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-30T18:48:04.497476] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-30T18:48:04.606292] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-30T18:48:05.064244] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T18:48:05.297503] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-30T18:48:05.826251] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T18:48:06.097491] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-30T18:48:06.654466] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T18:48:06.705997] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T18:48:06.897479] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-30T18:48:07.492887] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T18:48:07.697492] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-30T18:48:08.371158] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-30T18:48:08.497510] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-30T18:48:09.297500] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-30T18:48:09.799350] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T18:48:10.097484] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-30T18:48:10.686321] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T18:48:10.697608] [INFO ] [REMOTE ] FLS: Full fetch complete (72721 records). [2025-10-30T18:48:10.697799] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-30T18:48:10.905742] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-30T18:48:11.110380] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-30T18:48:11.110461] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-30T18:48:11.111414] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-30T18:48:11.111542] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-30T18:48:11.113239] [DEBUG] [LOCAL ] FLS: Trimmed 72721 records to 50790 (keeping 200 days of data) [2025-10-30T18:48:11.428771] [DEBUG] [LOCAL ] FLS: Primary data saved (50790 records). [2025-10-30T18:48:11.428977] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-30T18:48:11.429584] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLS took 33.3s. Estimated remaining: 3h 13m 57s. Rate: 7.8 symbols/min [2025-10-30T18:48:11.630582] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:11.632285] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T18:48:11.649038] [DEBUG] [LOCAL ] FMN: Loaded 5527 existing records from primary storage. [2025-10-30T18:48:11.649245] [INFO ] [MAIN ] FMN: Loaded 5527 existing records. [2025-10-30T18:48:11.703732] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-30T18:48:11.835487] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:11.835742] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-30T18:48:11.835796] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-30T18:48:11.836009] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-30T18:48:11.836065] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-30T18:48:12.195732] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:12.264561] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T18:48:12.458535] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T18:48:12.497465] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-30T18:48:13.135717] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T18:48:13.297505] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-30T18:48:14.019686] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T18:48:14.097491] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-30T18:48:14.897519] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-30T18:48:15.449163] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T18:48:15.644693] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T18:48:15.697502] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-30T18:48:16.262466] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T18:48:16.497493] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-30T18:48:17.174478] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-30T18:48:17.297480] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-30T18:48:18.097514] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-30T18:48:18.547996] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T18:48:18.897510] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-30T18:48:19.360520] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:48:19.386073] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T18:48:19.697485] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-30T18:48:20.497550] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-30T18:48:21.160018] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T18:48:21.297474] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-30T18:48:21.705829] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T18:48:21.795103] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-30T18:48:22.097484] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-30T18:48:22.897514] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-30T18:48:23.373416] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:48:23.697536] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-30T18:48:24.160301] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T18:48:24.497509] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-30T18:48:24.998413] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T18:48:25.297469] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-30T18:48:25.426989] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T18:48:25.434118] [INFO ] [REMOTE ] FLXR: Full fetch complete (28345 records). [2025-10-30T18:48:25.434225] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-30T18:48:25.877894] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-30T18:48:25.877971] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-30T18:48:25.878485] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-30T18:48:25.878529] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-30T18:48:25.879228] [DEBUG] [LOCAL ] FLXR: Trimmed 28345 records to 22005 (keeping 200 days of data) [2025-10-30T18:48:26.010264] [DEBUG] [LOCAL ] FLXR: Primary data saved (22005 records). [2025-10-30T18:48:26.010385] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-30T18:48:26.010459] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FLXR took 26.7s. Estimated remaining: 3h 14m 2s. Rate: 7.8 symbols/min [2025-10-30T18:48:26.106600] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-30T18:48:26.181819] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:26.209032] [DEBUG] [LOCAL ] FMS: Loaded 30037 existing records from primary storage. [2025-10-30T18:48:26.209286] [INFO ] [MAIN ] FMS: Loaded 30037 existing records. [2025-10-30T18:48:26.387225] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:26.387441] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-30T18:48:26.387496] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-30T18:48:26.387988] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-30T18:48:26.388047] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-30T18:48:26.760713] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:26.794601] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-30T18:48:26.897469] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-30T18:48:27.697470] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-30T18:48:27.837098] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-30T18:48:27.850222] [INFO ] [REMOTE ] FLUT: Full fetch complete (73437 records). [2025-10-30T18:48:27.850364] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-30T18:48:28.270754] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-30T18:48:28.270833] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-30T18:48:28.271703] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-30T18:48:28.271765] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-30T18:48:28.273241] [DEBUG] [LOCAL ] FLUT: Trimmed 73437 records to 50967 (keeping 200 days of data) [2025-10-30T18:48:28.504761] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-30T18:48:28.582607] [DEBUG] [LOCAL ] FLUT: Primary data saved (50967 records). [2025-10-30T18:48:28.592162] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-30T18:48:28.593017] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FLUT took 36.0s. Estimated remaining: 3h 13m 45s. Rate: 7.8 symbols/min [2025-10-30T18:48:28.593723] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T18:48:28.774939] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:28.821723] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-30T18:48:28.834620] [INFO ] [REMOTE ] FMC: Full fetch complete (75450 records). [2025-10-30T18:48:28.834829] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-30T18:48:28.974927] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T18:48:28.993330] [DEBUG] [LOCAL ] FMX: Loaded 39913 existing records from primary storage. [2025-10-30T18:48:29.010039] [INFO ] [MAIN ] FMX: Loaded 39913 existing records. [2025-10-30T18:48:29.318422] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-30T18:48:29.377750] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:29.384468] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-30T18:48:29.389938] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-30T18:48:29.411169] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-30T18:48:29.411252] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-30T18:48:29.619311] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-30T18:48:29.624557] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-30T18:48:29.637897] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-30T18:48:29.648248] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-30T18:48:29.759546] [DEBUG] [LOCAL ] FMC: Trimmed 75450 records to 52227 (keeping 200 days of data) [2025-10-30T18:48:29.988931] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:30.098683] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-30T18:48:30.196059] [DEBUG] [LOCAL ] FMC: Primary data saved (52227 records). [2025-10-30T18:48:30.201462] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-30T18:48:30.210024] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FMC took 29.0s. Estimated remaining: 3h 13m 27s. Rate: 7.8 symbols/min [2025-10-30T18:48:30.243690] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T18:48:30.389811] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:30.392897] [DEBUG] [LOCAL ] FMY: Loaded 1327 existing records from primary storage. [2025-10-30T18:48:30.393037] [INFO ] [MAIN ] FMY: Loaded 1327 existing records. [2025-10-30T18:48:30.574500] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:30.574998] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-30T18:48:30.575056] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-30T18:48:30.575332] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-30T18:48:30.575409] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-30T18:48:30.905825] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-30T18:48:30.949455] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:31.052582] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T18:48:31.697467] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-30T18:48:31.846999] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T18:48:31.973852] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-30T18:48:32.497532] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-30T18:48:33.297487] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-30T18:48:33.450625] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T18:48:34.097473] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-30T18:48:34.368531] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T18:48:34.897526] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-30T18:48:35.697553] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-30T18:48:35.923050] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T18:48:36.087980] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-30T18:48:36.497498] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-30T18:48:37.297468] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-30T18:48:37.361891] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (3.26 seconds). [2025-10-30T18:48:37.422973] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T18:48:38.097505] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-30T18:48:38.483682] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-30T18:48:38.574112] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T18:48:38.897493] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-30T18:48:39.368142] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-30T18:48:39.697499] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-30T18:48:40.497498] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-30T18:48:40.936281] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-30T18:48:40.938594] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T18:48:41.297526] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-30T18:48:41.694049] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T18:48:42.097493] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-30T18:48:42.705207] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-30T18:48:42.708017] [INFO ] [REMOTE ] FMN: Full fetch complete (9777 records). [2025-10-30T18:48:42.708171] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-30T18:48:42.903126] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-30T18:48:43.199184] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-30T18:48:43.199303] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-30T18:48:43.199714] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-30T18:48:43.199782] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-30T18:48:43.200423] [DEBUG] [LOCAL ] FMN: Trimmed 9777 records to 5638 (keeping 200 days of data) [2025-10-30T18:48:43.244162] [DEBUG] [LOCAL ] FMN: Primary data saved (5638 records). [2025-10-30T18:48:43.244326] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-30T18:48:43.244424] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FMN took 31.8s. Estimated remaining: 3h 13m 29s. Rate: 7.8 symbols/min [2025-10-30T18:48:43.282550] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-30T18:48:43.500731] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:43.542221] [DEBUG] [LOCAL ] FN: Loaded 36858 existing records from primary storage. [2025-10-30T18:48:43.542540] [INFO ] [MAIN ] FN: Loaded 36858 existing records. [2025-10-30T18:48:43.702701] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-30T18:48:43.761216] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:43.761429] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-30T18:48:43.761479] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-30T18:48:43.762171] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-30T18:48:43.762231] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-30T18:48:44.159938] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:44.497539] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-30T18:48:44.719984] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T18:48:44.830270] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-30T18:48:45.297539] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-30T18:48:45.620065] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T18:48:46.097471] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-30T18:48:46.897480] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-30T18:48:47.041047] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T18:48:47.151577] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-30T18:48:47.697502] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-30T18:48:48.497542] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-30T18:48:48.839631] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T18:48:49.297509] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-30T18:48:49.663129] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T18:48:50.097531] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-30T18:48:50.414143] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T18:48:50.897502] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-30T18:48:51.414453] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T18:48:51.697519] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-30T18:48:52.140330] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T18:48:52.497466] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-30T18:48:52.715088] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T18:48:53.297502] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-30T18:48:53.573301] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-30T18:48:53.863801] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T18:48:54.097481] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-30T18:48:54.406288] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-30T18:48:54.897508] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-30T18:48:55.697527] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-30T18:48:55.972318] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-30T18:48:56.143281] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T18:48:56.497500] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-30T18:48:57.297485] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-30T18:48:57.623084] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T18:48:57.630114] [INFO ] [REMOTE ] FMS: Full fetch complete (43211 records). [2025-10-30T18:48:57.630211] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-30T18:48:57.997439] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-30T18:48:57.997512] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-30T18:48:57.998156] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-30T18:48:57.998218] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-30T18:48:57.999168] [DEBUG] [LOCAL ] FMS: Trimmed 43211 records to 30281 (keeping 200 days of data) [2025-10-30T18:48:58.099246] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-30T18:48:58.171598] [DEBUG] [LOCAL ] FMS: Primary data saved (30281 records). [2025-10-30T18:48:58.171750] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-30T18:48:58.171832] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMS took 32.2s. Estimated remaining: 3h 13m 34s. Rate: 7.8 symbols/min [2025-10-30T18:48:58.340684] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:58.389317] [DEBUG] [LOCAL ] FNB: Loaded 52599 existing records from primary storage. [2025-10-30T18:48:58.389627] [INFO ] [MAIN ] FNB: Loaded 52599 existing records. [2025-10-30T18:48:58.492905] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-30T18:48:58.504473] [INFO ] [REMOTE ] FMY: Full fetch complete (1933 records). [2025-10-30T18:48:58.514840] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-30T18:48:58.618196] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:58.644814] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-30T18:48:58.644944] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-30T18:48:58.679028] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-30T18:48:58.679403] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-30T18:48:58.916887] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-30T18:48:59.243312] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-30T18:48:59.262679] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-30T18:48:59.262835] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-30T18:48:59.263075] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-30T18:48:59.262448] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-30T18:48:59.293014] [DEBUG] [LOCAL ] FMY: Trimmed 1933 records to 1329 (keeping 200 days of data) [2025-10-30T18:48:59.360771] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:48:59.363194] [DEBUG] [LOCAL ] FMY: Primary data saved (1329 records). [2025-10-30T18:48:59.363257] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-30T18:48:59.363323] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FMY took 29.2s. Estimated remaining: 3h 13m 15s. Rate: 7.8 symbols/min [2025-10-30T18:48:59.526798] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:48:59.574447] [DEBUG] [LOCAL ] FND: Loaded 52011 existing records from primary storage. [2025-10-30T18:48:59.574774] [INFO ] [MAIN ] FND: Loaded 52011 existing records. [2025-10-30T18:48:59.697482] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-30T18:48:59.785860] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:48:59.786103] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-30T18:48:59.786178] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-30T18:48:59.787016] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-30T18:48:59.787073] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-30T18:49:00.219294] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:00.246074] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T18:49:00.497505] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-30T18:49:01.297535] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-30T18:49:01.748484] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-30T18:49:02.097497] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-30T18:49:02.897493] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-30T18:49:03.135087] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-30T18:49:03.697543] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-30T18:49:03.792750] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-30T18:49:03.800951] [INFO ] [REMOTE ] FMX: Full fetch complete (57823 records). [2025-10-30T18:49:03.801061] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-30T18:49:04.155308] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-30T18:49:04.233570] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-30T18:49:04.233930] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-30T18:49:04.235062] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-30T18:49:04.235262] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-30T18:49:04.262990] [DEBUG] [LOCAL ] FMX: Trimmed 57823 records to 40220 (keeping 200 days of data) [2025-10-30T18:49:04.265146] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T18:49:04.497618] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-30T18:49:04.520201] [DEBUG] [LOCAL ] FMX: Primary data saved (40220 records). [2025-10-30T18:49:04.520310] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-30T18:49:04.520386] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FMX took 35.9s. Estimated remaining: 3h 13m 3s. Rate: 7.8 symbols/min [2025-10-30T18:49:04.695274] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:04.737797] [DEBUG] [LOCAL ] FNF: Loaded 48378 existing records from primary storage. [2025-10-30T18:49:04.738087] [INFO ] [MAIN ] FNF: Loaded 48378 existing records. [2025-10-30T18:49:04.921836] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:04.922063] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-30T18:49:04.922116] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-30T18:49:04.923185] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-30T18:49:04.923394] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-30T18:49:05.056939] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T18:49:05.302620] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-30T18:49:05.333066] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:05.813414] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T18:49:06.097490] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-30T18:49:06.513447] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T18:49:06.897507] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-30T18:49:07.461594] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T18:49:07.697558] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-30T18:49:07.823927] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T18:49:08.497510] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-30T18:49:08.859737] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T18:49:09.297503] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-30T18:49:09.876342] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T18:49:10.097477] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-30T18:49:10.530987] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T18:49:10.897498] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-30T18:49:11.401009] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T18:49:11.697515] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-30T18:49:12.070231] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:49:12.497526] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-30T18:49:13.210383] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-30T18:49:13.297482] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-30T18:49:13.702005] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T18:49:13.709498] [INFO ] [REMOTE ] FN: Full fetch complete (56504 records). [2025-10-30T18:49:13.709700] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-30T18:49:14.096038] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-30T18:49:14.096116] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-30T18:49:14.096946] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-30T18:49:14.097049] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-30T18:49:14.097623] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-30T18:49:14.099307] [DEBUG] [LOCAL ] FN: Trimmed 56504 records to 37165 (keeping 200 days of data) [2025-10-30T18:49:14.323155] [DEBUG] [LOCAL ] FN: Primary data saved (37165 records). [2025-10-30T18:49:14.323307] [INFO ] [MAIN ] FN: Full history saved. [2025-10-30T18:49:14.323388] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FN took 31.1s. Estimated remaining: 3h 12m 59s. Rate: 7.8 symbols/min [2025-10-30T18:49:14.487455] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:14.527177] [DEBUG] [LOCAL ] FNV: Loaded 45814 existing records from primary storage. [2025-10-30T18:49:14.527467] [INFO ] [MAIN ] FNV: Loaded 45814 existing records. [2025-10-30T18:49:14.708420] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:14.708830] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-30T18:49:14.708903] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-30T18:49:14.709862] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-30T18:49:14.709922] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-30T18:49:14.904611] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-30T18:49:15.099507] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-30T18:49:15.103499] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:15.537752] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T18:49:15.697507] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-30T18:49:15.952287] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T18:49:16.497504] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-30T18:49:16.779106] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T18:49:17.297514] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-30T18:49:17.938146] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T18:49:18.097485] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-30T18:49:18.619940] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-30T18:49:18.897559] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-30T18:49:19.181579] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T18:49:19.697560] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-30T18:49:20.078267] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T18:49:20.497523] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-30T18:49:20.922209] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:49:21.297517] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-30T18:49:22.097477] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-30T18:49:22.299452] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-30T18:49:22.313272] [INFO ] [REMOTE ] FNB: Full fetch complete (76250 records). [2025-10-30T18:49:22.313442] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-30T18:49:22.738377] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-30T18:49:22.738490] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-30T18:49:22.739402] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-30T18:49:22.739508] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-30T18:49:22.741051] [DEBUG] [LOCAL ] FNB: Trimmed 76250 records to 52987 (keeping 200 days of data) [2025-10-30T18:49:22.939633] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-30T18:49:22.889636] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-30T18:49:23.095574] [DEBUG] [LOCAL ] FNB: Primary data saved (52987 records). [2025-10-30T18:49:23.095738] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-30T18:49:23.096702] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FNB took 24.9s. Estimated remaining: 3h 12m 53s. Rate: 7.8 symbols/min [2025-10-30T18:49:23.265913] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:23.279122] [DEBUG] [LOCAL ] FOA: Loaded 12656 existing records from primary storage. [2025-10-30T18:49:23.279331] [INFO ] [MAIN ] FOA: Loaded 12656 existing records. [2025-10-30T18:49:23.456324] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:23.456667] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-30T18:49:23.456822] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-30T18:49:23.457173] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-30T18:49:23.457229] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-30T18:49:23.659920] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T18:49:23.705464] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-30T18:49:23.864047] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:24.146837] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T18:49:24.497493] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-30T18:49:25.279593] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-30T18:49:25.297454] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-30T18:49:25.339914] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T18:49:26.097513] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-30T18:49:26.698299] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T18:49:26.897490] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-30T18:49:27.389097] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T18:49:27.697522] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-30T18:49:28.264712] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T18:49:28.497503] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-30T18:49:29.021261] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T18:49:29.261082] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-30T18:49:29.297474] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-30T18:49:29.901356] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T18:49:30.097484] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-30T18:49:30.897500] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-30T18:49:31.423566] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T18:49:31.697532] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-30T18:49:32.315940] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T18:49:32.388749] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T18:49:32.497493] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-30T18:49:33.297545] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-30T18:49:33.686577] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:49:33.916300] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-30T18:49:34.097490] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-30T18:49:34.897496] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-30T18:49:35.268637] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-30T18:49:35.697497] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-30T18:49:36.497584] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-30T18:49:36.540930] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T18:49:36.552829] [INFO ] [REMOTE ] FND: Full fetch complete (75164 records). [2025-10-30T18:49:36.553004] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-30T18:49:36.948993] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-30T18:49:36.949099] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-30T18:49:36.950047] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-30T18:49:36.950135] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-30T18:49:36.951552] [DEBUG] [LOCAL ] FND: Trimmed 75164 records to 52401 (keeping 200 days of data) [2025-10-30T18:49:37.073408] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T18:49:37.285282] [DEBUG] [LOCAL ] FND: Primary data saved (52401 records). [2025-10-30T18:49:37.285408] [INFO ] [MAIN ] FND: Full history saved. [2025-10-30T18:49:37.286010] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FND took 37.9s. Estimated remaining: 3h 12m 57s. Rate: 7.8 symbols/min [2025-10-30T18:49:37.306632] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-30T18:49:37.454507] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:37.464136] [DEBUG] [LOCAL ] FOF: Loaded 8131 existing records from primary storage. [2025-10-30T18:49:37.464343] [INFO ] [MAIN ] FOF: Loaded 8131 existing records. [2025-10-30T18:49:37.647569] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:37.647974] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-30T18:49:37.648098] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-30T18:49:37.648357] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-30T18:49:37.648405] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-30T18:49:37.944969] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T18:49:37.938003] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T18:49:38.048067] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:38.097452] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-30T18:49:38.569412] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-30T18:49:38.897495] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-30T18:49:39.697491] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-30T18:49:40.223169] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T18:49:40.234148] [INFO ] [REMOTE ] FNF: Full fetch complete (69806 records). [2025-10-30T18:49:40.234323] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-30T18:49:40.503196] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-30T18:49:40.615418] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-30T18:49:40.615500] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-30T18:49:40.616429] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-30T18:49:40.616495] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-30T18:49:40.618005] [DEBUG] [LOCAL ] FNF: Trimmed 69806 records to 48716 (keeping 200 days of data) [2025-10-30T18:49:40.911583] [DEBUG] [LOCAL ] FNF: Primary data saved (48716 records). [2025-10-30T18:49:40.911752] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-30T18:49:40.911841] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FNF took 36.4s. Estimated remaining: 3h 12m 42s. Rate: 7.8 symbols/min [2025-10-30T18:49:41.087462] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:41.096843] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T18:49:41.130681] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T18:49:41.146944] [DEBUG] [LOCAL ] FOR: Loaded 18908 existing records from primary storage. [2025-10-30T18:49:41.147169] [INFO ] [MAIN ] FOR: Loaded 18908 existing records. [2025-10-30T18:49:41.322321] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:41.322547] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-30T18:49:41.317012] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-30T18:49:41.323596] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-30T18:49:41.324020] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-30T18:49:41.324076] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-30T18:49:41.695072] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:41.827515] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T18:49:42.097493] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-30T18:49:42.554976] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-30T18:49:42.897494] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-30T18:49:43.697500] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-30T18:49:44.304550] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T18:49:44.343372] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-30T18:49:44.497485] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-30T18:49:44.957100] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-30T18:49:45.297498] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-30T18:49:46.095782] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T18:49:46.101133] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-30T18:49:46.714892] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T18:49:46.897508] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-30T18:49:47.697511] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-30T18:49:48.073214] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T18:49:48.377029] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-30T18:49:48.497501] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-30T18:49:49.186325] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-30T18:49:49.192759] [INFO ] [REMOTE ] FOA: Full fetch complete (20344 records). [2025-10-30T18:49:49.192837] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-30T18:49:49.302583] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-30T18:49:49.564866] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-30T18:49:49.564933] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-30T18:49:49.565442] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-30T18:49:49.565488] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-30T18:49:49.566385] [DEBUG] [LOCAL ] FOA: Trimmed 20344 records to 12762 (keeping 200 days of data) [2025-10-30T18:49:49.640269] [DEBUG] [LOCAL ] FOA: Primary data saved (12762 records). [2025-10-30T18:49:49.640397] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-30T18:49:49.640476] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FOA took 26.5s. Estimated remaining: 3h 12m 36s. Rate: 7.8 symbols/min [2025-10-30T18:49:49.807001] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:49.851945] [DEBUG] [LOCAL ] FOUR: Loaded 49615 existing records from primary storage. [2025-10-30T18:49:49.852235] [INFO ] [MAIN ] FOUR: Loaded 49615 existing records. [2025-10-30T18:49:50.041680] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:50.042005] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-30T18:49:50.042078] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-30T18:49:50.048181] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-30T18:49:50.054830] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-30T18:49:50.099459] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-30T18:49:50.100799] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T18:49:50.423781] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:50.897509] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-30T18:49:51.567388] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T18:49:51.577530] [INFO ] [REMOTE ] FNV: Full fetch complete (66986 records). [2025-10-30T18:49:51.577671] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-30T18:49:51.702747] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-30T18:49:51.964724] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-30T18:49:51.964811] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-30T18:49:51.965781] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-30T18:49:51.965843] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-30T18:49:51.967237] [DEBUG] [LOCAL ] FNV: Trimmed 66986 records to 46143 (keeping 200 days of data) [2025-10-30T18:49:52.207143] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-30T18:49:52.268784] [DEBUG] [LOCAL ] FNV: Primary data saved (46143 records). [2025-10-30T18:49:52.269035] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-30T18:49:52.269766] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FNV took 37.9s. Estimated remaining: 3h 12m 20s. Rate: 7.8 symbols/min [2025-10-30T18:49:52.407531] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T18:49:52.484387] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:52.503736] [DEBUG] [LOCAL ] FPF: Loaded 18458 existing records from primary storage. [2025-10-30T18:49:52.502694] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-30T18:49:52.505026] [INFO ] [MAIN ] FPF: Loaded 18458 existing records. [2025-10-30T18:49:52.687409] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:52.687614] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-30T18:49:52.687695] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-30T18:49:52.688108] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-30T18:49:52.688164] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-30T18:49:53.068300] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:53.075088] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-30T18:49:53.297504] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-30T18:49:54.097522] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-30T18:49:54.169470] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-30T18:49:54.581092] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-30T18:49:54.897497] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-30T18:49:55.362963] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-30T18:49:55.697529] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-30T18:49:56.376077] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T18:49:56.378335] [INFO ] [REMOTE ] FOF: Full fetch complete (11933 records). [2025-10-30T18:49:56.378402] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-30T18:49:56.502712] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-30T18:49:56.739180] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-30T18:49:56.739252] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-30T18:49:56.739521] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-30T18:49:56.739559] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-30T18:49:56.740008] [DEBUG] [LOCAL ] FOF: Trimmed 11933 records to 8187 (keeping 200 days of data) [2025-10-30T18:49:56.788262] [DEBUG] [LOCAL ] FOF: Primary data saved (8187 records). [2025-10-30T18:49:56.788382] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-30T18:49:56.788458] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FOF took 19.5s. Estimated remaining: 3h 12m 7s. Rate: 7.8 symbols/min [2025-10-30T18:49:56.959230] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:49:56.976588] [DEBUG] [LOCAL ] FPH: Loaded 19121 existing records from primary storage. [2025-10-30T18:49:56.976886] [INFO ] [MAIN ] FPH: Loaded 19121 existing records. [2025-10-30T18:49:57.156710] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:49:57.157041] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-30T18:49:57.157101] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-30T18:49:57.157749] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-30T18:49:57.157810] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-30T18:49:57.302764] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-30T18:49:57.530505] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:49:57.538866] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T18:49:58.097534] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-30T18:49:58.819928] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-30T18:49:58.897466] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-30T18:49:58.917678] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T18:49:59.575368] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-30T18:49:59.697480] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-30T18:50:00.497529] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-30T18:50:00.806965] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T18:50:01.297514] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-30T18:50:01.936493] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T18:50:02.097549] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-30T18:50:02.287786] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T18:50:02.877282] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-30T18:50:02.897469] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-30T18:50:03.434955] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T18:50:03.697503] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-30T18:50:04.467831] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T18:50:04.497492] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-30T18:50:05.212023] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T18:50:05.297514] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-30T18:50:05.903415] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T18:50:06.097551] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-30T18:50:06.853558] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T18:50:06.897518] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-30T18:50:07.584075] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T18:50:07.697478] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-30T18:50:08.497502] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-30T18:50:08.540018] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:50:08.543844] [INFO ] [REMOTE ] FOR: Full fetch complete (29397 records). [2025-10-30T18:50:08.543948] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-30T18:50:08.911856] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-30T18:50:08.911936] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-30T18:50:08.912463] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-30T18:50:08.912504] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-30T18:50:08.913289] [DEBUG] [LOCAL ] FOR: Trimmed 29397 records to 19034 (keeping 200 days of data) [2025-10-30T18:50:09.020502] [DEBUG] [LOCAL ] FOR: Primary data saved (19034 records). [2025-10-30T18:50:09.020680] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-30T18:50:09.020785] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FOR took 28.1s. Estimated remaining: 3h 12m 7s. Rate: 7.8 symbols/min [2025-10-30T18:50:09.198599] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:50:09.229310] [DEBUG] [LOCAL ] FPI: Loaded 30948 existing records from primary storage. [2025-10-30T18:50:09.229586] [INFO ] [MAIN ] FPI: Loaded 30948 existing records. [2025-10-30T18:50:09.301108] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-30T18:50:09.431807] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:50:09.432174] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-30T18:50:09.432258] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-30T18:50:09.438073] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-30T18:50:09.444834] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-30T18:50:09.451739] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T18:50:09.804413] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:50:10.097537] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-30T18:50:10.613496] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T18:50:10.676597] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T18:50:10.897511] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-30T18:50:11.694487] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T18:50:11.700947] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-30T18:50:12.497520] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-30T18:50:12.655353] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-30T18:50:13.297508] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-30T18:50:13.942940] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T18:50:14.097470] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-30T18:50:14.150057] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-30T18:50:14.897540] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-30T18:50:15.479559] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T18:50:15.697508] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-30T18:50:15.771171] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T18:50:16.497536] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-30T18:50:16.977535] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T18:50:17.302573] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-30T18:50:17.315186] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T18:50:18.097535] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-30T18:50:18.861860] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T18:50:18.897485] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-30T18:50:19.111793] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T18:50:19.697514] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-30T18:50:20.332520] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T18:50:20.373861] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-30T18:50:20.497490] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-30T18:50:21.180060] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-30T18:50:21.297506] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-30T18:50:22.097468] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-30T18:50:22.235310] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T18:50:22.897538] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-30T18:50:23.558677] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-30T18:50:23.570308] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-30T18:50:23.697536] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-30T18:50:24.497511] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-30T18:50:25.140578] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T18:50:25.297500] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-30T18:50:25.458101] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-30T18:50:25.469027] [INFO ] [REMOTE ] FOUR: Full fetch complete (72352 records). [2025-10-30T18:50:25.469137] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-30T18:50:25.849137] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-30T18:50:25.849214] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-30T18:50:25.850086] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-30T18:50:25.850149] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-30T18:50:25.851423] [DEBUG] [LOCAL ] FOUR: Trimmed 72352 records to 50005 (keeping 200 days of data) [2025-10-30T18:50:26.103789] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-30T18:50:26.139797] [DEBUG] [LOCAL ] FOUR: Primary data saved (50005 records). [2025-10-30T18:50:26.139929] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-30T18:50:26.141009] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FOUR took 36.5s. Estimated remaining: 3h 12m 16s. Rate: 7.8 symbols/min [2025-10-30T18:50:26.310827] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:50:26.337164] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T18:50:26.389273] [DEBUG] [LOCAL ] FR: Loaded 46442 existing records from primary storage. [2025-10-30T18:50:26.389594] [INFO ] [MAIN ] FR: Loaded 46442 existing records. [2025-10-30T18:50:26.573974] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:50:26.574168] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-30T18:50:26.574216] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-30T18:50:26.575105] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-30T18:50:26.575163] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-30T18:50:26.902549] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-30T18:50:26.967034] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:50:26.979818] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T18:50:27.697503] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-30T18:50:27.827294] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T18:50:28.471503] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-30T18:50:28.497476] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-30T18:50:29.287762] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-30T18:50:29.297447] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-30T18:50:30.097505] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-30T18:50:30.382091] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-30T18:50:30.389070] [INFO ] [REMOTE ] FPI: Full fetch complete (43742 records). [2025-10-30T18:50:30.389166] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-30T18:50:30.763905] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-30T18:50:30.764009] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-30T18:50:30.764696] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-30T18:50:30.764758] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-30T18:50:30.765634] [DEBUG] [LOCAL ] FPI: Trimmed 43742 records to 31207 (keeping 200 days of data) [2025-10-30T18:50:30.914974] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-30T18:50:30.955281] [DEBUG] [LOCAL ] FPI: Primary data saved (31207 records). [2025-10-30T18:50:30.955526] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-30T18:50:30.955621] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FPI took 21.9s. Estimated remaining: 3h 12m 3s. Rate: 7.8 symbols/min [2025-10-30T18:50:31.033694] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T18:50:31.147541] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:50:31.161571] [DEBUG] [LOCAL ] FRA: Loaded 13241 existing records from primary storage. [2025-10-30T18:50:31.161829] [INFO ] [MAIN ] FRA: Loaded 13241 existing records. [2025-10-30T18:50:31.341621] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:50:31.341883] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-30T18:50:31.341937] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-30T18:50:31.342299] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-30T18:50:31.342359] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-30T18:50:31.694253] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:50:31.697463] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-30T18:50:31.847457] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T18:50:31.852918] [INFO ] [REMOTE ] FPF: Full fetch complete (26628 records). [2025-10-30T18:50:31.853019] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-30T18:50:32.226475] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-30T18:50:32.226559] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-30T18:50:32.227098] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-30T18:50:32.227159] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-30T18:50:32.227947] [DEBUG] [LOCAL ] FPF: Trimmed 26628 records to 18642 (keeping 200 days of data) [2025-10-30T18:50:32.352204] [DEBUG] [LOCAL ] FPF: Primary data saved (18642 records). [2025-10-30T18:50:32.352579] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-30T18:50:32.352815] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FPF took 40.1s. Estimated remaining: 3h 11m 45s. Rate: 7.8 symbols/min [2025-10-30T18:50:32.474239] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T18:50:32.499525] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-30T18:50:32.558017] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:50:32.573857] [DEBUG] [LOCAL ] FRGE: Loaded 15222 existing records from primary storage. [2025-10-30T18:50:32.574110] [INFO ] [MAIN ] FRGE: Loaded 15222 existing records. [2025-10-30T18:50:32.767910] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:50:32.768154] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-30T18:50:32.768203] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-30T18:50:32.768709] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-30T18:50:32.768790] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-30T18:50:33.115979] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:50:33.297457] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-30T18:50:33.652051] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T18:50:34.097489] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-30T18:50:34.417720] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T18:50:34.766066] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T18:50:34.897494] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-30T18:50:35.697529] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-30T18:50:35.991277] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T18:50:36.497475] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-30T18:50:36.531899] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T18:50:36.536099] [INFO ] [REMOTE ] FPH: Full fetch complete (30723 records). [2025-10-30T18:50:36.536171] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-30T18:50:36.894079] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-30T18:50:36.894151] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-30T18:50:36.894633] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-30T18:50:36.894711] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-30T18:50:36.895353] [DEBUG] [LOCAL ] FPH: Trimmed 30723 records to 19256 (keeping 200 days of data) [2025-10-30T18:50:36.997140] [DEBUG] [LOCAL ] FPH: Primary data saved (19256 records). [2025-10-30T18:50:36.997258] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-30T18:50:36.997334] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FPH took 40.2s. Estimated remaining: 3h 11m 32s. Rate: 7.8 symbols/min [2025-10-30T18:50:37.164267] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:50:37.212505] [DEBUG] [LOCAL ] FRO: Loaded 51579 existing records from primary storage. [2025-10-30T18:50:37.212855] [INFO ] [MAIN ] FRO: Loaded 51579 existing records. [2025-10-30T18:50:37.306812] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-30T18:50:37.395750] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:50:37.395923] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-30T18:50:37.395969] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-30T18:50:37.397088] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-30T18:50:37.397148] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-30T18:50:37.771578] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:50:37.794811] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T18:50:38.097466] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-30T18:50:38.210299] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T18:50:38.897496] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-30T18:50:39.548279] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-30T18:50:39.689278] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-30T18:50:39.699505] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-30T18:50:40.497495] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-30T18:50:40.960154] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-30T18:50:41.297501] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-30T18:50:42.065110] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-30T18:50:42.097468] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-30T18:50:42.277509] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T18:50:42.897518] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-30T18:50:43.470499] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T18:50:43.626682] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-30T18:50:43.697471] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-30T18:50:44.278876] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-30T18:50:44.497548] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-30T18:50:45.297508] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-30T18:50:45.407112] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T18:50:46.097544] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-30T18:50:46.583806] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T18:50:46.729925] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T18:50:46.897507] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-30T18:50:47.697509] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-30T18:50:48.213520] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-30T18:50:48.350202] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T18:50:48.497510] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-30T18:50:49.234472] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-30T18:50:49.297467] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-30T18:50:49.892223] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-30T18:50:50.097516] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-30T18:50:50.782085] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T18:50:50.897514] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-30T18:50:51.697583] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-30T18:50:52.297041] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-30T18:50:52.337377] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T18:50:52.497499] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-30T18:50:53.265757] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-30T18:50:53.297454] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-30T18:50:53.823412] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T18:50:54.097482] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-30T18:50:54.869403] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-30T18:50:54.872796] [INFO ] [REMOTE ] FRGE: Full fetch complete (29439 records). [2025-10-30T18:50:54.872868] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-30T18:50:54.902726] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-30T18:50:55.255993] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-30T18:50:55.256097] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-30T18:50:55.256625] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-30T18:50:55.256707] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-30T18:50:55.257327] [DEBUG] [LOCAL ] FRGE: Trimmed 29439 records to 15367 (keeping 200 days of data) [2025-10-30T18:50:55.342867] [DEBUG] [LOCAL ] FRGE: Primary data saved (15367 records). [2025-10-30T18:50:55.342988] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-30T18:50:55.343063] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FRGE took 23.0s. Estimated remaining: 3h 11m 42s. Rate: 7.8 symbols/min [2025-10-30T18:50:55.516451] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:50:55.552315] [DEBUG] [LOCAL ] FRT: Loaded 41004 existing records from primary storage. [2025-10-30T18:50:55.552582] [INFO ] [MAIN ] FRT: Loaded 41004 existing records. [2025-10-30T18:50:55.702735] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-30T18:50:55.746757] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:50:55.747080] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-30T18:50:55.747145] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-30T18:50:55.748088] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-30T18:50:55.748151] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-30T18:50:56.133550] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:50:56.185582] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T18:50:56.367331] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T18:50:56.497459] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-30T18:50:57.202689] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T18:50:57.205931] [INFO ] [REMOTE ] FRA: Full fetch complete (22581 records). [2025-10-30T18:50:57.206009] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-30T18:50:57.302729] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-30T18:50:57.578564] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-30T18:50:57.578676] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-30T18:50:57.579181] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-30T18:50:57.579223] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-30T18:50:57.579974] [DEBUG] [LOCAL ] FRA: Trimmed 22581 records to 13351 (keeping 200 days of data) [2025-10-30T18:50:57.658236] [DEBUG] [LOCAL ] FRA: Primary data saved (13351 records). [2025-10-30T18:50:57.658352] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-30T18:50:57.658427] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FRA took 26.7s. Estimated remaining: 3h 11m 26s. Rate: 7.8 symbols/min [2025-10-30T18:50:57.826723] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:50:57.859711] [DEBUG] [LOCAL ] FSCO: Loaded 38302 existing records from primary storage. [2025-10-30T18:50:57.859986] [INFO ] [MAIN ] FSCO: Loaded 38302 existing records. [2025-10-30T18:50:58.033789] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:50:58.034034] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-30T18:50:58.034103] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-30T18:50:58.034907] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-30T18:50:58.034982] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-30T18:50:58.102666] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-30T18:50:58.394194] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:50:58.618307] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-30T18:50:58.897533] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-30T18:50:59.331130] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T18:50:59.697554] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-30T18:51:00.090425] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T18:51:00.497524] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-30T18:51:01.229546] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T18:51:01.297460] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-30T18:51:01.867481] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T18:51:02.097483] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-30T18:51:02.392952] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:51:02.897509] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-30T18:51:03.585603] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-30T18:51:03.697544] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-30T18:51:04.144187] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T18:51:04.497551] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-30T18:51:04.958346] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T18:51:05.297503] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-30T18:51:05.358079] [DEBUG] [REMOTE ] FSCO: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-30T18:51:05.358436] [WARN ] [REMOTE ] FSCO: No data returned for month 2025-02 [2025-10-30T18:51:05.358527] [FATAL] [REMOTE ] FSCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T18:51:05.358617] [FATAL] [MAIN ] FSCO: Failed to fetch primary data. [2025-10-30T18:51:05.358707] [WARN ] [MAIN ] FSCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T18:51:05.358780] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-30T18:51:05.358856] [DEBUG] [LOCAL ] FSCO: No primary data file found to delete. [2025-10-30T18:51:05.358914] [INFO ] [LOCAL ] FSCO: Starting deletion of derivative data. [2025-10-30T18:51:05.359133] [DEBUG] [LOCAL ] FSCO: Deleted derivative data file. [2025-10-30T18:51:05.359218] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FSCO took 7.7s. Estimated remaining: 3h 11m 18s. Rate: 7.8 symbols/min [2025-10-30T18:51:05.535577] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:51:05.582778] [DEBUG] [LOCAL ] FSK: Loaded 49354 existing records from primary storage. [2025-10-30T18:51:05.583093] [INFO ] [MAIN ] FSK: Loaded 49354 existing records. [2025-10-30T18:51:05.766145] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:51:05.766341] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-30T18:51:05.766449] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-30T18:51:05.767617] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-30T18:51:05.767720] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-30T18:51:06.101957] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-30T18:51:06.146297] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:51:06.172816] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-30T18:51:06.897525] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-30T18:51:07.545963] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T18:51:07.697477] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-30T18:51:08.376930] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T18:51:08.388535] [INFO ] [REMOTE ] FR: Full fetch complete (67564 records). [2025-10-30T18:51:08.388758] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-30T18:51:08.502750] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-30T18:51:08.833341] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-30T18:51:08.833626] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-30T18:51:08.834987] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-30T18:51:08.835078] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-30T18:51:08.837166] [DEBUG] [LOCAL ] FR: Trimmed 67564 records to 46772 (keeping 200 days of data) [2025-10-30T18:51:09.092602] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-30T18:51:09.180177] [DEBUG] [LOCAL ] FR: Primary data saved (46772 records). [2025-10-30T18:51:09.180382] [INFO ] [MAIN ] FR: Full history saved. [2025-10-30T18:51:09.181489] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FR took 43.0s. Estimated remaining: 3h 11m 4s. Rate: 7.8 symbols/min [2025-10-30T18:51:09.302713] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-30T18:51:09.365505] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:51:09.422874] [DEBUG] [LOCAL ] FSLY: Loaded 51196 existing records from primary storage. [2025-10-30T18:51:09.423324] [INFO ] [MAIN ] FSLY: Loaded 51196 existing records. [2025-10-30T18:51:09.605065] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:51:09.605375] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-30T18:51:09.605438] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-30T18:51:09.606557] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-30T18:51:09.606620] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-30T18:51:09.999356] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:51:10.027206] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-30T18:51:10.097535] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-30T18:51:10.607633] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T18:51:10.897517] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-30T18:51:11.371716] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T18:51:11.697512] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-30T18:51:11.914940] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T18:51:12.497499] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-30T18:51:12.971295] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T18:51:13.297501] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-30T18:51:13.642601] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T18:51:14.097486] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-30T18:51:14.522088] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T18:51:14.897505] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-30T18:51:15.664895] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T18:51:15.697479] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-30T18:51:16.048278] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T18:51:16.497498] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-30T18:51:16.978261] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T18:51:17.297497] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-30T18:51:17.578702] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T18:51:18.097501] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-30T18:51:18.755616] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T18:51:18.897495] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-30T18:51:19.383246] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T18:51:19.697533] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-30T18:51:20.233744] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T18:51:20.497521] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-30T18:51:21.297508] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-30T18:51:21.471768] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-30T18:51:21.483112] [INFO ] [REMOTE ] FRO: Full fetch complete (75300 records). [2025-10-30T18:51:21.483244] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-30T18:51:21.885492] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-30T18:51:21.885721] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-30T18:51:21.889580] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-30T18:51:21.889925] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-30T18:51:21.891895] [DEBUG] [LOCAL ] FRO: Trimmed 75300 records to 51965 (keeping 200 days of data) [2025-10-30T18:51:22.009074] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T18:51:22.100819] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-30T18:51:22.236793] [DEBUG] [LOCAL ] FRO: Primary data saved (51965 records). [2025-10-30T18:51:22.236903] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-30T18:51:22.237488] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FRO took 45.2s. Estimated remaining: 3h 11m 5s. Rate: 7.8 symbols/min [2025-10-30T18:51:22.404582] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:51:22.454470] [DEBUG] [LOCAL ] FSM: Loaded 53294 existing records from primary storage. [2025-10-30T18:51:22.454896] [INFO ] [MAIN ] FSM: Loaded 53294 existing records. [2025-10-30T18:51:22.635207] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:51:22.635465] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-30T18:51:22.635602] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-30T18:51:22.636493] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-30T18:51:22.636558] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-30T18:51:22.810927] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-30T18:51:22.903503] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-30T18:51:23.042222] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:51:23.397957] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T18:51:23.697506] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-30T18:51:24.169999] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T18:51:24.497508] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-30T18:51:24.852617] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T18:51:25.297492] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-30T18:51:25.982829] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T18:51:26.097523] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-30T18:51:26.548060] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T18:51:26.897497] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-30T18:51:27.358353] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:51:27.697495] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-30T18:51:28.350768] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-30T18:51:28.497495] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-30T18:51:28.980409] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T18:51:29.297468] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-30T18:51:29.987673] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T18:51:29.998917] [INFO ] [REMOTE ] FSLY: Full fetch complete (74846 records). [2025-10-30T18:51:29.999040] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-30T18:51:30.100559] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-30T18:51:30.387308] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-30T18:51:30.387386] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-30T18:51:30.388268] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-30T18:51:30.388330] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-30T18:51:30.389679] [DEBUG] [LOCAL ] FSLY: Trimmed 74846 records to 51576 (keeping 200 days of data) [2025-10-30T18:51:30.680591] [DEBUG] [LOCAL ] FSLY: Primary data saved (51576 records). [2025-10-30T18:51:30.680757] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-30T18:51:30.681538] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FSLY took 21.5s. Estimated remaining: 3h 10m 59s. Rate: 7.8 symbols/min [2025-10-30T18:51:30.854441] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:51:30.885720] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T18:51:30.897450] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-30T18:51:30.923613] [DEBUG] [LOCAL ] FSS: Loaded 32549 existing records from primary storage. [2025-10-30T18:51:30.923891] [INFO ] [MAIN ] FSS: Loaded 32549 existing records. [2025-10-30T18:51:31.100428] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:51:31.100672] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-30T18:51:31.100734] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-30T18:51:31.101308] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-30T18:51:31.101367] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-30T18:51:31.501353] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:51:31.530813] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-30T18:51:31.540270] [INFO ] [REMOTE ] FRT: Full fetch complete (60395 records). [2025-10-30T18:51:31.540436] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-30T18:51:31.706036] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-30T18:51:32.081916] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-30T18:51:32.082038] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-30T18:51:32.083011] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-30T18:51:32.083100] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-30T18:51:32.084767] [DEBUG] [LOCAL ] FRT: Trimmed 60395 records to 41315 (keeping 200 days of data) [2025-10-30T18:51:32.422882] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T18:51:32.478583] [DEBUG] [LOCAL ] FRT: Primary data saved (41315 records). [2025-10-30T18:51:32.478731] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-30T18:51:32.479346] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FRT took 37.1s. Estimated remaining: 3h 10m 41s. Rate: 7.8 symbols/min [2025-10-30T18:51:32.502844] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-30T18:51:32.659543] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:51:32.668480] [DEBUG] [LOCAL ] FT: Loaded 6709 existing records from primary storage. [2025-10-30T18:51:32.668719] [INFO ] [MAIN ] FT: Loaded 6709 existing records. [2025-10-30T18:51:32.854943] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:51:32.855170] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-30T18:51:32.855239] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-30T18:51:32.855496] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-30T18:51:32.855581] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-30T18:51:33.215498] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:51:33.244369] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-30T18:51:33.281711] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T18:51:33.297457] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-30T18:51:34.097467] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-30T18:51:34.298681] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-30T18:51:34.897502] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-30T18:51:35.485460] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T18:51:35.697486] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-30T18:51:35.927854] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T18:51:36.497492] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-30T18:51:37.295400] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T18:51:37.305718] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-30T18:51:37.307982] [INFO ] [REMOTE ] FSK: Full fetch complete (72175 records). [2025-10-30T18:51:37.308195] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-30T18:51:37.710075] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-30T18:51:37.710179] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-30T18:51:37.711160] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-30T18:51:37.711239] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-30T18:51:37.713058] [DEBUG] [LOCAL ] FSK: Trimmed 72175 records to 49725 (keeping 200 days of data) [2025-10-30T18:51:37.838243] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:51:38.046693] [DEBUG] [LOCAL ] FSK: Primary data saved (49725 records). [2025-10-30T18:51:38.046814] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-30T18:51:38.046890] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FSK took 32.7s. Estimated remaining: 3h 10m 30s. Rate: 7.8 symbols/min [2025-10-30T18:51:38.102593] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-30T18:51:38.226715] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T18:51:38.229933] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:51:38.244416] [DEBUG] [LOCAL ] FTHY: Loaded 11953 existing records from primary storage. [2025-10-30T18:51:38.244667] [INFO ] [MAIN ] FTHY: Loaded 11953 existing records. [2025-10-30T18:51:38.427338] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:51:38.427555] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-30T18:51:38.427608] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-30T18:51:38.427958] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-30T18:51:38.428014] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-30T18:51:38.778520] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:51:38.897494] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-30T18:51:39.174819] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T18:51:39.561902] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-30T18:51:39.697499] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-30T18:51:40.497482] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-30T18:51:41.006004] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T18:51:41.297497] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-30T18:51:41.536892] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T18:51:41.692137] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T18:51:42.097528] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-30T18:51:42.897553] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-30T18:51:43.140964] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T18:51:43.363991] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T18:51:43.697542] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-30T18:51:44.497469] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-30T18:51:44.652679] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T18:51:44.970124] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-30T18:51:45.297495] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-30T18:51:45.915213] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T18:51:46.097501] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-30T18:51:46.897469] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-30T18:51:47.066688] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T18:51:47.443571] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-30T18:51:47.697516] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-30T18:51:48.497535] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-30T18:51:48.936765] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-30T18:51:49.163121] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-30T18:51:49.297487] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-30T18:51:50.097522] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-30T18:51:50.680317] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-30T18:51:50.735821] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T18:51:50.897494] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-30T18:51:51.697515] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-30T18:51:52.182349] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:51:52.243483] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T18:51:52.497503] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-30T18:51:52.952032] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T18:51:53.297495] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-30T18:51:53.914673] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T18:51:54.097526] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-30T18:51:54.620892] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T18:51:54.897491] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-30T18:51:55.697495] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-30T18:51:56.260565] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T18:51:56.292576] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T18:51:56.497462] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-30T18:51:57.297496] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-30T18:51:58.097467] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-30T18:51:58.259453] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-30T18:51:58.271562] [INFO ] [REMOTE ] FSM: Full fetch complete (77250 records). [2025-10-30T18:51:58.271729] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-30T18:51:58.616620] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-30T18:51:58.670535] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T18:51:58.700309] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-30T18:51:58.700395] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-30T18:51:58.700479] [INFO ] [REMOTE ] FSS: Full fetch complete (48654 records). [2025-10-30T18:51:58.701424] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-30T18:51:58.701528] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-30T18:51:58.701595] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-30T18:51:58.805877] [DEBUG] [LOCAL ] FSM: Trimmed 77250 records to 53683 (keeping 200 days of data) [2025-10-30T18:51:58.900709] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-30T18:51:59.309775] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-30T18:51:59.315765] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-30T18:51:59.319397] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-30T18:51:59.319476] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-30T18:51:59.381030] [DEBUG] [LOCAL ] FSS: Trimmed 48654 records to 32926 (keeping 200 days of data) [2025-10-30T18:51:59.404061] [DEBUG] [LOCAL ] FSM: Primary data saved (53683 records). [2025-10-30T18:51:59.404389] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-30T18:51:59.404486] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FSM took 37.2s. Estimated remaining: 3h 10m 46s. Rate: 7.8 symbols/min [2025-10-30T18:51:59.708736] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-30T18:51:59.703520] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-30T18:51:59.782136] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:51:59.808200] [DEBUG] [LOCAL ] FSS: Primary data saved (32926 records). [2025-10-30T18:51:59.808387] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-30T18:51:59.808479] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FSS took 29.1s. Estimated remaining: 3h 10m 26s. Rate: 7.8 symbols/min [2025-10-30T18:52:00.011751] [DEBUG] [LOCAL ] FTI: Loaded 53289 existing records from primary storage. [2025-10-30T18:52:00.013236] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:00.013751] [INFO ] [MAIN ] FTI: Loaded 53289 existing records. [2025-10-30T18:52:00.203363] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:00.203671] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-30T18:52:00.203733] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-30T18:52:00.204913] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-30T18:52:00.205054] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-30T18:52:00.314927] [DEBUG] [LOCAL ] FTK: Loaded 33149 existing records from primary storage. [2025-10-30T18:52:00.317668] [INFO ] [MAIN ] FTK: Loaded 33149 existing records. [2025-10-30T18:52:00.506510] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-30T18:52:00.671998] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:00.683225] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-30T18:52:00.694016] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-30T18:52:00.728816] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-30T18:52:00.759347] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-30T18:52:00.782812] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:00.844497] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T18:52:00.878565] [INFO ] [REMOTE ] FTHY: Full fetch complete (17224 records). [2025-10-30T18:52:00.880935] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-30T18:52:01.319477] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-30T18:52:01.387586] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T18:52:01.539925] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-30T18:52:01.539778] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:01.540248] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-30T18:52:01.540733] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-30T18:52:01.540796] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-30T18:52:01.541320] [DEBUG] [LOCAL ] FTHY: Trimmed 17224 records to 12003 (keeping 200 days of data) [2025-10-30T18:52:01.614968] [DEBUG] [LOCAL ] FTHY: Primary data saved (12003 records). [2025-10-30T18:52:01.615109] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-30T18:52:01.615191] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FTHY took 23.6s. Estimated remaining: 3h 10m 8s. Rate: 7.8 symbols/min [2025-10-30T18:52:02.097575] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-30T18:52:02.549303] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T18:52:02.897488] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-30T18:52:02.935136] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-30T18:52:03.583896] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-30T18:52:03.586285] [INFO ] [REMOTE ] FT: Full fetch complete (9379 records). [2025-10-30T18:52:03.586382] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-30T18:52:03.702768] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-30T18:52:03.943917] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-30T18:52:03.943994] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-30T18:52:03.944271] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-30T18:52:03.944309] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-30T18:52:03.944754] [DEBUG] [LOCAL ] FT: Trimmed 9379 records to 6756 (keeping 200 days of data) [2025-10-30T18:52:03.982823] [DEBUG] [LOCAL ] FT: Primary data saved (6756 records). [2025-10-30T18:52:03.982950] [INFO ] [MAIN ] FT: Full history saved. [2025-10-30T18:52:03.983032] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FT took 31.5s. Estimated remaining: 3h 9m 51s. Rate: 7.8 symbols/min [2025-10-30T18:52:04.497533] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-30T18:52:04.953110] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T18:52:05.299012] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-30T18:52:05.300858] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T18:52:06.097490] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-30T18:52:06.738478] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T18:52:06.761228] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T18:52:06.897495] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-30T18:52:07.697497] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-30T18:52:07.920118] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T18:52:08.497470] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-30T18:52:09.049720] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T18:52:09.106421] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-30T18:52:09.297531] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-30T18:52:10.097527] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-30T18:52:10.319626] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T18:52:10.897541] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-30T18:52:11.644334] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-30T18:52:11.697489] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-30T18:52:12.047993] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:52:12.497492] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-30T18:52:12.997719] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-30T18:52:13.297498] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-30T18:52:13.653042] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T18:52:14.097545] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-30T18:52:14.636974] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T18:52:14.897503] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-30T18:52:15.125491] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T18:52:15.697500] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-30T18:52:16.116855] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T18:52:16.497497] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-30T18:52:16.755841] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T18:52:17.297529] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-30T18:52:17.825579] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T18:52:18.097532] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-30T18:52:18.425275] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T18:52:18.432541] [INFO ] [REMOTE ] FTK: Full fetch complete (44226 records). [2025-10-30T18:52:18.432667] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-30T18:52:18.820258] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-30T18:52:18.820338] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-30T18:52:18.821020] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-30T18:52:18.821272] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-30T18:52:18.822491] [DEBUG] [LOCAL ] FTK: Trimmed 44226 records to 33430 (keeping 200 days of data) [2025-10-30T18:52:19.040742] [DEBUG] [LOCAL ] FTK: Primary data saved (33430 records). [2025-10-30T18:52:19.040879] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-30T18:52:19.040961] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTK took 19.2s. Estimated remaining: 3h 9m 56s. Rate: 7.8 symbols/min [2025-10-30T18:52:19.967280] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-30T18:52:19.979012] [INFO ] [REMOTE ] FTI: Full fetch complete (77338 records). [2025-10-30T18:52:19.979176] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-30T18:52:20.367347] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-30T18:52:20.367426] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-30T18:52:20.368327] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-30T18:52:20.368390] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-30T18:52:20.369807] [DEBUG] [LOCAL ] FTI: Trimmed 77338 records to 53679 (keeping 200 days of data) [2025-10-30T18:52:20.679818] [DEBUG] [LOCAL ] FTI: Primary data saved (53679 records). [2025-10-30T18:52:20.679937] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-30T18:52:20.680012] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTI took 21.3s. Estimated remaining: 3h 9m 38s. Rate: 7.8 symbols/min [2025-10-30T18:52:21.271139] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:21.353524] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:21.390064] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:21.423933] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:21.428689] [DEBUG] [LOCAL ] FTWO: Loaded 1933 existing records from primary storage. [2025-10-30T18:52:21.428906] [INFO ] [MAIN ] FTWO: Loaded 1933 existing records. [2025-10-30T18:52:21.645767] [DEBUG] [LOCAL ] FTS: Loaded 42262 existing records from primary storage. [2025-10-30T18:52:21.662030] [INFO ] [MAIN ] FTS: Loaded 42262 existing records. [2025-10-30T18:52:21.687487] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:21.734034] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-30T18:52:21.740813] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-30T18:52:21.752203] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-30T18:52:21.752374] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-30T18:52:21.767186] [DEBUG] [LOCAL ] FTV: Loaded 53001 existing records from primary storage. [2025-10-30T18:52:21.794060] [INFO ] [MAIN ] FTV: Loaded 53001 existing records. [2025-10-30T18:52:21.835216] [DEBUG] [LOCAL ] FUBO: Loaded 53714 existing records from primary storage. [2025-10-30T18:52:21.940711] [INFO ] [MAIN ] FUBO: Loaded 53714 existing records. [2025-10-30T18:52:22.360325] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:22.377359] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:22.444388] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-30T18:52:22.444867] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-30T18:52:22.444595] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-30T18:52:22.455003] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-30T18:52:22.501020] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-30T18:52:22.550586] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-30T18:52:22.566536] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-30T18:52:22.624781] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-30T18:52:22.667823] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:22.736789] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-30T18:52:22.765157] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-30T18:52:22.837670] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-30T18:52:22.876012] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-30T18:52:22.919260] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:23.015077] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-30T18:52:23.788351] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:23.795916] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T18:52:23.789600] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-30T18:52:23.819544] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-30T18:52:23.848848] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:23.878408] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-30T18:52:23.936584] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:23.937919] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-30T18:52:24.251342] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-30T18:52:24.252768] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-30T18:52:24.615365] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-30T18:52:24.616552] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-30T18:52:24.897667] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-30T18:52:24.898769] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-30T18:52:25.030350] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T18:52:25.113939] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-30T18:52:25.118447] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T18:52:25.297518] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-30T18:52:25.979194] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-30T18:52:26.097465] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-30T18:52:26.304763] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T18:52:26.897553] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-30T18:52:27.699735] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-30T18:52:27.706123] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-30T18:52:28.123607] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-30T18:52:28.165616] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T18:52:28.497499] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-30T18:52:29.297502] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-30T18:52:29.625825] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-30T18:52:29.725450] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T18:52:30.097541] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-30T18:52:30.378767] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-30T18:52:30.897508] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-30T18:52:31.697506] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-30T18:52:32.332108] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T18:52:32.497534] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-30T18:52:32.761783] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-30T18:52:33.297736] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-30T18:52:33.957256] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T18:52:34.097508] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-30T18:52:34.418590] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:52:34.417287] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-30T18:52:34.897518] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-30T18:52:35.697470] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-30T18:52:36.466428] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-30T18:52:36.497462] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-30T18:52:36.962693] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T18:52:37.297505] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-30T18:52:37.701838] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-30T18:52:37.702981] [INFO ] [REMOTE ] FTWO: Full fetch complete (3282 records). [2025-10-30T18:52:37.703049] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-30T18:52:38.080798] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-30T18:52:38.080892] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-30T18:52:38.081024] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-30T18:52:38.081094] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-30T18:52:38.081585] [DEBUG] [LOCAL ] FTWO: Trimmed 3282 records to 1949 (keeping 200 days of data) [2025-10-30T18:52:38.093503] [DEBUG] [LOCAL ] FTWO: Primary data saved (1949 records). [2025-10-30T18:52:38.093562] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-30T18:52:38.093628] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTWO took 17.4s. Estimated remaining: 3h 9m 47s. Rate: 7.8 symbols/min [2025-10-30T18:52:38.104912] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-30T18:52:38.282145] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:38.316458] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-30T18:52:38.349987] [DEBUG] [LOCAL ] FUL: Loaded 31580 existing records from primary storage. [2025-10-30T18:52:38.350237] [INFO ] [MAIN ] FUL: Loaded 31580 existing records. [2025-10-30T18:52:38.530230] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:38.530439] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-30T18:52:38.530489] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-30T18:52:38.530856] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-30T18:52:38.530913] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-30T18:52:38.898568] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:38.898693] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-30T18:52:39.252992] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T18:52:39.697530] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-30T18:52:40.384162] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-30T18:52:40.497531] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-30T18:52:41.297499] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-30T18:52:41.538013] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-30T18:52:41.590242] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T18:52:42.097569] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-30T18:52:42.504720] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T18:52:42.897570] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-30T18:52:43.592927] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-30T18:52:43.697515] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-30T18:52:43.934288] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T18:52:44.497548] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-30T18:52:44.985534] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T18:52:45.297470] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-30T18:52:45.420241] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T18:52:46.097511] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-30T18:52:46.472339] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:52:46.897497] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-30T18:52:47.697475] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-30T18:52:47.817519] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-30T18:52:48.316207] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T18:52:48.497461] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-30T18:52:49.059950] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T18:52:49.069912] [INFO ] [REMOTE ] FTS: Full fetch complete (60981 records). [2025-10-30T18:52:49.070052] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-30T18:52:49.302713] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-30T18:52:49.480536] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-30T18:52:49.480678] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-30T18:52:49.481788] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-30T18:52:49.481854] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-30T18:52:49.483679] [DEBUG] [LOCAL ] FTS: Trimmed 60981 records to 42567 (keeping 200 days of data) [2025-10-30T18:52:49.757912] [DEBUG] [LOCAL ] FTS: Primary data saved (42567 records). [2025-10-30T18:52:49.758088] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-30T18:52:49.758216] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FTS took 29.1s. Estimated remaining: 3h 9m 46s. Rate: 7.8 symbols/min [2025-10-30T18:52:49.945684] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:49.984788] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T18:52:50.054497] [DEBUG] [LOCAL ] FUN: Loaded 52108 existing records from primary storage. [2025-10-30T18:52:50.055045] [INFO ] [MAIN ] FUN: Loaded 52108 existing records. [2025-10-30T18:52:50.102879] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-30T18:52:50.256167] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:50.256566] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-30T18:52:50.256631] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-30T18:52:50.257559] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-30T18:52:50.257629] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-30T18:52:50.648476] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:50.897520] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-30T18:52:50.992184] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-30T18:52:51.065321] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-30T18:52:51.697582] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-30T18:52:52.497510] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-30T18:52:52.592974] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T18:52:52.604486] [INFO ] [REMOTE ] FTV: Full fetch complete (76650 records). [2025-10-30T18:52:52.604608] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-30T18:52:53.016520] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-30T18:52:53.016614] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-30T18:52:53.017591] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-30T18:52:53.017704] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-30T18:52:53.041134] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T18:52:53.039970] [DEBUG] [LOCAL ] FTV: Trimmed 76650 records to 53391 (keeping 200 days of data) [2025-10-30T18:52:53.326912] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-30T18:52:53.374286] [DEBUG] [LOCAL ] FTV: Primary data saved (53391 records). [2025-10-30T18:52:53.374413] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-30T18:52:53.375270] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FTV took 32.7s. Estimated remaining: 3h 9m 32s. Rate: 7.8 symbols/min [2025-10-30T18:52:53.559789] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:53.582355] [DEBUG] [LOCAL ] FVR: Loaded 20489 existing records from primary storage. [2025-10-30T18:52:53.582587] [INFO ] [MAIN ] FVR: Loaded 20489 existing records. [2025-10-30T18:52:53.769635] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:53.769887] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-30T18:52:53.769933] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-30T18:52:53.770342] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-30T18:52:53.770408] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-30T18:52:54.102561] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-30T18:52:54.124618] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:54.157064] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-30T18:52:54.459598] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T18:52:54.897491] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-30T18:52:55.004287] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T18:52:55.697539] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-30T18:52:56.297729] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-30T18:52:56.497523] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-30T18:52:56.944024] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-30T18:52:56.959851] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-30T18:52:56.960035] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-30T18:52:57.157755] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T18:52:57.302639] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-30T18:52:57.381062] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-30T18:52:57.381152] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-30T18:52:57.382096] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-30T18:52:57.382159] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-30T18:52:57.383602] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 54104 (keeping 200 days of data) [2025-10-30T18:52:57.677669] [DEBUG] [LOCAL ] FUBO: Primary data saved (54104 records). [2025-10-30T18:52:57.677803] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-30T18:52:57.677880] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FUBO took 37.0s. Estimated remaining: 3h 9m 18s. Rate: 7.8 symbols/min [2025-10-30T18:52:57.844369] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:52:57.879050] [DEBUG] [LOCAL ] FVRR: Loaded 40488 existing records from primary storage. [2025-10-30T18:52:57.880223] [INFO ] [MAIN ] FVRR: Loaded 40488 existing records. [2025-10-30T18:52:58.058003] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:52:58.058412] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-30T18:52:58.058486] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-30T18:52:58.064470] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-30T18:52:58.072393] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-30T18:52:58.072839] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-30T18:52:58.107775] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-30T18:52:58.429162] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:52:58.897503] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-30T18:52:59.096634] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T18:52:59.598520] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-30T18:52:59.697533] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-30T18:53:00.497519] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-30T18:53:01.133620] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T18:53:01.297576] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-30T18:53:02.097517] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-30T18:53:02.633523] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T18:53:02.732793] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-30T18:53:02.897473] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-30T18:53:03.157597] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T18:53:03.697527] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-30T18:53:04.264733] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T18:53:04.380581] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T18:53:04.497497] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-30T18:53:05.297466] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-30T18:53:05.396317] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T18:53:06.097496] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-30T18:53:06.346298] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-30T18:53:06.816274] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T18:53:06.897532] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-30T18:53:07.697488] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-30T18:53:07.776990] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T18:53:08.497491] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-30T18:53:08.792017] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T18:53:09.230122] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T18:53:09.297479] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-30T18:53:10.087526] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-30T18:53:10.091297] [INFO ] [REMOTE ] FVR: Full fetch complete (29106 records). [2025-10-30T18:53:10.091374] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-30T18:53:10.102633] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-30T18:53:10.463994] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-30T18:53:10.464075] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-30T18:53:10.464689] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-30T18:53:10.464752] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-30T18:53:10.465446] [DEBUG] [LOCAL ] FVR: Trimmed 29106 records to 20569 (keeping 200 days of data) [2025-10-30T18:53:10.595663] [DEBUG] [LOCAL ] FVR: Primary data saved (20569 records). [2025-10-30T18:53:10.595818] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-30T18:53:10.595907] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FVR took 17.2s. Estimated remaining: 3h 9m 20s. Rate: 7.8 symbols/min [2025-10-30T18:53:10.764156] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:53:10.766974] [DEBUG] [LOCAL ] FXED: Loaded 1213 existing records from primary storage. [2025-10-30T18:53:10.767106] [INFO ] [MAIN ] FXED: Loaded 1213 existing records. [2025-10-30T18:53:10.902585] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-30T18:53:10.940728] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:53:10.940909] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-30T18:53:10.940955] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-30T18:53:10.941133] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-30T18:53:10.941189] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-30T18:53:11.306685] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:53:11.533881] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T18:53:11.697561] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-30T18:53:11.803204] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T18:53:12.497506] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-30T18:53:12.897143] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T18:53:13.297504] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-30T18:53:13.718121] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:53:14.097508] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-30T18:53:14.430284] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-30T18:53:14.459222] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T18:53:14.897506] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-30T18:53:15.697557] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-30T18:53:16.056997] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T18:53:16.497507] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-30T18:53:16.694163] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T18:53:16.734077] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-30T18:53:17.297533] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-30T18:53:17.583977] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-30T18:53:18.097507] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-30T18:53:18.897501] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-30T18:53:19.294092] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T18:53:19.697546] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-30T18:53:19.984602] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-30T18:53:20.460128] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T18:53:20.497533] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-30T18:53:21.297527] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-30T18:53:21.906015] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T18:53:22.097531] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-30T18:53:22.317568] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-30T18:53:22.392868] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:53:22.897499] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-30T18:53:23.135148] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-30T18:53:23.697518] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-30T18:53:23.982610] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-30T18:53:24.497507] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-30T18:53:25.297531] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-30T18:53:25.572493] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-30T18:53:25.922488] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T18:53:26.097497] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-30T18:53:26.366634] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-30T18:53:26.897538] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-30T18:53:27.697530] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-30T18:53:27.969077] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T18:53:27.975881] [INFO ] [REMOTE ] FUL: Full fetch complete (47922 records). [2025-10-30T18:53:27.975967] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-30T18:53:28.345820] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-30T18:53:28.345895] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-30T18:53:28.346566] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-30T18:53:28.346627] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-30T18:53:28.347557] [DEBUG] [LOCAL ] FUL: Trimmed 47922 records to 31837 (keeping 200 days of data) [2025-10-30T18:53:28.502144] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-30T18:53:28.538636] [DEBUG] [LOCAL ] FUL: Primary data saved (31837 records). [2025-10-30T18:53:28.538757] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-30T18:53:28.538831] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FUL took 50.4s. Estimated remaining: 3h 9m 29s. Rate: 7.8 symbols/min [2025-10-30T18:53:28.704999] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:53:28.746018] [DEBUG] [LOCAL ] G: Loaded 50029 existing records from primary storage. [2025-10-30T18:53:28.746297] [INFO ] [MAIN ] G: Loaded 50029 existing records. [2025-10-30T18:53:28.925722] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:53:28.925923] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-30T18:53:28.925969] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-30T18:53:28.926846] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-30T18:53:28.926903] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-30T18:53:29.299218] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-30T18:53:29.299139] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:53:29.321836] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-30T18:53:29.334720] [INFO ] [REMOTE ] FUN: Full fetch complete (73793 records). [2025-10-30T18:53:29.334908] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-30T18:53:29.736933] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-30T18:53:29.737063] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-30T18:53:29.738240] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-30T18:53:29.738356] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-30T18:53:29.765143] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T18:53:29.773896] [DEBUG] [LOCAL ] FUN: Trimmed 73793 records to 52489 (keeping 200 days of data) [2025-10-30T18:53:29.834759] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-30T18:53:29.862864] [INFO ] [REMOTE ] FXED: Full fetch complete (1771 records). [2025-10-30T18:53:29.874005] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-30T18:53:30.100907] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-30T18:53:30.457901] [DEBUG] [LOCAL ] FUN: Primary data saved (52489 records). [2025-10-30T18:53:30.463789] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-30T18:53:30.463916] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FUN took 40.7s. Estimated remaining: 3h 9m 12s. Rate: 7.8 symbols/min [2025-10-30T18:53:30.476165] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-30T18:53:30.528676] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-30T18:53:30.540244] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-30T18:53:30.556304] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-30T18:53:30.567352] [DEBUG] [LOCAL ] FXED: Trimmed 1771 records to 1222 (keeping 200 days of data) [2025-10-30T18:53:30.627171] [DEBUG] [LOCAL ] FXED: Primary data saved (1222 records). [2025-10-30T18:53:30.628774] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-30T18:53:30.642557] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FXED took 20.0s. Estimated remaining: 3h 8m 52s. Rate: 7.8 symbols/min [2025-10-30T18:53:30.645396] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:53:30.832181] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:53:30.843469] [DEBUG] [LOCAL ] GAB: Loaded 26753 existing records from primary storage. [2025-10-30T18:53:30.844031] [INFO ] [MAIN ] GAB: Loaded 26753 existing records. [2025-10-30T18:53:30.846944] [DEBUG] [LOCAL ] GAM: Loaded 3691 existing records from primary storage. [2025-10-30T18:53:30.912935] [INFO ] [MAIN ] GAM: Loaded 3691 existing records. [2025-10-30T18:53:30.903338] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-30T18:53:31.155566] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:53:31.171191] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-30T18:53:31.183323] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-30T18:53:31.218076] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-30T18:53:31.222820] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:53:31.222898] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-30T18:53:31.255147] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-30T18:53:31.255248] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-30T18:53:31.288704] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-30T18:53:31.288793] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-30T18:53:31.909916] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:53:31.949545] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-30T18:53:31.949268] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:53:31.976050] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-30T18:53:31.985830] [INFO ] [REMOTE ] FVRR: Full fetch complete (59338 records). [2025-10-30T18:53:31.985955] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-30T18:53:32.382009] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-30T18:53:32.382106] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-30T18:53:32.391681] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-30T18:53:32.404307] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-30T18:53:32.408755] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T18:53:32.418732] [DEBUG] [LOCAL ] FVRR: Trimmed 59338 records to 40809 (keeping 200 days of data) [2025-10-30T18:53:32.499424] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-30T18:53:32.659022] [DEBUG] [LOCAL ] FVRR: Primary data saved (40809 records). [2025-10-30T18:53:32.659256] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-30T18:53:32.659354] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. FVRR took 35.0s. Estimated remaining: 3h 8m 35s. Rate: 7.8 symbols/min [2025-10-30T18:53:32.848871] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:53:32.849880] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T18:53:32.904949] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-30T18:53:32.905443] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-30T18:53:33.003551] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-30T18:53:33.091392] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:53:33.091629] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-30T18:53:33.091713] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-30T18:53:33.092749] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-30T18:53:33.092808] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-30T18:53:33.302607] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-30T18:53:33.464501] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:53:34.097541] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-30T18:53:34.567561] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T18:53:34.897497] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-30T18:53:35.572058] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T18:53:35.632095] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-30T18:53:35.697496] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-30T18:53:36.497496] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-30T18:53:36.957606] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T18:53:37.297493] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-30T18:53:37.740781] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T18:53:38.097542] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-30T18:53:38.875521] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T18:53:38.897470] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-30T18:53:39.371716] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T18:53:39.697534] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-30T18:53:40.103478] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T18:53:40.248252] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T18:53:40.497554] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-30T18:53:41.297488] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-30T18:53:41.760423] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-30T18:53:42.073043] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T18:53:42.097455] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-30T18:53:42.897548] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-30T18:53:43.673795] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-30T18:53:43.697457] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-30T18:53:43.789459] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T18:53:44.497553] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-30T18:53:45.202075] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T18:53:45.297490] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-30T18:53:45.330966] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-30T18:53:46.097533] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-30T18:53:46.515844] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T18:53:46.897498] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-30T18:53:46.920797] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-30T18:53:47.340540] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-30T18:53:47.697509] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-30T18:53:48.497467] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-30T18:53:48.560098] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T18:53:49.297509] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-30T18:53:49.767995] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T18:53:50.097493] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-30T18:53:50.632691] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T18:53:50.897516] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-30T18:53:51.356620] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T18:53:51.697506] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-30T18:53:52.497479] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-30T18:53:52.637029] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T18:53:52.648903] [INFO ] [REMOTE ] GAP: Full fetch complete (77815 records). [2025-10-30T18:53:52.649035] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-30T18:53:52.965399] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T18:53:53.064351] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-30T18:53:53.064517] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-30T18:53:53.065630] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-30T18:53:53.065822] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-30T18:53:53.077551] [DEBUG] [LOCAL ] GAP: Trimmed 77815 records to 54043 (keeping 200 days of data) [2025-10-30T18:53:53.097521] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T18:53:53.315130] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-30T18:53:53.436157] [DEBUG] [LOCAL ] GAP: Primary data saved (54043 records). [2025-10-30T18:53:53.436313] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-30T18:53:53.437178] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. GAP took 20.8s. Estimated remaining: 3h 8m 49s. Rate: 7.8 symbols/min [2025-10-30T18:53:53.623357] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:53:53.641404] [DEBUG] [LOCAL ] GATX: Loaded 17718 existing records from primary storage. [2025-10-30T18:53:53.641626] [INFO ] [MAIN ] GATX: Loaded 17718 existing records. [2025-10-30T18:53:53.816015] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:53:53.816252] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-30T18:53:53.816310] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-30T18:53:53.816806] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-30T18:53:53.816875] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-30T18:53:54.102769] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-30T18:53:54.173383] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:53:54.226382] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T18:53:54.504616] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T18:53:54.897495] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-30T18:53:55.333628] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-30T18:53:55.697506] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-30T18:53:56.497503] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-30T18:53:56.931971] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T18:53:56.954316] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T18:53:57.297491] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-30T18:53:57.990552] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T18:53:58.097460] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-30T18:53:58.784576] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-30T18:53:58.897569] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-30T18:53:59.254378] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T18:53:59.697523] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-30T18:54:00.123576] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-30T18:54:00.125159] [INFO ] [REMOTE ] GAM: Full fetch complete (6410 records). [2025-10-30T18:54:00.125293] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-30T18:54:00.479227] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-30T18:54:00.479293] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-30T18:54:00.479462] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-30T18:54:00.479500] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-30T18:54:00.479884] [DEBUG] [LOCAL ] GAM: Trimmed 6410 records to 3724 (keeping 200 days of data) [2025-10-30T18:54:00.500884] [DEBUG] [LOCAL ] GAM: Primary data saved (3724 records). [2025-10-30T18:54:00.500939] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-30T18:54:00.501939] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-30T18:54:00.502029] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. GAM took 29.9s. Estimated remaining: 3h 8m 40s. Rate: 7.8 symbols/min [2025-10-30T18:54:00.667864] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:00.681362] [DEBUG] [LOCAL ] GBAB: Loaded 12258 existing records from primary storage. [2025-10-30T18:54:00.681549] [INFO ] [MAIN ] GBAB: Loaded 12258 existing records. [2025-10-30T18:54:00.851882] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:00.852063] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-30T18:54:00.852109] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-30T18:54:00.852380] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-30T18:54:00.852436] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-30T18:54:01.191364] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:01.297453] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-30T18:54:01.708083] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T18:54:02.097465] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-30T18:54:02.193706] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T18:54:02.897497] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-30T18:54:03.386085] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T18:54:03.509990] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T18:54:03.697534] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-30T18:54:04.381627] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-30T18:54:04.497490] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-30T18:54:05.294846] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T18:54:05.301581] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-30T18:54:06.056875] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T18:54:06.097483] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-30T18:54:06.585774] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T18:54:06.897531] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-30T18:54:07.697555] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-30T18:54:08.054783] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T18:54:08.444096] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T18:54:08.497547] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-30T18:54:09.297472] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-30T18:54:09.408598] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T18:54:09.415128] [INFO ] [REMOTE ] GAB: Full fetch complete (39146 records). [2025-10-30T18:54:09.415229] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-30T18:54:09.799318] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-30T18:54:09.799421] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-30T18:54:09.800077] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-30T18:54:09.800187] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-30T18:54:09.808051] [DEBUG] [LOCAL ] GAB: Trimmed 39146 records to 26954 (keeping 200 days of data) [2025-10-30T18:54:09.808808] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T18:54:09.960323] [DEBUG] [LOCAL ] GAB: Primary data saved (26954 records). [2025-10-30T18:54:09.960450] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-30T18:54:09.960535] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GAB took 39.5s. Estimated remaining: 3h 8m 35s. Rate: 7.8 symbols/min [2025-10-30T18:54:10.104714] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-30T18:54:10.129532] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:10.167620] [DEBUG] [LOCAL ] GBCI: Loaded 41030 existing records from primary storage. [2025-10-30T18:54:10.167922] [INFO ] [MAIN ] GBCI: Loaded 41030 existing records. [2025-10-30T18:54:10.343387] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:10.343613] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-30T18:54:10.343689] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-30T18:54:10.344242] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-30T18:54:10.344298] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-30T18:54:10.698036] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:10.897536] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-30T18:54:11.707409] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-30T18:54:11.716944] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T18:54:11.732703] [INFO ] [REMOTE ] G: Full fetch complete (72370 records). [2025-10-30T18:54:11.732998] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-30T18:54:12.179301] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-30T18:54:12.179455] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-30T18:54:12.180780] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-30T18:54:12.180908] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-30T18:54:12.207179] [DEBUG] [LOCAL ] G: Trimmed 72370 records to 50412 (keeping 200 days of data) [2025-10-30T18:54:12.209767] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-30T18:54:12.510442] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-30T18:54:12.556910] [DEBUG] [LOCAL ] G: Primary data saved (50412 records). [2025-10-30T18:54:12.557318] [INFO ] [MAIN ] G: Full history saved. [2025-10-30T18:54:12.558443] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. G took 44.0s. Estimated remaining: 3h 8m 19s. Rate: 7.8 symbols/min [2025-10-30T18:54:12.681448] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T18:54:12.760787] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:12.761067] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-30T18:54:12.761109] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-30T18:54:12.761238] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-30T18:54:12.761280] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-30T18:54:12.761323] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-30T18:54:12.761358] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-30T18:54:13.142815] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:13.297537] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-30T18:54:13.658386] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T18:54:13.945301] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T18:54:14.097546] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-30T18:54:14.745955] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T18:54:14.897531] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-30T18:54:15.697506] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-30T18:54:15.755003] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T18:54:16.497528] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-30T18:54:16.851722] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T18:54:17.297532] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-30T18:54:17.360777] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-30T18:54:17.365045] [INFO ] [REMOTE ] GATX: Full fetch complete (25107 records). [2025-10-30T18:54:17.365158] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-30T18:54:17.751395] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-30T18:54:17.751500] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-30T18:54:17.752331] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-30T18:54:17.752397] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-30T18:54:17.753295] [DEBUG] [LOCAL ] GATX: Trimmed 25107 records to 17837 (keeping 200 days of data) [2025-10-30T18:54:17.872450] [DEBUG] [LOCAL ] GATX: Primary data saved (17837 records). [2025-10-30T18:54:17.872845] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-30T18:54:17.872968] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GATX took 24.4s. Estimated remaining: 3h 8m 8s. Rate: 7.8 symbols/min [2025-10-30T18:54:18.060350] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:18.100562] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-30T18:54:18.108317] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T18:54:18.130817] [DEBUG] [LOCAL ] GBTG: Loaded 39866 existing records from primary storage. [2025-10-30T18:54:18.131216] [INFO ] [MAIN ] GBTG: Loaded 39866 existing records. [2025-10-30T18:54:18.334816] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:18.335081] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-30T18:54:18.335134] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-30T18:54:18.335482] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-30T18:54:18.335526] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-30T18:54:18.687681] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:18.897506] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-30T18:54:19.270050] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T18:54:19.697528] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-30T18:54:19.897365] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T18:54:20.497556] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-30T18:54:20.604347] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T18:54:21.297482] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-30T18:54:21.355455] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T18:54:21.984973] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-30T18:54:22.097465] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-30T18:54:22.618931] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-30T18:54:22.897540] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-30T18:54:23.414566] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T18:54:23.697487] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-30T18:54:24.497453] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-30T18:54:24.542947] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T18:54:25.121838] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-30T18:54:25.124457] [INFO ] [REMOTE ] GBAB: Full fetch complete (18449 records). [2025-10-30T18:54:25.124528] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-30T18:54:25.303445] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-30T18:54:25.487187] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-30T18:54:25.487258] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-30T18:54:25.487662] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-30T18:54:25.487724] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-30T18:54:25.488219] [DEBUG] [LOCAL ] GBAB: Trimmed 18449 records to 12337 (keeping 200 days of data) [2025-10-30T18:54:25.560805] [DEBUG] [LOCAL ] GBAB: Primary data saved (12337 records). [2025-10-30T18:54:25.560908] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-30T18:54:25.560981] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GBAB took 25.1s. Estimated remaining: 3h 7m 60s. Rate: 7.8 symbols/min [2025-10-30T18:54:25.730301] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:25.756425] [DEBUG] [LOCAL ] GBX: Loaded 27535 existing records from primary storage. [2025-10-30T18:54:25.756686] [INFO ] [MAIN ] GBX: Loaded 27535 existing records. [2025-10-30T18:54:25.931134] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:25.931341] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-30T18:54:25.931387] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-30T18:54:25.931870] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-30T18:54:25.931936] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-30T18:54:26.102816] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-30T18:54:26.290905] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:26.461961] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T18:54:26.538296] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-30T18:54:26.897487] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-30T18:54:27.697464] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-30T18:54:27.880807] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.18 seconds). [2025-10-30T18:54:27.905786] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-30T18:54:28.497492] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-30T18:54:29.297490] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-30T18:54:29.688106] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T18:54:30.097459] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-30T18:54:30.318516] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T18:54:30.897473] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-30T18:54:30.980106] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T18:54:31.697486] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-30T18:54:31.937743] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-30T18:54:31.976464] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T18:54:32.497498] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-30T18:54:33.297460] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-30T18:54:33.516276] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T18:54:33.617466] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-30T18:54:34.097488] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-30T18:54:34.897485] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-30T18:54:35.063534] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T18:54:35.697456] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-30T18:54:35.908050] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T18:54:36.497524] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-30T18:54:36.573042] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-30T18:54:37.297541] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-30T18:54:37.594474] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:54:38.097495] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-30T18:54:38.445251] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T18:54:38.897540] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-30T18:54:39.156576] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-30T18:54:39.269733] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T18:54:39.697515] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-30T18:54:40.497551] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-30T18:54:41.075389] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T18:54:41.085970] [INFO ] [REMOTE ] GBCI: Full fetch complete (59486 records). [2025-10-30T18:54:41.086110] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-30T18:54:41.305234] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-30T18:54:41.505590] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-30T18:54:41.505925] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-30T18:54:41.507195] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-30T18:54:41.507906] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T18:54:41.508101] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-30T18:54:41.515005] [DEBUG] [LOCAL ] GBCI: Trimmed 59486 records to 41369 (keeping 200 days of data) [2025-10-30T18:54:41.569918] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-30T18:54:41.772411] [DEBUG] [LOCAL ] GBCI: Primary data saved (41369 records). [2025-10-30T18:54:41.772547] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-30T18:54:41.772686] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GBCI took 31.8s. Estimated remaining: 3h 8m 6s. Rate: 7.8 symbols/min [2025-10-30T18:54:41.962056] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:41.999726] [DEBUG] [LOCAL ] GCI: Loaded 43520 existing records from primary storage. [2025-10-30T18:54:42.000016] [INFO ] [MAIN ] GCI: Loaded 43520 existing records. [2025-10-30T18:54:42.099370] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-30T18:54:42.176438] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:42.176627] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-30T18:54:42.176705] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-30T18:54:42.177394] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-30T18:54:42.177452] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-30T18:54:42.535632] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:42.897514] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-30T18:54:43.094441] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-10-30T18:54:43.158160] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T18:54:43.697533] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-30T18:54:44.497518] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-30T18:54:44.793860] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T18:54:44.875844] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T18:54:45.297591] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-30T18:54:46.097525] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-30T18:54:46.256772] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T18:54:46.328234] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-30T18:54:46.897543] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-30T18:54:47.631178] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T18:54:47.697476] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-30T18:54:48.497541] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-30T18:54:48.742175] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T18:54:49.297561] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-30T18:54:49.594305] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T18:54:49.603093] [INFO ] [REMOTE ] GBTG: Full fetch complete (56917 records). [2025-10-30T18:54:49.603240] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-30T18:54:49.722304] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-30T18:54:49.729490] [INFO ] [REMOTE ] GBLI: Full fetch complete (1254 records). [2025-10-30T18:54:49.745241] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-30T18:54:50.097814] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-30T18:54:50.158696] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-30T18:54:50.170756] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-30T18:54:50.212921] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-30T18:54:50.232434] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-30T18:54:50.238266] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-30T18:54:50.254586] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-30T18:54:50.257629] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-30T18:54:50.257801] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-30T18:54:50.257877] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-30T18:54:50.258843] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-30T18:54:50.259007] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBLI took 37.7s. Estimated remaining: 3h 7m 60s. Rate: 7.8 symbols/min [2025-10-30T18:54:50.259109] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-30T18:54:50.355911] [DEBUG] [LOCAL ] GBTG: Trimmed 56917 records to 40152 (keeping 200 days of data) [2025-10-30T18:54:50.600946] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:50.719311] [DEBUG] [LOCAL ] GBTG: Primary data saved (40152 records). [2025-10-30T18:54:50.719535] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-30T18:54:50.719622] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBTG took 32.8s. Estimated remaining: 3h 7m 41s. Rate: 7.8 symbols/min [2025-10-30T18:54:50.861291] [DEBUG] [LOCAL ] GCO: Loaded 21760 existing records from primary storage. [2025-10-30T18:54:50.861585] [INFO ] [MAIN ] GCO: Loaded 21760 existing records. [2025-10-30T18:54:50.901938] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-30T18:54:51.023485] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:51.135892] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:51.143422] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-30T18:54:51.143525] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-30T18:54:51.143345] [DEBUG] [LOCAL ] GCTS: Loaded 20176 existing records from primary storage. [2025-10-30T18:54:51.143859] [INFO ] [MAIN ] GCTS: Loaded 20176 existing records. [2025-10-30T18:54:51.177713] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-30T18:54:51.214354] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-30T18:54:51.483536] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:51.500399] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-30T18:54:51.506276] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-30T18:54:51.537723] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-30T18:54:51.594437] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-30T18:54:51.884340] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-30T18:54:51.905037] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-30T18:54:52.077619] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:52.185810] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T18:54:52.266424] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:52.497469] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-30T18:54:53.097675] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T18:54:53.121814] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-30T18:54:53.297489] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-30T18:54:54.097517] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-30T18:54:54.371070] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T18:54:54.880933] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T18:54:54.897457] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-30T18:54:55.700287] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-30T18:54:55.702415] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T18:54:56.473343] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-30T18:54:56.497488] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-30T18:54:57.297505] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-30T18:54:57.388794] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T18:54:58.097462] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-30T18:54:58.204849] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T18:54:58.210908] [INFO ] [REMOTE ] GBX: Full fetch complete (42619 records). [2025-10-30T18:54:58.211000] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-30T18:54:58.579320] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-30T18:54:58.579399] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-30T18:54:58.580079] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-30T18:54:58.580148] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-30T18:54:58.581008] [DEBUG] [LOCAL ] GBX: Trimmed 42619 records to 27847 (keeping 200 days of data) [2025-10-30T18:54:58.743345] [DEBUG] [LOCAL ] GBX: Primary data saved (27847 records). [2025-10-30T18:54:58.743485] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-30T18:54:58.743599] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GBX took 33.2s. Estimated remaining: 3h 7m 33s. Rate: 7.8 symbols/min [2025-10-30T18:54:58.909959] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:54:58.899827] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-30T18:54:58.919250] [DEBUG] [LOCAL ] GCV: Loaded 8000 existing records from primary storage. [2025-10-30T18:54:58.919436] [INFO ] [MAIN ] GCV: Loaded 8000 existing records. [2025-10-30T18:54:59.097851] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:54:59.098124] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-30T18:54:59.098206] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-30T18:54:59.098517] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-30T18:54:59.098576] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-30T18:54:59.436681] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T18:54:59.499702] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:54:59.697501] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-30T18:54:59.827939] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T18:55:00.497551] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-30T18:55:00.600288] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T18:55:01.297513] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-30T18:55:01.775685] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T18:55:02.097491] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-30T18:55:02.495941] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T18:55:02.816667] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T18:55:02.897511] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-30T18:55:03.697476] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-30T18:55:03.844940] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T18:55:04.026256] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-30T18:55:04.497495] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-30T18:55:04.964493] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-30T18:55:05.297506] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-30T18:55:05.829621] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T18:55:06.097527] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-30T18:55:06.789819] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T18:55:06.897496] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-30T18:55:07.629117] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T18:55:07.697591] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-30T18:55:08.497587] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-30T18:55:08.613950] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-30T18:55:09.297525] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-30T18:55:09.534058] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T18:55:09.803501] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T18:55:10.097502] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-30T18:55:10.897535] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-30T18:55:11.338529] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-30T18:55:11.384998] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T18:55:11.697500] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-30T18:55:12.497491] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-30T18:55:12.857141] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T18:55:13.297499] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-30T18:55:13.691035] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T18:55:13.691820] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-30T18:55:14.097501] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-30T18:55:14.897470] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-30T18:55:15.003722] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T18:55:15.362706] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-30T18:55:15.697493] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-30T18:55:16.497559] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-30T18:55:16.685034] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T18:55:17.245552] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T18:55:17.297494] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-30T18:55:18.100841] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-30T18:55:18.103054] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T18:55:18.897477] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-30T18:55:19.318200] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T18:55:19.697568] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-30T18:55:19.948629] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T18:55:19.953234] [INFO ] [REMOTE ] GCTS: Full fetch complete (26688 records). [2025-10-30T18:55:19.953334] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-30T18:55:20.309080] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T18:55:20.339412] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-30T18:55:20.339493] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-30T18:55:20.340094] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-30T18:55:20.340156] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-30T18:55:20.340957] [DEBUG] [LOCAL ] GCTS: Trimmed 26688 records to 20289 (keeping 200 days of data) [2025-10-30T18:55:20.449591] [DEBUG] [LOCAL ] GCTS: Primary data saved (20289 records). [2025-10-30T18:55:20.449742] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-30T18:55:20.449823] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GCTS took 29.7s. Estimated remaining: 3h 7m 49s. Rate: 7.8 symbols/min [2025-10-30T18:55:20.504755] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-30T18:55:20.628389] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:55:20.670079] [DEBUG] [LOCAL ] GD: Loaded 46319 existing records from primary storage. [2025-10-30T18:55:20.670373] [INFO ] [MAIN ] GD: Loaded 46319 existing records. [2025-10-30T18:55:20.848606] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:55:20.848848] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-30T18:55:20.848896] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-30T18:55:20.849920] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-30T18:55:20.849979] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-30T18:55:21.203669] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:55:21.297480] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-30T18:55:21.320561] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T18:55:21.323534] [INFO ] [REMOTE ] GCV: Full fetch complete (10335 records). [2025-10-30T18:55:21.323676] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-30T18:55:21.676077] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-30T18:55:21.676152] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-30T18:55:21.676392] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-30T18:55:21.676456] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-30T18:55:21.676909] [DEBUG] [LOCAL ] GCV: Trimmed 10335 records to 8048 (keeping 200 days of data) [2025-10-30T18:55:21.722130] [DEBUG] [LOCAL ] GCV: Primary data saved (8048 records). [2025-10-30T18:55:21.722248] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-30T18:55:21.722325] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GCV took 23.0s. Estimated remaining: 3h 7m 30s. Rate: 7.8 symbols/min [2025-10-30T18:55:21.891960] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:55:21.938032] [DEBUG] [LOCAL ] GDDY: Loaded 49363 existing records from primary storage. [2025-10-30T18:55:21.938317] [INFO ] [MAIN ] GDDY: Loaded 49363 existing records. [2025-10-30T18:55:22.108125] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-30T18:55:22.113557] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:55:22.113908] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-30T18:55:22.113956] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-30T18:55:22.114627] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-30T18:55:22.114705] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-30T18:55:22.466727] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:55:22.644302] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T18:55:22.655601] [INFO ] [REMOTE ] GCI: Full fetch complete (63379 records). [2025-10-30T18:55:22.655856] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-30T18:55:22.902699] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-30T18:55:23.058192] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-30T18:55:23.058267] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-30T18:55:23.059060] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-30T18:55:23.059120] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-30T18:55:23.060423] [DEBUG] [LOCAL ] GCI: Trimmed 63379 records to 43891 (keeping 200 days of data) [2025-10-30T18:55:23.293350] [DEBUG] [LOCAL ] GCI: Primary data saved (43891 records). [2025-10-30T18:55:23.293471] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-30T18:55:23.293549] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCI took 41.5s. Estimated remaining: 3h 7m 13s. Rate: 7.8 symbols/min [2025-10-30T18:55:23.464352] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:55:23.469517] [DEBUG] [LOCAL ] GDIV: Loaded 3395 existing records from primary storage. [2025-10-30T18:55:23.469752] [INFO ] [MAIN ] GDIV: Loaded 3395 existing records. [2025-10-30T18:55:23.652249] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:55:23.652972] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-30T18:55:23.653082] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-30T18:55:23.669273] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-30T18:55:23.676905] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-30T18:55:23.699368] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-30T18:55:23.736022] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-30T18:55:23.854099] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-30T18:55:23.908505] [INFO ] [REMOTE ] GCO: Full fetch complete (34239 records). [2025-10-30T18:55:23.981218] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-30T18:55:24.210635] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:55:24.489071] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-30T18:55:24.489151] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-30T18:55:24.489747] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-30T18:55:24.489807] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-30T18:55:24.490638] [DEBUG] [LOCAL ] GCO: Trimmed 34239 records to 21824 (keeping 200 days of data) [2025-10-30T18:55:24.538603] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-30T18:55:24.618109] [DEBUG] [LOCAL ] GCO: Primary data saved (21824 records). [2025-10-30T18:55:24.618234] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-30T18:55:24.618323] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GCO took 34.4s. Estimated remaining: 3h 6m 55s. Rate: 7.8 symbols/min [2025-10-30T18:55:24.792292] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:55:24.796352] [DEBUG] [LOCAL ] GDL: Loaded 2518 existing records from primary storage. [2025-10-30T18:55:24.796544] [INFO ] [MAIN ] GDL: Loaded 2518 existing records. [2025-10-30T18:55:24.984510] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:55:24.984783] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-30T18:55:24.984862] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-30T18:55:24.985079] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-30T18:55:24.985148] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-30T18:55:25.298703] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-30T18:55:25.355156] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-30T18:55:25.384904] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:55:25.815886] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T18:55:25.830043] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T18:55:26.097481] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-30T18:55:26.434991] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-30T18:55:26.897510] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-30T18:55:27.697501] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-30T18:55:27.990574] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T18:55:28.190400] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-30T18:55:28.497503] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-30T18:55:28.846105] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-30T18:55:29.297496] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-30T18:55:30.097494] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-30T18:55:30.478103] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-30T18:55:30.685961] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T18:55:30.897467] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-30T18:55:31.697488] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-30T18:55:32.119968] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-30T18:55:32.242088] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T18:55:32.497504] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-30T18:55:32.866226] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-30T18:55:33.297501] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-30T18:55:33.673869] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-30T18:55:34.097480] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-30T18:55:34.608628] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T18:55:34.897547] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-30T18:55:35.160687] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-30T18:55:35.697503] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-30T18:55:36.046563] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-30T18:55:36.497523] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-30T18:55:36.786804] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-30T18:55:37.297528] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-30T18:55:38.097513] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-30T18:55:38.678636] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T18:55:38.897516] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-30T18:55:39.150749] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-30T18:55:39.582433] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T18:55:39.697493] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-30T18:55:40.497513] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-30T18:55:40.739265] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T18:55:41.297491] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-30T18:55:41.678555] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T18:55:42.097498] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-30T18:55:42.404502] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-30T18:55:42.514307] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T18:55:42.897509] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-30T18:55:43.227802] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-30T18:55:43.697497] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-30T18:55:44.497516] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-30T18:55:44.948889] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T18:55:45.297495] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-30T18:55:45.871760] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:55:46.097478] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-30T18:55:46.465602] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-30T18:55:46.666692] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T18:55:46.897519] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-30T18:55:47.697558] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-30T18:55:48.037735] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T18:55:48.236216] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T18:55:48.497497] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-30T18:55:49.297514] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-30T18:55:49.674445] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T18:55:50.097497] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-30T18:55:50.372205] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T18:55:50.605532] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-30T18:55:50.606806] [INFO ] [REMOTE ] GDIV: Full fetch complete (5384 records). [2025-10-30T18:55:50.606874] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-30T18:55:50.902632] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-30T18:55:50.975164] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-30T18:55:50.975236] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-30T18:55:50.975445] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-30T18:55:50.975500] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-30T18:55:50.975902] [DEBUG] [LOCAL ] GDIV: Trimmed 5384 records to 3418 (keeping 200 days of data) [2025-10-30T18:55:50.996159] [DEBUG] [LOCAL ] GDIV: Primary data saved (3418 records). [2025-10-30T18:55:50.996276] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-30T18:55:50.996383] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GDIV took 27.7s. Estimated remaining: 3h 7m 18s. Rate: 7.8 symbols/min [2025-10-30T18:55:51.163258] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:55:51.170610] [DEBUG] [LOCAL ] GDO: Loaded 5713 existing records from primary storage. [2025-10-30T18:55:51.170832] [INFO ] [MAIN ] GDO: Loaded 5713 existing records. [2025-10-30T18:55:51.346727] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:55:51.347022] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-30T18:55:51.347076] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-30T18:55:51.347414] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-30T18:55:51.347471] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-30T18:55:51.709633] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-30T18:55:51.714488] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:55:52.065729] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T18:55:52.498678] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-30T18:55:52.501888] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T18:55:52.513482] [INFO ] [REMOTE ] GDDY: Full fetch complete (72051 records). [2025-10-30T18:55:52.513622] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-30T18:55:52.903277] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-30T18:55:52.903354] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-30T18:55:52.904226] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-30T18:55:52.904288] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-30T18:55:52.905626] [DEBUG] [LOCAL ] GDDY: Trimmed 72051 records to 49749 (keeping 200 days of data) [2025-10-30T18:55:53.198561] [DEBUG] [LOCAL ] GDDY: Primary data saved (49749 records). [2025-10-30T18:55:53.198739] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-30T18:55:53.199463] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GDDY took 31.5s. Estimated remaining: 3h 7m 1s. Rate: 7.8 symbols/min [2025-10-30T18:55:53.299238] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-30T18:55:53.314747] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T18:55:53.381437] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:55:53.415670] [DEBUG] [LOCAL ] GDOT: Loaded 37273 existing records from primary storage. [2025-10-30T18:55:53.415943] [INFO ] [MAIN ] GDOT: Loaded 37273 existing records. [2025-10-30T18:55:53.596305] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:55:53.596568] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-30T18:55:53.596617] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-30T18:55:53.597348] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-30T18:55:53.597407] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-30T18:55:53.881929] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-30T18:55:53.885787] [INFO ] [REMOTE ] GDL: Full fetch complete (3453 records). [2025-10-30T18:55:53.886120] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-30T18:55:54.077492] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:55:54.105963] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-30T18:55:54.330627] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-30T18:55:54.330736] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-30T18:55:54.330891] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-30T18:55:54.330930] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-30T18:55:54.331261] [DEBUG] [LOCAL ] GDL: Trimmed 3453 records to 2535 (keeping 200 days of data) [2025-10-30T18:55:54.346686] [DEBUG] [LOCAL ] GDL: Primary data saved (2535 records). [2025-10-30T18:55:54.346753] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-30T18:55:54.346820] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GDL took 29.7s. Estimated remaining: 3h 6m 43s. Rate: 7.8 symbols/min [2025-10-30T18:55:54.531994] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:55:54.551055] [DEBUG] [LOCAL ] GDV: Loaded 18697 existing records from primary storage. [2025-10-30T18:55:54.551281] [INFO ] [MAIN ] GDV: Loaded 18697 existing records. [2025-10-30T18:55:54.729063] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:55:54.729321] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-30T18:55:54.729368] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-30T18:55:54.729617] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-30T18:55:54.729691] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-30T18:55:54.909606] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-30T18:55:55.148540] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:55:55.166449] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T18:55:55.697570] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-30T18:55:56.142610] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T18:55:56.497513] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-30T18:55:56.695728] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T18:55:56.899732] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-30T18:55:57.297491] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-30T18:55:57.974031] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-30T18:55:58.097501] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-30T18:55:58.897538] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-30T18:55:59.697464] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-30T18:55:59.779128] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T18:55:59.811381] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-30T18:55:59.821415] [INFO ] [REMOTE ] GD: Full fetch complete (69559 records). [2025-10-30T18:55:59.821592] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-30T18:56:00.128261] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T18:56:00.227455] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-30T18:56:00.227575] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-30T18:56:00.228410] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-30T18:56:00.228472] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-30T18:56:00.229979] [DEBUG] [LOCAL ] GD: Trimmed 69559 records to 46662 (keeping 200 days of data) [2025-10-30T18:56:00.503756] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-30T18:56:00.516127] [DEBUG] [LOCAL ] GD: Primary data saved (46662 records). [2025-10-30T18:56:00.516211] [INFO ] [MAIN ] GD: Full history saved. [2025-10-30T18:56:00.517141] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GD took 40.1s. Estimated remaining: 3h 6m 33s. Rate: 7.8 symbols/min [2025-10-30T18:56:00.691017] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:56:00.739303] [DEBUG] [LOCAL ] GE: Loaded 53688 existing records from primary storage. [2025-10-30T18:56:00.739590] [INFO ] [MAIN ] GE: Loaded 53688 existing records. [2025-10-30T18:56:00.920824] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:56:00.921081] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-30T18:56:00.921140] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-30T18:56:00.922267] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-30T18:56:00.922330] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-30T18:56:01.288969] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:56:01.297453] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-30T18:56:02.097497] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-30T18:56:02.193091] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-30T18:56:02.608854] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-30T18:56:02.836149] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-30T18:56:02.897497] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-30T18:56:03.697512] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-30T18:56:03.950239] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-30T18:56:04.497497] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-30T18:56:05.308697] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-30T18:56:05.313951] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-30T18:56:05.522182] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T18:56:05.704864] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-30T18:56:06.097487] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-30T18:56:06.897516] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-30T18:56:07.276298] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T18:56:07.697500] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-30T18:56:07.966341] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T18:56:08.169368] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-30T18:56:08.497498] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-30T18:56:08.948748] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-30T18:56:09.297512] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-30T18:56:10.094719] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T18:56:10.100045] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-30T18:56:10.897508] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-30T18:56:11.697481] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-30T18:56:11.728240] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-30T18:56:12.118103] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T18:56:12.497472] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-30T18:56:12.553018] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-30T18:56:13.297515] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-30T18:56:13.749608] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-30T18:56:14.097483] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-30T18:56:14.256383] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-30T18:56:14.897493] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-30T18:56:15.197729] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T18:56:15.697536] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-30T18:56:16.095070] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T18:56:16.497510] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-30T18:56:16.747855] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-30T18:56:17.297504] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-30T18:56:17.423860] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T18:56:17.899787] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-30T18:56:17.901561] [INFO ] [REMOTE ] GDO: Full fetch complete (8363 records). [2025-10-30T18:56:17.901634] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-30T18:56:18.106056] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-30T18:56:18.256951] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-30T18:56:18.257028] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-30T18:56:18.257242] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-30T18:56:18.257281] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-30T18:56:18.257692] [DEBUG] [LOCAL ] GDO: Trimmed 8363 records to 5787 (keeping 200 days of data) [2025-10-30T18:56:18.292515] [DEBUG] [LOCAL ] GDO: Primary data saved (5787 records). [2025-10-30T18:56:18.292637] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-30T18:56:18.292756] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDO took 27.3s. Estimated remaining: 3h 6m 41s. Rate: 7.8 symbols/min [2025-10-30T18:56:18.456321] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:56:18.477023] [DEBUG] [LOCAL ] GEF: Loaded 20555 existing records from primary storage. [2025-10-30T18:56:18.477255] [INFO ] [MAIN ] GEF: Loaded 20555 existing records. [2025-10-30T18:56:18.652699] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:56:18.652920] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-30T18:56:18.652967] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-30T18:56:18.653255] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-30T18:56:18.653311] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-30T18:56:18.902609] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-30T18:56:19.004558] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:56:19.697513] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-30T18:56:19.977694] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-30T18:56:20.263147] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T18:56:20.271350] [INFO ] [REMOTE ] GDOT: Full fetch complete (53642 records). [2025-10-30T18:56:20.271499] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-30T18:56:20.500412] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-30T18:56:20.588466] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-30T18:56:20.682907] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-30T18:56:20.682982] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-30T18:56:20.683693] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-30T18:56:20.683753] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-30T18:56:20.684769] [DEBUG] [LOCAL ] GDOT: Trimmed 53642 records to 37482 (keeping 200 days of data) [2025-10-30T18:56:20.893661] [DEBUG] [LOCAL ] GDOT: Primary data saved (37482 records). [2025-10-30T18:56:20.893827] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-30T18:56:20.893909] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GDOT took 27.7s. Estimated remaining: 3h 6m 25s. Rate: 7.8 symbols/min [2025-10-30T18:56:21.061906] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:56:21.090191] [DEBUG] [LOCAL ] GEL: Loaded 30604 existing records from primary storage. [2025-10-30T18:56:21.090443] [INFO ] [MAIN ] GEL: Loaded 30604 existing records. [2025-10-30T18:56:21.263638] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:56:21.263886] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-30T18:56:21.263933] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-30T18:56:21.264633] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-30T18:56:21.264727] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-30T18:56:21.306797] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-30T18:56:21.613480] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:56:22.052846] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T18:56:22.097499] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-30T18:56:22.435352] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-30T18:56:22.803040] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-30T18:56:22.897555] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-30T18:56:23.697515] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-30T18:56:23.870119] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T18:56:24.497465] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-30T18:56:24.534387] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-30T18:56:25.297469] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-30T18:56:25.618145] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T18:56:25.950715] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T18:56:26.097544] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-30T18:56:26.897542] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-30T18:56:27.697493] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-30T18:56:27.733688] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T18:56:27.898693] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-30T18:56:28.226348] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T18:56:28.497507] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-30T18:56:29.297485] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-30T18:56:29.422239] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-30T18:56:29.426221] [INFO ] [REMOTE ] GDV: Full fetch complete (28088 records). [2025-10-30T18:56:29.426295] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-30T18:56:29.792023] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-30T18:56:29.792137] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-30T18:56:29.792681] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-30T18:56:29.792741] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-30T18:56:29.793360] [DEBUG] [LOCAL ] GDV: Trimmed 28088 records to 18819 (keeping 200 days of data) [2025-10-30T18:56:29.904736] [DEBUG] [LOCAL ] GDV: Primary data saved (18819 records). [2025-10-30T18:56:29.904864] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-30T18:56:29.904940] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GDV took 35.6s. Estimated remaining: 3h 6m 20s. Rate: 7.8 symbols/min [2025-10-30T18:56:30.072567] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:56:30.098755] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-30T18:56:30.121491] [DEBUG] [LOCAL ] GENI: Loaded 52857 existing records from primary storage. [2025-10-30T18:56:30.121814] [INFO ] [MAIN ] GENI: Loaded 52857 existing records. [2025-10-30T18:56:30.296107] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:56:30.296375] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-30T18:56:30.296437] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-30T18:56:30.297574] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-30T18:56:30.297632] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-30T18:56:30.647430] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:56:30.897459] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-30T18:56:31.144367] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-30T18:56:31.236759] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T18:56:31.697482] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-30T18:56:31.726606] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-30T18:56:32.497491] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-30T18:56:33.123057] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-30T18:56:33.297492] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-30T18:56:33.809944] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-30T18:56:33.822220] [INFO ] [REMOTE ] GE: Full fetch complete (77855 records). [2025-10-30T18:56:33.822374] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-30T18:56:34.102633] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-30T18:56:34.266800] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-30T18:56:34.266973] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-30T18:56:34.268018] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-30T18:56:34.268083] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-30T18:56:34.269541] [DEBUG] [LOCAL ] GE: Trimmed 77855 records to 54076 (keeping 200 days of data) [2025-10-30T18:56:34.543553] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T18:56:34.667512] [DEBUG] [LOCAL ] GE: Primary data saved (54076 records). [2025-10-30T18:56:34.667667] [INFO ] [MAIN ] GE: Full history saved. [2025-10-30T18:56:34.668425] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GE took 34.2s. Estimated remaining: 3h 6m 8s. Rate: 7.8 symbols/min [2025-10-30T18:56:34.856514] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:56:34.905197] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-30T18:56:34.908537] [DEBUG] [LOCAL ] GEO: Loaded 51526 existing records from primary storage. [2025-10-30T18:56:34.909023] [INFO ] [MAIN ] GEO: Loaded 51526 existing records. [2025-10-30T18:56:35.099797] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:56:35.100216] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-30T18:56:35.100297] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-30T18:56:35.111018] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-30T18:56:35.111125] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-30T18:56:35.197555] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T18:56:35.499231] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:56:35.697486] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-30T18:56:35.766931] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T18:56:36.429606] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T18:56:36.497512] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-30T18:56:37.297509] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-30T18:56:37.691418] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T18:56:38.097489] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-30T18:56:38.338595] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T18:56:38.897553] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-30T18:56:39.559126] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T18:56:39.697457] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-30T18:56:40.481362] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-30T18:56:40.497450] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-30T18:56:41.078602] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T18:56:41.297492] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-30T18:56:41.928676] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T18:56:42.097512] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-30T18:56:42.322770] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T18:56:42.897529] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-30T18:56:43.499404] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T18:56:43.697461] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-30T18:56:44.451183] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-30T18:56:44.497509] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-30T18:56:45.088079] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T18:56:45.297494] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-30T18:56:45.325542] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T18:56:46.097503] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-30T18:56:46.673179] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T18:56:46.897487] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-30T18:56:46.933569] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:56:46.938514] [INFO ] [REMOTE ] GEF: Full fetch complete (29379 records). [2025-10-30T18:56:46.938598] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-30T18:56:47.364189] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-30T18:56:47.364370] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-30T18:56:47.365081] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-30T18:56:47.365164] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-30T18:56:47.366132] [DEBUG] [LOCAL ] GEF: Trimmed 29379 records to 20694 (keeping 200 days of data) [2025-10-30T18:56:47.518089] [DEBUG] [LOCAL ] GEF: Primary data saved (20694 records). [2025-10-30T18:56:47.518242] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-30T18:56:47.518332] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GEF took 29.2s. Estimated remaining: 3h 6m 8s. Rate: 7.8 symbols/min [2025-10-30T18:56:47.710575] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-30T18:56:47.755690] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:56:47.801998] [DEBUG] [LOCAL ] GES: Loaded 37291 existing records from primary storage. [2025-10-30T18:56:47.802328] [INFO ] [MAIN ] GES: Loaded 37291 existing records. [2025-10-30T18:56:48.071407] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:56:48.071828] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-30T18:56:48.072020] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-30T18:56:48.073190] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-30T18:56:48.073270] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-30T18:56:48.355901] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-30T18:56:48.502814] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-30T18:56:48.577977] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:56:48.936429] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T18:56:49.297555] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-30T18:56:49.981109] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-30T18:56:50.097467] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-30T18:56:50.145051] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T18:56:50.897510] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-30T18:56:51.394097] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T18:56:51.697470] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-30T18:56:51.898120] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T18:56:52.497472] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-30T18:56:52.814004] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T18:56:53.297466] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-30T18:56:54.019430] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-30T18:56:54.097483] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-30T18:56:54.781130] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T18:56:54.897458] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-30T18:56:55.613920] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T18:56:55.697450] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-30T18:56:56.428103] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-30T18:56:56.439674] [INFO ] [REMOTE ] GENI: Full fetch complete (76087 records). [2025-10-30T18:56:56.439809] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-30T18:56:56.506477] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-30T18:56:56.843304] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-30T18:56:56.843383] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-30T18:56:56.844263] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-30T18:56:56.844327] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-30T18:56:56.845741] [DEBUG] [LOCAL ] GENI: Trimmed 76087 records to 53245 (keeping 200 days of data) [2025-10-30T18:56:57.151942] [DEBUG] [LOCAL ] GENI: Primary data saved (53245 records). [2025-10-30T18:56:57.152074] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-30T18:56:57.152978] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GENI took 27.2s. Estimated remaining: 3h 6m 4s. Rate: 7.8 symbols/min [2025-10-30T18:56:57.300129] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-30T18:56:57.334256] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:56:57.364133] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-30T18:56:57.403945] [DEBUG] [LOCAL ] GETY: Loaded 34916 existing records from primary storage. [2025-10-30T18:56:57.404202] [INFO ] [MAIN ] GETY: Loaded 34916 existing records. [2025-10-30T18:56:57.584753] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:56:57.584995] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-30T18:56:57.585095] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-30T18:56:57.585814] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-30T18:56:57.585880] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-30T18:56:57.850048] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T18:56:57.975779] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:56:58.097451] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-30T18:56:58.189753] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-30T18:56:58.897506] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-30T18:56:59.513974] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T18:56:59.697469] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-30T18:57:00.116701] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T18:57:00.497507] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-30T18:57:01.059455] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T18:57:01.297521] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-30T18:57:01.886163] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T18:57:01.891538] [INFO ] [REMOTE ] GEL: Full fetch complete (47798 records). [2025-10-30T18:57:01.891634] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-30T18:57:02.106578] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-30T18:57:02.278775] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-30T18:57:02.278848] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-30T18:57:02.279493] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-30T18:57:02.279531] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-30T18:57:02.280418] [DEBUG] [LOCAL ] GEL: Trimmed 47798 records to 30810 (keeping 200 days of data) [2025-10-30T18:57:02.454943] [DEBUG] [LOCAL ] GEL: Primary data saved (30810 records). [2025-10-30T18:57:02.455062] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-30T18:57:02.455840] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GEL took 41.6s. Estimated remaining: 3h 5m 52s. Rate: 7.8 symbols/min [2025-10-30T18:57:02.642450] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:57:02.691223] [DEBUG] [LOCAL ] GEV: Loaded 52978 existing records from primary storage. [2025-10-30T18:57:02.691772] [INFO ] [MAIN ] GEV: Loaded 52978 existing records. [2025-10-30T18:57:02.909093] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-30T18:57:02.912738] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:57:02.916172] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-30T18:57:02.916031] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-30T18:57:02.926699] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-30T18:57:02.928324] [INFO ] [REMOTE ] GEO: Full fetch complete (75360 records). [2025-10-30T18:57:02.928407] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-30T18:57:02.934519] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-30T18:57:02.962443] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-30T18:57:03.648061] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-30T18:57:03.658459] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-30T18:57:03.703593] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-30T18:57:03.718738] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-30T18:57:03.724323] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:57:03.724860] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-30T18:57:03.727440] [DEBUG] [LOCAL ] GEO: Trimmed 75360 records to 51899 (keeping 200 days of data) [2025-10-30T18:57:03.841831] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-30T18:57:04.069165] [DEBUG] [LOCAL ] GEO: Primary data saved (51899 records). [2025-10-30T18:57:04.069302] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-30T18:57:04.070324] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GEO took 29.4s. Estimated remaining: 3h 5m 35s. Rate: 7.8 symbols/min [2025-10-30T18:57:04.238676] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:57:04.264019] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T18:57:04.265971] [DEBUG] [LOCAL ] GF: Loaded 2514 existing records from primary storage. [2025-10-30T18:57:04.274560] [INFO ] [MAIN ] GF: Loaded 2514 existing records. [2025-10-30T18:57:04.447388] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:57:04.447623] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-30T18:57:04.447709] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-30T18:57:04.447868] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-30T18:57:04.447908] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-30T18:57:04.504149] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-30T18:57:04.801851] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:57:05.297503] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-30T18:57:05.672569] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-30T18:57:05.770204] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-30T18:57:05.773554] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T18:57:06.097570] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-30T18:57:06.897540] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-30T18:57:07.697593] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-30T18:57:07.753126] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-30T18:57:08.225383] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T18:57:08.497550] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-30T18:57:08.827560] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T18:57:09.297497] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-30T18:57:09.732383] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-30T18:57:10.097468] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-30T18:57:10.232852] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-30T18:57:10.897507] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-30T18:57:11.086286] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-30T18:57:11.697496] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-30T18:57:11.825153] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T18:57:12.497483] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-30T18:57:12.653857] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-30T18:57:13.297559] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-30T18:57:13.636453] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T18:57:14.097500] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-30T18:57:14.442134] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T18:57:14.897493] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-30T18:57:15.697475] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-30T18:57:15.896995] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-30T18:57:16.062697] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-30T18:57:16.114266] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T18:57:16.497528] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-30T18:57:17.297494] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-30T18:57:18.097519] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-30T18:57:18.335935] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T18:57:18.349033] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-30T18:57:18.897501] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-30T18:57:19.171673] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T18:57:19.697502] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-30T18:57:20.497469] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-30T18:57:20.602869] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-30T18:57:20.811343] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-30T18:57:20.887044] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T18:57:20.894774] [INFO ] [REMOTE ] GES: Full fetch complete (57938 records). [2025-10-30T18:57:20.894908] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-30T18:57:21.293964] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-30T18:57:21.294048] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-30T18:57:21.294792] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-30T18:57:21.294852] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-30T18:57:21.295911] [DEBUG] [LOCAL ] GES: Trimmed 57938 records to 37552 (keeping 200 days of data) [2025-10-30T18:57:21.297495] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-30T18:57:21.519570] [DEBUG] [LOCAL ] GES: Primary data saved (37552 records). [2025-10-30T18:57:21.519738] [INFO ] [MAIN ] GES: Full history saved. [2025-10-30T18:57:21.519825] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GES took 34.0s. Estimated remaining: 3h 5m 43s. Rate: 7.8 symbols/min [2025-10-30T18:57:21.712699] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:57:21.739678] [DEBUG] [LOCAL ] GFF: Loaded 28765 existing records from primary storage. [2025-10-30T18:57:21.739934] [INFO ] [MAIN ] GFF: Loaded 28765 existing records. [2025-10-30T18:57:21.819140] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T18:57:21.957872] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:57:21.958105] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-30T18:57:21.958171] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-30T18:57:21.958799] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-30T18:57:21.958858] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-30T18:57:22.102721] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-30T18:57:22.340935] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:57:22.897504] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-30T18:57:23.255632] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-30T18:57:23.697495] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-30T18:57:23.980398] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-30T18:57:23.994303] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-30T18:57:24.497498] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-30T18:57:24.802703] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-30T18:57:25.297505] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-30T18:57:26.097466] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-30T18:57:26.256263] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T18:57:26.384815] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-30T18:57:26.897496] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-30T18:57:27.324599] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-30T18:57:27.325537] [INFO ] [REMOTE ] GF: Full fetch complete (4820 records). [2025-10-30T18:57:27.325603] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-30T18:57:27.680120] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-30T18:57:27.680197] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-30T18:57:27.680349] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-30T18:57:27.680390] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-30T18:57:27.680880] [DEBUG] [LOCAL ] GF: Trimmed 4820 records to 2527 (keeping 200 days of data) [2025-10-30T18:57:27.695445] [DEBUG] [LOCAL ] GF: Primary data saved (2527 records). [2025-10-30T18:57:27.695506] [INFO ] [MAIN ] GF: Full history saved. [2025-10-30T18:57:27.695573] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GF took 23.6s. Estimated remaining: 3h 5m 33s. Rate: 7.8 symbols/min [2025-10-30T18:57:27.697453] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-30T18:57:28.497494] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-30T18:57:29.297455] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-30T18:57:29.437094] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T18:57:29.705240] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-30T18:57:30.097488] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-30T18:57:30.531344] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T18:57:30.539759] [INFO ] [REMOTE ] GETY: Full fetch complete (54919 records). [2025-10-30T18:57:30.539859] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-30T18:57:30.901018] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-30T18:57:30.942610] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-30T18:57:30.942711] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-30T18:57:30.943505] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-30T18:57:30.943551] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-30T18:57:30.944691] [DEBUG] [LOCAL ] GETY: Trimmed 54919 records to 35161 (keeping 200 days of data) [2025-10-30T18:57:31.134448] [DEBUG] [LOCAL ] GETY: Primary data saved (35161 records). [2025-10-30T18:57:31.134563] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-30T18:57:31.134659] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GETY took 34.0s. Estimated remaining: 3h 5m 18s. Rate: 7.8 symbols/min [2025-10-30T18:57:31.842449] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T18:57:31.848659] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-30T18:57:32.124816] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-30T18:57:32.497506] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-30T18:57:32.853232] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T18:57:33.297507] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-30T18:57:34.483090] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T18:57:34.491494] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-30T18:57:34.686784] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-30T18:57:34.704178] [INFO ] [REMOTE ] GEV: Full fetch complete (77057 records). [2025-10-30T18:57:34.704349] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-30T18:57:35.230693] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-30T18:57:35.230810] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-30T18:57:35.232198] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-30T18:57:35.232281] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-30T18:57:35.234083] [DEBUG] [LOCAL ] GEV: Trimmed 77057 records to 53365 (keeping 200 days of data) [2025-10-30T18:57:35.678789] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T18:57:35.705099] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-30T18:57:35.714105] [DEBUG] [LOCAL ] GEV: Primary data saved (53365 records). [2025-10-30T18:57:35.714254] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-30T18:57:35.714859] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GEV took 33.3s. Estimated remaining: 3h 5m 6s. Rate: 7.8 symbols/min [2025-10-30T18:57:36.569091] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-30T18:57:36.574962] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-30T18:57:37.380501] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T18:57:37.386733] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-30T18:57:38.470084] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T18:57:38.477772] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-30T18:57:39.373748] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-30T18:57:39.380063] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-30T18:57:40.479488] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T18:57:40.485887] [INFO ] [REMOTE ] GFF: Full fetch complete (43243 records). [2025-10-30T18:57:40.486051] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-30T18:57:40.872582] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-30T18:57:40.872691] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-30T18:57:40.873466] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-30T18:57:40.873510] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-30T18:57:40.874480] [DEBUG] [LOCAL ] GFF: Trimmed 43243 records to 28909 (keeping 200 days of data) [2025-10-30T18:57:41.053245] [DEBUG] [LOCAL ] GFF: Primary data saved (28909 records). [2025-10-30T18:57:41.053411] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-30T18:57:41.053512] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GFF took 19.5s. Estimated remaining: 3h 4m 54s. Rate: 7.8 symbols/min [2025-10-30T18:57:41.732836] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:57:41.802002] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:57:41.794600] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:57:41.832133] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:57:41.844632] [DEBUG] [LOCAL ] GFR: Loaded 6839 existing records from primary storage. [2025-10-30T18:57:41.845285] [INFO ] [MAIN ] GFR: Loaded 6839 existing records. [2025-10-30T18:57:42.089148] [DEBUG] [LOCAL ] GFL: Loaded 47219 existing records from primary storage. [2025-10-30T18:57:42.093230] [INFO ] [MAIN ] GFL: Loaded 47219 existing records. [2025-10-30T18:57:42.092769] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:57:42.112692] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-30T18:57:42.167405] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-30T18:57:42.151518] [DEBUG] [LOCAL ] GFI: Loaded 53112 existing records from primary storage. [2025-10-30T18:57:42.222689] [DEBUG] [LOCAL ] GGB: Loaded 51537 existing records from primary storage. [2025-10-30T18:57:42.216322] [INFO ] [MAIN ] GFI: Loaded 53112 existing records. [2025-10-30T18:57:42.228205] [INFO ] [MAIN ] GGB: Loaded 51537 existing records. [2025-10-30T18:57:42.228298] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-30T18:57:42.273732] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-30T18:57:42.701790] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:57:42.737866] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-30T18:57:42.763602] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-30T18:57:42.808134] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-30T18:57:42.867315] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-30T18:57:42.967855] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:57:43.022454] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-30T18:57:43.022023] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:57:43.055771] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-30T18:57:43.070030] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-30T18:57:43.055934] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-30T18:57:43.097212] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-30T18:57:43.112941] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-30T18:57:43.097291] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-30T18:57:43.195325] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-30T18:57:43.644319] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:57:43.727554] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-30T18:57:44.072613] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:57:44.083226] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-30T18:57:44.254461] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:57:44.273579] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-30T18:57:44.273351] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:57:44.274553] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-30T18:57:44.608712] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T18:57:44.611178] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-30T18:57:45.146910] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-30T18:57:45.149333] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-30T18:57:45.264368] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T18:57:45.273551] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-30T18:57:45.652993] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-30T18:57:45.664628] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T18:57:45.665397] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-30T18:57:45.670257] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-30T18:57:45.751758] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-30T18:57:46.097538] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-30T18:57:46.255533] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-30T18:57:46.527535] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T18:57:46.892933] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T18:57:46.902338] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-30T18:57:47.403296] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-30T18:57:47.522995] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-30T18:57:47.697521] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-30T18:57:48.497518] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-30T18:57:49.297565] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-30T18:57:49.465524] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-30T18:57:49.612375] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T18:57:49.782693] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-30T18:57:50.097577] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-30T18:57:50.897509] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-30T18:57:51.288698] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-30T18:57:51.418355] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T18:57:51.697517] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-30T18:57:52.497563] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-30T18:57:53.297464] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-30T18:57:53.469699] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-30T18:57:53.678750] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T18:57:53.764630] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T18:57:54.097543] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-30T18:57:54.897548] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-30T18:57:55.371598] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T18:57:55.697524] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-30T18:57:56.200614] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T18:57:56.439919] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T18:57:56.497515] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-30T18:57:57.297522] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-30T18:57:57.814800] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T18:57:58.097514] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-30T18:57:58.295066] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T18:57:58.897477] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-30T18:57:59.618804] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T18:57:59.697498] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-30T18:58:00.140865] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-30T18:58:00.279440] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-30T18:58:00.281180] [INFO ] [REMOTE ] GFR: Full fetch complete (11798 records). [2025-10-30T18:58:00.281248] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-30T18:58:00.502720] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-30T18:58:00.650327] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-30T18:58:00.650402] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-30T18:58:00.650686] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-30T18:58:00.650746] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-30T18:58:00.651200] [DEBUG] [LOCAL ] GFR: Trimmed 11798 records to 6884 (keeping 200 days of data) [2025-10-30T18:58:00.687254] [DEBUG] [LOCAL ] GFR: Primary data saved (6884 records). [2025-10-30T18:58:00.687343] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-30T18:58:00.687417] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFR took 19.6s. Estimated remaining: 3h 5m 5s. Rate: 7.8 symbols/min [2025-10-30T18:58:00.856331] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:00.891063] [DEBUG] [LOCAL ] GGG: Loaded 40336 existing records from primary storage. [2025-10-30T18:58:00.891358] [INFO ] [MAIN ] GGG: Loaded 40336 existing records. [2025-10-30T18:58:01.066668] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:01.066867] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-30T18:58:01.066943] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-30T18:58:01.067833] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-30T18:58:01.067893] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-30T18:58:01.306100] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-30T18:58:01.430891] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:02.097503] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-30T18:58:02.282693] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-30T18:58:02.809344] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T18:58:02.897460] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-30T18:58:03.250474] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T18:58:03.697501] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-30T18:58:04.497469] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-30T18:58:04.679481] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-30T18:58:05.099078] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T18:58:05.297491] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-30T18:58:05.668065] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T18:58:06.097494] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-30T18:58:06.897476] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-30T18:58:07.042273] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T18:58:07.056186] [INFO ] [REMOTE ] GFI: Full fetch complete (77047 records). [2025-10-30T18:58:07.056350] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-30T18:58:07.512504] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T18:58:07.510825] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-30T18:58:07.521622] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-30T18:58:07.522999] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-30T18:58:07.523194] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-30T18:58:07.524745] [DEBUG] [LOCAL ] GFI: Trimmed 77047 records to 53502 (keeping 200 days of data) [2025-10-30T18:58:07.720122] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-30T18:58:07.876006] [DEBUG] [LOCAL ] GFI: Primary data saved (53502 records). [2025-10-30T18:58:07.876131] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-30T18:58:07.876208] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GFI took 26.8s. Estimated remaining: 3h 4m 57s. Rate: 7.8 symbols/min [2025-10-30T18:58:08.070066] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:08.094520] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T18:58:08.112677] [DEBUG] [LOCAL ] GGT: Loaded 14466 existing records from primary storage. [2025-10-30T18:58:08.112908] [INFO ] [MAIN ] GGT: Loaded 14466 existing records. [2025-10-30T18:58:08.288392] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:08.288591] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-30T18:58:08.288661] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-30T18:58:08.289003] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-30T18:58:08.289061] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-30T18:58:08.507013] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-30T18:58:08.642775] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:08.847018] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T18:58:09.297489] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-30T18:58:09.743769] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T18:58:10.097497] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-30T18:58:10.523585] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T18:58:10.897495] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-30T18:58:11.239156] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T18:58:11.697495] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-30T18:58:12.152831] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-30T18:58:12.315114] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T18:58:12.328527] [INFO ] [REMOTE ] GGB: Full fetch complete (74381 records). [2025-10-30T18:58:12.328721] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-30T18:58:12.511070] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-30T18:58:12.764425] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-30T18:58:12.764520] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-30T18:58:12.765502] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-30T18:58:12.765570] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-30T18:58:12.767144] [DEBUG] [LOCAL ] GGB: Trimmed 74381 records to 51927 (keeping 200 days of data) [2025-10-30T18:58:13.054536] [DEBUG] [LOCAL ] GGB: Primary data saved (51927 records). [2025-10-30T18:58:13.054686] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-30T18:58:13.054777] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GGB took 32.0s. Estimated remaining: 3h 4m 45s. Rate: 7.8 symbols/min [2025-10-30T18:58:13.231781] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:13.236087] [DEBUG] [LOCAL ] GGZ: Loaded 2287 existing records from primary storage. [2025-10-30T18:58:13.236278] [INFO ] [MAIN ] GGZ: Loaded 2287 existing records. [2025-10-30T18:58:13.309142] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-30T18:58:13.437473] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:13.437700] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-30T18:58:13.437759] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-30T18:58:13.437910] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-30T18:58:13.437950] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-30T18:58:13.799283] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:13.855982] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T18:58:13.873367] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T18:58:14.097483] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-30T18:58:14.709091] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T18:58:14.897497] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-30T18:58:15.199993] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-30T18:58:15.697489] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-30T18:58:16.031120] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T18:58:16.497470] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-30T18:58:17.297500] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-30T18:58:17.762963] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T18:58:17.774610] [INFO ] [REMOTE ] GFL: Full fetch complete (69625 records). [2025-10-30T18:58:17.774794] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-30T18:58:17.931847] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-30T18:58:18.102582] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-30T18:58:18.183047] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-30T18:58:18.183128] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-30T18:58:18.183973] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-30T18:58:18.184035] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-30T18:58:18.185381] [DEBUG] [LOCAL ] GFL: Trimmed 69625 records to 47591 (keeping 200 days of data) [2025-10-30T18:58:18.474252] [DEBUG] [LOCAL ] GFL: Primary data saved (47591 records). [2025-10-30T18:58:18.474448] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-30T18:58:18.475322] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GFL took 37.4s. Estimated remaining: 3h 4m 34s. Rate: 7.8 symbols/min [2025-10-30T18:58:18.642528] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:18.647253] [DEBUG] [LOCAL ] GHC: Loaded 2946 existing records from primary storage. [2025-10-30T18:58:18.647429] [INFO ] [MAIN ] GHC: Loaded 2946 existing records. [2025-10-30T18:58:18.828771] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:18.828992] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-30T18:58:18.829058] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-30T18:58:18.829324] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-30T18:58:18.829382] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-30T18:58:18.904870] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-30T18:58:19.132411] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T18:58:19.204945] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:19.697507] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-30T18:58:20.052020] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-30T18:58:20.055704] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T18:58:20.497495] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-30T18:58:21.297495] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-30T18:58:21.595769] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T18:58:21.629482] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-30T18:58:22.097515] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-30T18:58:22.411514] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-30T18:58:22.897501] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-30T18:58:23.197158] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-30T18:58:23.697497] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-30T18:58:23.998214] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T18:58:24.497510] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-30T18:58:25.148632] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T18:58:25.297519] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-30T18:58:25.612390] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-30T18:58:26.097499] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-30T18:58:26.897507] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-30T18:58:27.153419] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T18:58:27.234725] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T18:58:27.697497] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-30T18:58:28.497488] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-30T18:58:28.857442] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T18:58:29.231232] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T18:58:29.297487] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-30T18:58:29.898585] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-30T18:58:30.097496] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-30T18:58:30.399413] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-30T18:58:30.897487] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-30T18:58:31.495676] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T18:58:31.697523] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-30T18:58:32.285728] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-30T18:58:32.497548] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-30T18:58:32.936508] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-30T18:58:32.937580] [INFO ] [REMOTE ] GGZ: Full fetch complete (3735 records). [2025-10-30T18:58:32.937705] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-30T18:58:33.298149] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-30T18:58:33.297797] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-30T18:58:33.299252] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-30T18:58:33.299424] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-30T18:58:33.299468] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-30T18:58:33.299924] [DEBUG] [LOCAL ] GGZ: Trimmed 3735 records to 2297 (keeping 200 days of data) [2025-10-30T18:58:33.314301] [DEBUG] [LOCAL ] GGZ: Primary data saved (2297 records). [2025-10-30T18:58:33.314410] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-30T18:58:33.314490] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGZ took 20.3s. Estimated remaining: 3h 4m 38s. Rate: 7.8 symbols/min [2025-10-30T18:58:33.482195] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:33.486632] [DEBUG] [LOCAL ] GHG: Loaded 3270 existing records from primary storage. [2025-10-30T18:58:33.486802] [INFO ] [MAIN ] GHG: Loaded 3270 existing records. [2025-10-30T18:58:33.657190] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:33.657404] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-30T18:58:33.657450] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-30T18:58:33.657678] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-30T18:58:33.657735] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-30T18:58:34.031631] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:34.068851] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-30T18:58:34.072756] [INFO ] [REMOTE ] GGT: Full fetch complete (19209 records). [2025-10-30T18:58:34.072897] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-30T18:58:34.102734] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-30T18:58:34.462813] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-30T18:58:34.462894] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-30T18:58:34.463309] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-30T18:58:34.463347] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-30T18:58:34.463929] [DEBUG] [LOCAL ] GGT: Trimmed 19209 records to 14552 (keeping 200 days of data) [2025-10-30T18:58:34.549045] [DEBUG] [LOCAL ] GGT: Primary data saved (14552 records). [2025-10-30T18:58:34.549184] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-30T18:58:34.549265] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GGT took 26.7s. Estimated remaining: 3h 4m 20s. Rate: 7.8 symbols/min [2025-10-30T18:58:34.637980] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T18:58:34.726123] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:34.734951] [DEBUG] [LOCAL ] GHI: Loaded 8098 existing records from primary storage. [2025-10-30T18:58:34.735166] [INFO ] [MAIN ] GHI: Loaded 8098 existing records. [2025-10-30T18:58:34.903001] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-30T18:58:34.910865] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:34.911224] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-30T18:58:34.912187] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-30T18:58:34.912504] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-30T18:58:34.912562] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-30T18:58:35.293432] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:35.293604] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-30T18:58:35.697577] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-30T18:58:36.039859] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T18:58:36.497571] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-30T18:58:37.297555] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-30T18:58:37.438426] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T18:58:37.853508] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T18:58:38.097482] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-30T18:58:38.510209] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T18:58:38.897498] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-30T18:58:39.697503] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-30T18:58:39.976395] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T18:58:40.208122] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T18:58:40.497497] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-30T18:58:41.297497] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-30T18:58:41.794021] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T18:58:41.881606] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T18:58:41.891048] [INFO ] [REMOTE ] GGG: Full fetch complete (59672 records). [2025-10-30T18:58:41.891197] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-30T18:58:42.103355] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-30T18:58:42.300528] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-30T18:58:42.300634] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-30T18:58:42.301555] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-30T18:58:42.301620] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-30T18:58:42.303065] [DEBUG] [LOCAL ] GGG: Trimmed 59672 records to 40635 (keeping 200 days of data) [2025-10-30T18:58:42.514903] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-30T18:58:42.552695] [DEBUG] [LOCAL ] GGG: Primary data saved (40635 records). [2025-10-30T18:58:42.552835] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-30T18:58:42.553526] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GGG took 41.9s. Estimated remaining: 3h 4m 13s. Rate: 7.8 symbols/min [2025-10-30T18:58:42.723362] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:42.730597] [DEBUG] [LOCAL ] GHLD: Loaded 4368 existing records from primary storage. [2025-10-30T18:58:42.730836] [INFO ] [MAIN ] GHLD: Loaded 4368 existing records. [2025-10-30T18:58:42.919040] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:42.899514] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-30T18:58:42.919387] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-30T18:58:42.919461] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-30T18:58:42.920304] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-30T18:58:42.920378] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-30T18:58:43.287182] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:43.367909] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T18:58:43.697502] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-30T18:58:43.969456] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-30T18:58:44.497592] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-30T18:58:44.868580] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-30T18:58:45.297574] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-30T18:58:45.677374] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-30T18:58:46.097591] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-30T18:58:46.544165] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T18:58:46.897582] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-30T18:58:47.174065] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-30T18:58:47.697541] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-30T18:58:48.101734] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-30T18:58:48.497543] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-30T18:58:48.755441] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-30T18:58:49.297562] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-30T18:58:49.650318] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-30T18:58:50.097529] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-30T18:58:50.415241] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-30T18:58:50.897518] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-30T18:58:51.347808] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-30T18:58:51.697583] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-30T18:58:52.152041] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T18:58:52.497512] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-30T18:58:52.940947] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-30T18:58:53.297549] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-30T18:58:53.625181] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-30T18:58:54.097533] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-30T18:58:54.524184] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-30T18:58:54.897565] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-30T18:58:55.207902] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-30T18:58:55.697549] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-30T18:58:56.239244] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-30T18:58:56.497501] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-30T18:58:57.021248] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-30T18:58:57.297501] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-30T18:58:57.776108] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T18:58:58.097504] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-30T18:58:58.538937] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-30T18:58:58.540198] [INFO ] [REMOTE ] GHG: Full fetch complete (4251 records). [2025-10-30T18:58:58.540264] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-30T18:58:58.910990] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-30T18:58:58.904797] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-30T18:58:58.911437] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-30T18:58:58.912344] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-30T18:58:58.912402] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-30T18:58:58.912831] [DEBUG] [LOCAL ] GHG: Trimmed 4251 records to 3291 (keeping 200 days of data) [2025-10-30T18:58:58.934407] [DEBUG] [LOCAL ] GHG: Primary data saved (3291 records). [2025-10-30T18:58:58.934918] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-30T18:58:58.935031] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GHG took 25.6s. Estimated remaining: 3h 4m 18s. Rate: 7.8 symbols/min [2025-10-30T18:58:59.101768] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:58:59.116236] [DEBUG] [LOCAL ] GHM: Loaded 14332 existing records from primary storage. [2025-10-30T18:58:59.116510] [INFO ] [MAIN ] GHM: Loaded 14332 existing records. [2025-10-30T18:58:59.289986] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:58:59.290199] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-30T18:58:59.290252] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-30T18:58:59.290625] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-30T18:58:59.290717] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-30T18:58:59.392950] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T18:58:59.644746] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:58:59.697513] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-30T18:59:00.092681] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-30T18:59:00.497523] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-30T18:59:01.293901] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T18:59:01.297379] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-30T18:59:02.053746] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-30T18:59:02.097452] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-30T18:59:02.782899] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T18:59:02.897483] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-30T18:59:03.439404] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T18:59:03.697501] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-30T18:59:04.326526] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-30T18:59:04.328266] [INFO ] [REMOTE ] GHC: Full fetch complete (3746 records). [2025-10-30T18:59:04.328339] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-30T18:59:04.498735] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-30T18:59:04.689585] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-30T18:59:04.689690] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-30T18:59:04.689845] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-30T18:59:04.689885] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-30T18:59:04.690382] [DEBUG] [LOCAL ] GHC: Trimmed 3746 records to 2984 (keeping 200 days of data) [2025-10-30T18:59:04.710772] [DEBUG] [LOCAL ] GHC: Primary data saved (2984 records). [2025-10-30T18:59:04.710892] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-30T18:59:04.710982] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GHC took 46.2s. Estimated remaining: 3h 4m 8s. Rate: 7.8 symbols/min [2025-10-30T18:59:04.875076] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:04.894606] [DEBUG] [LOCAL ] GHY: Loaded 20611 existing records from primary storage. [2025-10-30T18:59:04.894876] [INFO ] [MAIN ] GHY: Loaded 20611 existing records. [2025-10-30T18:59:05.071460] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:05.071717] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-30T18:59:05.071775] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-30T18:59:05.072255] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-30T18:59:05.072313] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-30T18:59:05.303206] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-30T18:59:05.448705] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:05.470826] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-30T18:59:05.474566] [INFO ] [REMOTE ] GHI: Full fetch complete (11491 records). [2025-10-30T18:59:05.474694] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-30T18:59:05.835048] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-30T18:59:05.835125] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-30T18:59:05.835407] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-30T18:59:05.835446] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-30T18:59:05.835902] [DEBUG] [LOCAL ] GHI: Trimmed 11491 records to 8257 (keeping 200 days of data) [2025-10-30T18:59:05.885235] [DEBUG] [LOCAL ] GHI: Primary data saved (8257 records). [2025-10-30T18:59:05.885499] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-30T18:59:05.885732] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GHI took 31.3s. Estimated remaining: 3h 3m 50s. Rate: 7.8 symbols/min [2025-10-30T18:59:06.045372] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-30T18:59:06.068695] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:06.101354] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-30T18:59:06.102348] [DEBUG] [LOCAL ] GIB: Loaded 30857 existing records from primary storage. [2025-10-30T18:59:06.103353] [INFO ] [MAIN ] GIB: Loaded 30857 existing records. [2025-10-30T18:59:06.286155] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:06.286400] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-30T18:59:06.286458] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-30T18:59:06.287112] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-30T18:59:06.287171] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-30T18:59:06.558850] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-30T18:59:06.662632] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:06.897582] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-30T18:59:07.626759] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T18:59:07.697542] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-30T18:59:08.497489] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-30T18:59:08.579192] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T18:59:08.966457] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-30T18:59:09.297498] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-30T18:59:09.663515] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-30T18:59:10.097497] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-30T18:59:10.897504] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-30T18:59:11.084231] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T18:59:11.697479] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-30T18:59:11.773186] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T18:59:12.266239] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-30T18:59:12.497465] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-30T18:59:13.123760] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-30T18:59:13.297519] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-30T18:59:13.971561] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T18:59:14.097497] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-30T18:59:14.897520] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-30T18:59:15.188526] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T18:59:15.697496] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-30T18:59:15.872376] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-30T18:59:15.878142] [INFO ] [REMOTE ] GHM: Full fetch complete (21953 records). [2025-10-30T18:59:15.878253] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-30T18:59:16.252106] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-30T18:59:16.252231] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-30T18:59:16.252803] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-30T18:59:16.252866] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-30T18:59:16.253790] [DEBUG] [LOCAL ] GHM: Trimmed 21953 records to 14436 (keeping 200 days of data) [2025-10-30T18:59:16.336792] [DEBUG] [LOCAL ] GHM: Primary data saved (14436 records). [2025-10-30T18:59:16.336923] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-30T18:59:16.337001] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHM took 17.4s. Estimated remaining: 3h 3m 47s. Rate: 7.8 symbols/min [2025-10-30T18:59:16.502875] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-30T18:59:16.530540] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:16.527305] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T18:59:16.548233] [DEBUG] [LOCAL ] GIC: Loaded 13041 existing records from primary storage. [2025-10-30T18:59:16.548457] [INFO ] [MAIN ] GIC: Loaded 13041 existing records. [2025-10-30T18:59:16.723160] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:16.723386] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-30T18:59:16.723434] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-30T18:59:16.723808] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-30T18:59:16.723895] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-30T18:59:17.007755] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-30T18:59:17.090900] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:17.297499] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-30T18:59:17.999002] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T18:59:18.097485] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-30T18:59:18.491532] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T18:59:18.897491] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-30T18:59:19.360346] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-30T18:59:19.362000] [INFO ] [REMOTE ] GHLD: Full fetch complete (5273 records). [2025-10-30T18:59:19.362066] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-30T18:59:19.701837] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-30T18:59:19.726489] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-30T18:59:19.727366] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-30T18:59:19.727560] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-30T18:59:19.727686] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-30T18:59:19.728156] [DEBUG] [LOCAL ] GHLD: Trimmed 5273 records to 4428 (keeping 200 days of data) [2025-10-30T18:59:19.754860] [DEBUG] [LOCAL ] GHLD: Primary data saved (4428 records). [2025-10-30T18:59:19.754936] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-30T18:59:19.755006] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GHLD took 37.2s. Estimated remaining: 3h 3m 32s. Rate: 7.8 symbols/min [2025-10-30T18:59:19.923584] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:19.960305] [DEBUG] [LOCAL ] GIL: Loaded 43812 existing records from primary storage. [2025-10-30T18:59:19.960587] [INFO ] [MAIN ] GIL: Loaded 43812 existing records. [2025-10-30T18:59:20.137469] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:20.137714] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-30T18:59:20.137773] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-30T18:59:20.138627] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-30T18:59:20.138725] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-30T18:59:20.496602] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:20.497450] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-30T18:59:21.009958] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T18:59:21.297518] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-30T18:59:21.652996] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T18:59:21.881340] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-30T18:59:22.097500] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-30T18:59:22.742055] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-30T18:59:22.897498] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-30T18:59:23.697490] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-30T18:59:24.031033] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T18:59:24.497496] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-30T18:59:24.644945] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-30T18:59:25.297481] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-30T18:59:25.514612] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T18:59:26.099676] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-30T18:59:26.105437] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T18:59:26.787922] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T18:59:26.897546] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-30T18:59:27.697524] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-30T18:59:27.908454] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T18:59:28.497559] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-30T18:59:28.870310] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T18:59:29.054596] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T18:59:29.297527] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-30T18:59:29.810491] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T18:59:30.097521] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-30T18:59:30.897543] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-30T18:59:31.214521] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T18:59:31.352915] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T18:59:31.697526] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-30T18:59:32.497592] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-30T18:59:32.617387] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T18:59:33.297545] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-30T18:59:33.582147] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-30T18:59:33.929754] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-30T18:59:34.097512] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-30T18:59:34.894725] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-30T18:59:34.900512] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-30T18:59:35.697483] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-30T18:59:35.935496] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T18:59:36.497519] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-30T18:59:36.827973] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T18:59:37.297479] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-30T18:59:37.413326] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-30T18:59:37.789834] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T18:59:38.097518] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-30T18:59:38.897487] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-30T18:59:39.161135] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T18:59:39.168094] [INFO ] [REMOTE ] GIB: Full fetch complete (46581 records). [2025-10-30T18:59:39.168223] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-30T18:59:39.541157] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-30T18:59:39.541237] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-30T18:59:39.542000] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-30T18:59:39.542062] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-30T18:59:39.543100] [DEBUG] [LOCAL ] GIB: Trimmed 46581 records to 31104 (keeping 200 days of data) [2025-10-30T18:59:39.699021] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-30T18:59:39.734566] [DEBUG] [LOCAL ] GIB: Primary data saved (31104 records). [2025-10-30T18:59:39.734743] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-30T18:59:39.734834] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GIB took 33.8s. Estimated remaining: 3h 3m 44s. Rate: 7.8 symbols/min [2025-10-30T18:59:39.910349] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:39.958038] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-30T18:59:39.958382] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-10-30T18:59:40.145413] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:40.145789] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-30T18:59:40.145958] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-30T18:59:40.147289] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-30T18:59:40.147351] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-30T18:59:40.426201] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-30T18:59:40.498014] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-30T18:59:40.543014] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T18:59:40.575189] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:40.578778] [INFO ] [REMOTE ] GIC: Full fetch complete (19783 records). [2025-10-30T18:59:40.578861] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-30T18:59:40.939059] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-30T18:59:40.939144] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-30T18:59:40.939587] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-30T18:59:40.939627] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-30T18:59:40.940185] [DEBUG] [LOCAL ] GIC: Trimmed 19783 records to 13224 (keeping 200 days of data) [2025-10-30T18:59:41.017488] [DEBUG] [LOCAL ] GIC: Primary data saved (13224 records). [2025-10-30T18:59:41.017625] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-30T18:59:41.017741] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GIC took 24.7s. Estimated remaining: 3h 3m 26s. Rate: 7.8 symbols/min [2025-10-30T18:59:41.182335] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:41.218339] [DEBUG] [LOCAL ] GKOS: Loaded 42391 existing records from primary storage. [2025-10-30T18:59:41.218613] [INFO ] [MAIN ] GKOS: Loaded 42391 existing records. [2025-10-30T18:59:41.302681] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-30T18:59:41.400670] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:41.400882] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-30T18:59:41.400948] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-30T18:59:41.401844] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-30T18:59:41.401906] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-30T18:59:41.773262] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:41.806389] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-30T18:59:42.097505] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-30T18:59:42.665843] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T18:59:42.897510] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-30T18:59:43.000806] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T18:59:43.697510] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-30T18:59:44.075957] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T18:59:44.497483] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-30T18:59:44.635389] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T18:59:45.297502] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-30T18:59:45.896752] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T18:59:45.907291] [INFO ] [REMOTE ] GIL: Full fetch complete (62792 records). [2025-10-30T18:59:45.907448] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-30T18:59:46.107347] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-30T18:59:46.255018] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T18:59:46.329388] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-30T18:59:46.329470] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-30T18:59:46.330321] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-30T18:59:46.330385] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-30T18:59:46.331606] [DEBUG] [LOCAL ] GIL: Trimmed 62792 records to 44190 (keeping 200 days of data) [2025-10-30T18:59:46.587971] [DEBUG] [LOCAL ] GIL: Primary data saved (44190 records). [2025-10-30T18:59:46.588090] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-30T18:59:46.588725] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GIL took 26.8s. Estimated remaining: 3h 3m 15s. Rate: 7.8 symbols/min [2025-10-30T18:59:46.753855] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:46.789338] [DEBUG] [LOCAL ] GL: Loaded 37138 existing records from primary storage. [2025-10-30T18:59:46.789605] [INFO ] [MAIN ] GL: Loaded 37138 existing records. [2025-10-30T18:59:46.902790] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-30T18:59:46.969837] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:46.970187] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-30T18:59:46.970242] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-30T18:59:46.971124] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-30T18:59:46.971182] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-30T18:59:47.320247] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:47.473504] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T18:59:47.697526] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-30T18:59:48.104129] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T18:59:48.250452] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T18:59:48.497497] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-30T18:59:49.297523] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-30T18:59:49.936808] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T18:59:50.091003] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-30T18:59:50.097451] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-30T18:59:50.733393] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-30T18:59:50.897508] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-30T18:59:51.697504] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-30T18:59:52.245338] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T18:59:52.497516] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-30T18:59:52.689218] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T18:59:53.162915] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T18:59:53.297489] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-30T18:59:54.097523] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-30T18:59:54.589006] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T18:59:54.897534] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-30T18:59:55.297108] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T18:59:55.650781] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-30T18:59:55.656003] [INFO ] [REMOTE ] GHY: Full fetch complete (32018 records). [2025-10-30T18:59:55.656078] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-30T18:59:55.702749] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-30T18:59:56.024100] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-30T18:59:56.024206] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-30T18:59:56.024791] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-30T18:59:56.024852] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-30T18:59:56.025520] [DEBUG] [LOCAL ] GHY: Trimmed 32018 records to 20749 (keeping 200 days of data) [2025-10-30T18:59:56.150329] [DEBUG] [LOCAL ] GHY: Primary data saved (20749 records). [2025-10-30T18:59:56.150448] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-30T18:59:56.150521] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GHY took 51.4s. Estimated remaining: 3h 3m 10s. Rate: 7.8 symbols/min [2025-10-30T18:59:56.321923] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T18:59:56.363562] [DEBUG] [LOCAL ] GLOB: Loaded 48070 existing records from primary storage. [2025-10-30T18:59:56.363885] [INFO ] [MAIN ] GLOB: Loaded 48070 existing records. [2025-10-30T18:59:56.502975] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-30T18:59:56.568505] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T18:59:56.568903] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-30T18:59:56.568962] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-30T18:59:56.569928] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-30T18:59:56.570007] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-30T18:59:56.918535] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T18:59:57.297492] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-30T18:59:57.341249] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-30T18:59:57.683974] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T18:59:58.097511] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-30T18:59:58.334096] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T18:59:58.897545] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-30T18:59:59.474569] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T18:59:59.697489] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-30T19:00:00.245395] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T19:00:00.497509] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-30T19:00:00.975114] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T19:00:01.297492] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-30T19:00:02.097498] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-30T19:00:02.519963] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-30T19:00:02.674547] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T19:00:02.897490] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-30T19:00:03.209262] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T19:00:03.697508] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-30T19:00:04.497559] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-30T19:00:04.945892] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T19:00:05.012344] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-30T19:00:05.024627] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-30T19:00:05.024960] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-30T19:00:05.304108] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-30T19:00:05.423757] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-30T19:00:05.423836] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-30T19:00:05.424759] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-30T19:00:05.424821] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-30T19:00:05.426228] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 54065 (keeping 200 days of data) [2025-10-30T19:00:05.742865] [DEBUG] [LOCAL ] GIS: Primary data saved (54065 records). [2025-10-30T19:00:05.743061] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-30T19:00:05.743798] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GIS took 26.0s. Estimated remaining: 3h 3m 6s. Rate: 7.8 symbols/min [2025-10-30T19:00:05.928822] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:00:05.963552] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T19:00:05.979042] [DEBUG] [LOCAL ] GLP: Loaded 9072 existing records from primary storage. [2025-10-30T19:00:05.979329] [INFO ] [MAIN ] GLP: Loaded 9072 existing records. [2025-10-30T19:00:06.102724] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-30T19:00:06.171872] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:00:06.172461] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-30T19:00:06.172522] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-30T19:00:06.172888] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-30T19:00:06.172946] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-30T19:00:06.548980] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:00:06.614045] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T19:00:06.897492] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-30T19:00:07.428555] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T19:00:07.589451] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T19:00:07.697497] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-30T19:00:08.257402] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T19:00:08.497524] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-30T19:00:09.297535] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-30T19:00:09.607209] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T19:00:10.097547] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-30T19:00:10.359310] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T19:00:10.897492] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-30T19:00:10.955389] [DEBUG] [REMOTE ] GL: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-30T19:00:10.955777] [WARN ] [REMOTE ] GL: No data returned for month 2025-06 [2025-10-30T19:00:10.955869] [FATAL] [REMOTE ] GL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:00:10.955966] [FATAL] [MAIN ] GL: Failed to fetch primary data. [2025-10-30T19:00:10.956035] [WARN ] [MAIN ] GL: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:00:10.956107] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-30T19:00:10.956171] [DEBUG] [LOCAL ] GL: No primary data file found to delete. [2025-10-30T19:00:10.956207] [INFO ] [LOCAL ] GL: Starting deletion of derivative data. [2025-10-30T19:00:10.956355] [DEBUG] [LOCAL ] GL: Deleted derivative data file. [2025-10-30T19:00:10.956959] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GL took 24.4s. Estimated remaining: 3h 2m 54s. Rate: 7.8 symbols/min [2025-10-30T19:00:11.133475] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:00:11.182306] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-30T19:00:11.182592] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-30T19:00:11.376627] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:00:11.376873] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-30T19:00:11.377064] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-30T19:00:11.378022] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-30T19:00:11.378079] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-30T19:00:11.703685] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-30T19:00:11.698468] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-30T19:00:11.794084] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:00:12.497509] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-30T19:00:12.848552] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:00:13.297495] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-30T19:00:13.665933] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T19:00:14.097493] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-30T19:00:14.632464] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T19:00:14.643291] [INFO ] [REMOTE ] GKOS: Full fetch complete (60939 records). [2025-10-30T19:00:14.643506] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-30T19:00:14.904188] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-30T19:00:15.056925] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-30T19:00:15.057018] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-30T19:00:15.057852] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-30T19:00:15.057920] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-30T19:00:15.059198] [DEBUG] [LOCAL ] GKOS: Trimmed 60939 records to 42780 (keeping 200 days of data) [2025-10-30T19:00:15.331621] [DEBUG] [LOCAL ] GKOS: Primary data saved (42780 records). [2025-10-30T19:00:15.331804] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-30T19:00:15.331936] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GKOS took 34.3s. Estimated remaining: 3h 2m 41s. Rate: 7.8 symbols/min [2025-10-30T19:00:15.530209] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:00:15.581393] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-30T19:00:15.581803] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-30T19:00:15.698341] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-30T19:00:15.794239] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:00:15.794495] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-30T19:00:15.794549] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-30T19:00:15.795128] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-30T19:00:15.795186] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-30T19:00:16.208908] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:00:16.277248] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-30T19:00:16.274370] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-30T19:00:16.359389] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T19:00:16.497508] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-30T19:00:17.297503] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-30T19:00:17.894182] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-30T19:00:18.097499] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-30T19:00:18.682193] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-30T19:00:18.905323] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-30T19:00:18.908151] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-30T19:00:19.697504] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-30T19:00:20.182481] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T19:00:20.210880] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T19:00:20.497486] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-30T19:00:20.893282] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T19:00:21.297500] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-30T19:00:22.097492] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-30T19:00:22.849139] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-30T19:00:22.897474] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-30T19:00:23.418575] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-30T19:00:23.697491] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-30T19:00:24.418661] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-30T19:00:24.497512] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-30T19:00:24.987769] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-30T19:00:25.247033] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-30T19:00:25.297545] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-30T19:00:26.097513] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-30T19:00:26.897470] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-30T19:00:27.136408] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-30T19:00:27.425496] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-30T19:00:27.702363] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-30T19:00:27.708056] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T19:00:27.718770] [INFO ] [REMOTE ] GLOB: Full fetch complete (66858 records). [2025-10-30T19:00:27.718878] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-30T19:00:28.111327] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-30T19:00:28.111405] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-30T19:00:28.112304] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-30T19:00:28.112366] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-30T19:00:28.113853] [DEBUG] [LOCAL ] GLOB: Trimmed 66858 records to 48411 (keeping 200 days of data) [2025-10-30T19:00:28.391589] [DEBUG] [LOCAL ] GLOB: Primary data saved (48411 records). [2025-10-30T19:00:28.391746] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-30T19:00:28.392698] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GLOB took 32.2s. Estimated remaining: 3h 2m 42s. Rate: 7.8 symbols/min [2025-10-30T19:00:28.502618] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-30T19:00:28.563751] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:00:28.614920] [DEBUG] [LOCAL ] GME: Loaded 53776 existing records from primary storage. [2025-10-30T19:00:28.615218] [INFO ] [MAIN ] GME: Loaded 53776 existing records. [2025-10-30T19:00:28.790000] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:00:28.790200] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-30T19:00:28.790277] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-30T19:00:28.791097] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-30T19:00:28.791157] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-30T19:00:29.135843] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:00:29.297486] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-30T19:00:29.568706] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-30T19:00:29.986875] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T19:00:30.097516] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-30T19:00:30.897563] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-30T19:00:31.436358] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-30T19:00:31.528847] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-30T19:00:31.576954] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-30T19:00:31.697518] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-30T19:00:32.188610] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-30T19:00:32.190824] [INFO ] [REMOTE ] GLP: Full fetch complete (14204 records). [2025-10-30T19:00:32.190895] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-30T19:00:32.505197] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-30T19:00:32.549078] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-30T19:00:32.549155] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-30T19:00:32.549474] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-30T19:00:32.549514] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-30T19:00:32.550017] [DEBUG] [LOCAL ] GLP: Trimmed 14204 records to 9115 (keeping 200 days of data) [2025-10-30T19:00:32.605210] [DEBUG] [LOCAL ] GLP: Primary data saved (9115 records). [2025-10-30T19:00:32.605358] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-30T19:00:32.605443] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GLP took 26.9s. Estimated remaining: 3h 2m 29s. Rate: 7.8 symbols/min [2025-10-30T19:00:32.770544] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:00:32.813286] [DEBUG] [LOCAL ] GMED: Loaded 48081 existing records from primary storage. [2025-10-30T19:00:32.813580] [INFO ] [MAIN ] GMED: Loaded 48081 existing records. [2025-10-30T19:00:32.990049] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:00:32.990257] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-30T19:00:32.990342] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-30T19:00:32.990788] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-30T19:00:32.990845] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-30T19:00:33.311428] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-30T19:00:33.358725] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:00:34.024194] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T19:00:34.097504] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-30T19:00:34.897511] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-30T19:00:34.951948] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-30T19:00:35.545176] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T19:00:35.697522] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-30T19:00:35.964105] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-30T19:00:36.497534] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-30T19:00:37.297471] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-30T19:00:37.531197] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-30T19:00:38.003223] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T19:00:38.097488] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-30T19:00:38.441416] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:00:38.897464] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-30T19:00:39.501084] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T19:00:39.697549] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-30T19:00:40.228633] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T19:00:40.497552] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-30T19:00:41.125554] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T19:00:41.297525] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-30T19:00:41.816339] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T19:00:42.097464] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-30T19:00:42.782916] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T19:00:42.897503] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-30T19:00:43.512515] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T19:00:43.697546] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-30T19:00:44.497554] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-30T19:00:44.820342] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-30T19:00:45.297545] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-30T19:00:45.533282] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-30T19:00:45.545358] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-30T19:00:45.545550] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-30T19:00:45.946045] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-30T19:00:45.946341] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-30T19:00:45.947956] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-30T19:00:45.948082] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-30T19:00:45.950465] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54119 (keeping 200 days of data) [2025-10-30T19:00:46.099460] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-30T19:00:46.213947] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-30T19:00:46.334421] [DEBUG] [LOCAL ] GM: Primary data saved (54119 records). [2025-10-30T19:00:46.334696] [INFO ] [MAIN ] GM: Full history saved. [2025-10-30T19:00:46.334800] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GM took 31.0s. Estimated remaining: 3h 2m 30s. Rate: 7.8 symbols/min [2025-10-30T19:00:46.507170] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:00:46.534598] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-30T19:00:46.572886] [DEBUG] [LOCAL ] GMRE: Loaded 35346 existing records from primary storage. [2025-10-30T19:00:46.573185] [INFO ] [MAIN ] GMRE: Loaded 35346 existing records. [2025-10-30T19:00:46.774184] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:00:46.774740] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-30T19:00:46.774800] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-30T19:00:46.775389] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-30T19:00:46.775467] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-30T19:00:46.902716] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-30T19:00:47.154370] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:00:47.697522] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-30T19:00:48.270022] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T19:00:48.314859] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-30T19:00:48.497519] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-30T19:00:49.297548] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-30T19:00:49.879014] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-30T19:00:49.891172] [INFO ] [REMOTE ] GLW: Full fetch complete (77800 records). [2025-10-30T19:00:49.891323] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-30T19:00:50.125352] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-30T19:00:50.288388] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-30T19:00:50.288467] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-30T19:00:50.289414] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-30T19:00:50.289505] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-30T19:00:50.290929] [DEBUG] [LOCAL ] GLW: Trimmed 77800 records to 54025 (keeping 200 days of data) [2025-10-30T19:00:50.615187] [DEBUG] [LOCAL ] GLW: Primary data saved (54025 records). [2025-10-30T19:00:50.615481] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-30T19:00:50.616163] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GLW took 39.7s. Estimated remaining: 3h 2m 18s. Rate: 7.8 symbols/min [2025-10-30T19:00:50.796538] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:00:50.829232] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-30T19:00:50.880309] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-30T19:00:50.896971] [DEBUG] [LOCAL ] GNE: Loaded 18134 existing records from primary storage. [2025-10-30T19:00:50.897231] [INFO ] [MAIN ] GNE: Loaded 18134 existing records. [2025-10-30T19:00:50.908632] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-30T19:00:51.080913] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:00:51.081161] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-30T19:00:51.081303] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-30T19:00:51.090040] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-30T19:00:51.103328] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-30T19:00:51.136408] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-30T19:00:51.461604] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:00:51.697511] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-30T19:00:52.497504] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-30T19:00:52.850537] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:00:52.959235] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-30T19:00:52.977071] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-30T19:00:53.297492] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-30T19:00:53.774672] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-30T19:00:54.097500] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-30T19:00:54.897495] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-30T19:00:55.418467] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T19:00:55.697507] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-30T19:00:56.164373] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T19:00:56.323417] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-30T19:00:56.497568] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-30T19:00:57.297496] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-30T19:00:58.097509] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-30T19:00:58.348680] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-30T19:00:58.377723] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T19:00:58.897511] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-30T19:00:59.554906] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T19:00:59.565468] [INFO ] [REMOTE ] GMED: Full fetch complete (70088 records). [2025-10-30T19:00:59.565668] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-30T19:00:59.702587] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-30T19:00:59.978576] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-30T19:00:59.978697] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-30T19:00:59.979626] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-30T19:00:59.979705] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-30T19:00:59.981017] [DEBUG] [LOCAL ] GMED: Trimmed 70088 records to 48384 (keeping 200 days of data) [2025-10-30T19:01:00.265778] [DEBUG] [LOCAL ] GMED: Primary data saved (48384 records). [2025-10-30T19:01:00.265913] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-30T19:01:00.266677] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GMED took 27.7s. Estimated remaining: 3h 2m 13s. Rate: 7.8 symbols/min [2025-10-30T19:01:00.440924] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:00.455020] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T19:01:00.494889] [DEBUG] [LOCAL ] GNK: Loaded 38699 existing records from primary storage. [2025-10-30T19:01:00.495228] [INFO ] [MAIN ] GNK: Loaded 38699 existing records. [2025-10-30T19:01:00.506359] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-30T19:01:00.675745] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:00.675962] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-30T19:01:00.676026] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-30T19:01:00.676798] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-30T19:01:00.676861] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-30T19:01:01.028590] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:01.162616] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-30T19:01:01.297526] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-30T19:01:01.650985] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T19:01:02.097470] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-30T19:01:02.290843] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T19:01:02.897505] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-30T19:01:02.951568] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T19:01:03.697490] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-30T19:01:03.856619] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T19:01:04.497513] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-30T19:01:04.808317] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T19:01:05.297496] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-30T19:01:06.001093] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-30T19:01:06.097481] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-30T19:01:06.687976] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-30T19:01:06.699882] [INFO ] [REMOTE ] GME: Full fetch complete (77916 records). [2025-10-30T19:01:06.700009] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-30T19:01:06.906351] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-30T19:01:07.096994] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-30T19:01:07.097200] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-30T19:01:07.098315] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-30T19:01:07.098396] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-30T19:01:07.099827] [DEBUG] [LOCAL ] GME: Trimmed 77916 records to 54164 (keeping 200 days of data) [2025-10-30T19:01:07.210041] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T19:01:07.438212] [DEBUG] [LOCAL ] GME: Primary data saved (54164 records). [2025-10-30T19:01:07.438374] [INFO ] [MAIN ] GME: Full history saved. [2025-10-30T19:01:07.439341] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GME took 39.0s. Estimated remaining: 3h 2m 4s. Rate: 7.8 symbols/min [2025-10-30T19:01:07.602572] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:07.642901] [DEBUG] [LOCAL ] GNL: Loaded 46108 existing records from primary storage. [2025-10-30T19:01:07.643188] [INFO ] [MAIN ] GNL: Loaded 46108 existing records. [2025-10-30T19:01:07.704820] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-30T19:01:07.821692] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:07.821893] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-30T19:01:07.821940] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-30T19:01:07.822397] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-30T19:01:07.822437] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-30T19:01:08.202373] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:08.227016] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T19:01:08.497460] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-30T19:01:08.820938] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T19:01:09.235076] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-30T19:01:09.297472] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-30T19:01:10.097513] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-30T19:01:10.565355] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:01:10.897494] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-30T19:01:11.156094] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T19:01:11.697554] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-30T19:01:11.834270] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T19:01:12.501803] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-30T19:01:12.508577] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T19:01:13.297515] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-30T19:01:13.744961] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T19:01:14.097455] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-30T19:01:14.140764] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T19:01:14.144216] [INFO ] [REMOTE ] GNE: Full fetch complete (22626 records). [2025-10-30T19:01:14.144293] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-30T19:01:14.534109] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-30T19:01:14.534188] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-30T19:01:14.534769] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-30T19:01:14.534831] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-30T19:01:14.535502] [DEBUG] [LOCAL ] GNE: Trimmed 22626 records to 18223 (keeping 200 days of data) [2025-10-30T19:01:14.643685] [DEBUG] [LOCAL ] GNE: Primary data saved (18223 records). [2025-10-30T19:01:14.643822] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-30T19:01:14.643896] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GNE took 24.0s. Estimated remaining: 3h 1m 56s. Rate: 7.8 symbols/min [2025-10-30T19:01:14.828817] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:14.877078] [DEBUG] [LOCAL ] GNRC: Loaded 45196 existing records from primary storage. [2025-10-30T19:01:14.877377] [INFO ] [MAIN ] GNRC: Loaded 45196 existing records. [2025-10-30T19:01:14.907710] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-30T19:01:15.060802] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:15.061130] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-30T19:01:15.061255] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-30T19:01:15.061810] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-30T19:01:15.061878] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-30T19:01:15.386731] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-30T19:01:15.471519] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:15.697535] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-30T19:01:16.086501] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T19:01:16.497495] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-30T19:01:16.947302] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T19:01:17.297538] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-30T19:01:17.472741] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T19:01:18.097503] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-30T19:01:18.544188] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T19:01:18.897505] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-30T19:01:19.197700] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T19:01:19.697509] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-30T19:01:19.982560] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T19:01:20.497513] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-30T19:01:20.804550] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T19:01:21.297501] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-30T19:01:21.613143] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T19:01:22.097517] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-30T19:01:22.452940] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T19:01:22.897497] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-30T19:01:23.291822] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T19:01:23.697496] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-30T19:01:24.103929] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T19:01:24.111797] [INFO ] [REMOTE ] GNK: Full fetch complete (56932 records). [2025-10-30T19:01:24.111922] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-30T19:01:24.511269] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-30T19:01:24.531830] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-30T19:01:24.532558] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-30T19:01:24.533567] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-30T19:01:24.533784] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-30T19:01:24.535164] [DEBUG] [LOCAL ] GNK: Trimmed 56932 records to 38918 (keeping 200 days of data) [2025-10-30T19:01:24.686216] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T19:01:24.806404] [DEBUG] [LOCAL ] GNK: Primary data saved (38918 records). [2025-10-30T19:01:24.806547] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-30T19:01:24.806630] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNK took 24.5s. Estimated remaining: 3h 1m 52s. Rate: 7.8 symbols/min [2025-10-30T19:01:24.984396] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:24.993828] [DEBUG] [LOCAL ] GNT: Loaded 8617 existing records from primary storage. [2025-10-30T19:01:24.994023] [INFO ] [MAIN ] GNT: Loaded 8617 existing records. [2025-10-30T19:01:25.181005] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:25.181247] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-30T19:01:25.181315] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-30T19:01:25.181498] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-30T19:01:25.181557] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-30T19:01:25.302599] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-30T19:01:25.558530] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:25.904947] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T19:01:26.097555] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-30T19:01:26.478368] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T19:01:26.634083] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T19:01:26.897524] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-30T19:01:27.306617] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T19:01:27.697546] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-30T19:01:28.497546] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-30T19:01:28.868154] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T19:01:29.297493] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-30T19:01:29.576386] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T19:01:30.097480] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-30T19:01:30.194035] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-30T19:01:30.199571] [INFO ] [REMOTE ] GMRE: Full fetch complete (50848 records). [2025-10-30T19:01:30.199724] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-30T19:01:30.541935] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-30T19:01:30.631660] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-30T19:01:30.631750] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-30T19:01:30.632551] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-30T19:01:30.632615] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-30T19:01:30.633744] [DEBUG] [LOCAL ] GMRE: Trimmed 50848 records to 35477 (keeping 200 days of data) [2025-10-30T19:01:30.842548] [DEBUG] [LOCAL ] GMRE: Primary data saved (35477 records). [2025-10-30T19:01:30.842696] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-30T19:01:30.842785] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GMRE took 44.5s. Estimated remaining: 3h 1m 42s. Rate: 7.8 symbols/min [2025-10-30T19:01:30.903885] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-30T19:01:31.016204] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:31.062276] [DEBUG] [LOCAL ] GNW: Loaded 51221 existing records from primary storage. [2025-10-30T19:01:31.062555] [INFO ] [MAIN ] GNW: Loaded 51221 existing records. [2025-10-30T19:01:31.237929] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:31.238182] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-30T19:01:31.238241] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-30T19:01:31.238760] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-30T19:01:31.238820] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-30T19:01:31.597998] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:31.697544] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-30T19:01:32.171936] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T19:01:32.231331] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T19:01:32.497514] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-30T19:01:32.983606] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T19:01:33.297472] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-30T19:01:34.097522] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-30T19:01:34.611999] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T19:01:34.897528] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-30T19:01:35.332942] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T19:01:35.697502] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-30T19:01:36.163373] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T19:01:36.497494] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-30T19:01:37.150126] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T19:01:37.162317] [INFO ] [REMOTE ] GNL: Full fetch complete (67894 records). [2025-10-30T19:01:37.162484] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-30T19:01:37.304018] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-30T19:01:37.562219] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-30T19:01:37.562414] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-30T19:01:37.563392] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-30T19:01:37.563574] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-30T19:01:37.565255] [DEBUG] [LOCAL ] GNL: Trimmed 67894 records to 46453 (keeping 200 days of data) [2025-10-30T19:01:37.707356] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T19:01:37.870731] [DEBUG] [LOCAL ] GNL: Primary data saved (46453 records). [2025-10-30T19:01:37.870879] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-30T19:01:37.871691] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNL took 30.4s. Estimated remaining: 3h 1m 33s. Rate: 7.8 symbols/min [2025-10-30T19:01:38.053493] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:38.097048] [DEBUG] [LOCAL ] GOF: Loaded 42710 existing records from primary storage. [2025-10-30T19:01:38.097324] [INFO ] [MAIN ] GOF: Loaded 42710 existing records. [2025-10-30T19:01:38.108784] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-30T19:01:38.282301] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:38.282557] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-30T19:01:38.282626] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-30T19:01:38.283254] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-30T19:01:38.283327] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-30T19:01:38.650894] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:38.686613] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-30T19:01:38.739928] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T19:01:38.897508] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-30T19:01:39.697489] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-30T19:01:40.311068] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T19:01:40.497496] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-30T19:01:40.933625] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T19:01:41.297551] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-30T19:01:41.510463] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T19:01:42.097503] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-30T19:01:42.547862] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T19:01:42.583050] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-30T19:01:42.897517] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-30T19:01:43.697516] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-30T19:01:44.124946] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T19:01:44.497520] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-30T19:01:44.928741] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T19:01:44.948257] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-30T19:01:45.297546] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-30T19:01:46.097564] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-30T19:01:46.559760] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T19:01:46.587096] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T19:01:46.897541] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-30T19:01:47.697559] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-30T19:01:48.179187] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T19:01:48.497488] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-30T19:01:48.993445] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:01:49.297508] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-30T19:01:49.856541] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T19:01:49.866810] [INFO ] [REMOTE ] GNRC: Full fetch complete (65828 records). [2025-10-30T19:01:49.866930] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-30T19:01:49.985882] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-30T19:01:50.009446] [INFO ] [REMOTE ] GNT: Full fetch complete (11520 records). [2025-10-30T19:01:50.027119] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-30T19:01:50.102619] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-30T19:01:50.570686] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-30T19:01:50.571040] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-30T19:01:50.571925] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-30T19:01:50.582479] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-30T19:01:50.630083] [DEBUG] [LOCAL ] GNRC: Trimmed 65828 records to 45582 (keeping 200 days of data) [2025-10-30T19:01:50.653978] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-30T19:01:50.654068] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-30T19:01:50.654288] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-30T19:01:50.654368] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-30T19:01:50.655095] [DEBUG] [LOCAL ] GNT: Trimmed 11520 records to 8662 (keeping 200 days of data) [2025-10-30T19:01:50.807278] [DEBUG] [LOCAL ] GNT: Primary data saved (8662 records). [2025-10-30T19:01:50.811987] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-30T19:01:50.814897] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GNT took 26.0s. Estimated remaining: 3h 1m 33s. Rate: 7.8 symbols/min [2025-10-30T19:01:50.903869] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-30T19:01:51.105552] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:51.168682] [DEBUG] [LOCAL ] GNRC: Primary data saved (45582 records). [2025-10-30T19:01:51.168814] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-30T19:01:51.169363] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GNRC took 36.5s. Estimated remaining: 3h 1m 15s. Rate: 7.8 symbols/min [2025-10-30T19:01:51.289117] [DEBUG] [LOCAL ] GOLF: Loaded 29569 existing records from primary storage. [2025-10-30T19:01:51.290136] [INFO ] [MAIN ] GOLF: Loaded 29569 existing records. [2025-10-30T19:01:51.444773] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:01:51.560179] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:51.561611] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-30T19:01:51.561908] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-30T19:01:51.579126] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-30T19:01:51.589959] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-30T19:01:51.633494] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T19:01:51.701033] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-30T19:01:51.731078] [DEBUG] [LOCAL ] GOOS: Loaded 43547 existing records from primary storage. [2025-10-30T19:01:51.732791] [INFO ] [MAIN ] GOOS: Loaded 43547 existing records. [2025-10-30T19:01:52.148009] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:01:52.219661] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:52.220007] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-30T19:01:52.220377] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-30T19:01:52.221050] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-30T19:01:52.221125] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-30T19:01:52.531029] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-30T19:01:52.619698] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-30T19:01:52.624111] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:01:52.976502] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T19:01:53.297469] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-30T19:01:53.410156] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T19:01:54.097488] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-30T19:01:54.485277] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T19:01:54.897517] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-30T19:01:55.141418] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T19:01:55.697511] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-30T19:01:55.929449] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T19:01:56.497515] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-30T19:01:56.755832] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:01:57.297497] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-30T19:01:57.590567] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T19:01:58.097499] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-30T19:01:58.286057] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T19:01:58.897536] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-30T19:01:59.133598] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T19:01:59.697520] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-30T19:02:00.135858] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T19:02:00.497507] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-30T19:02:01.138306] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T19:02:01.297488] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-30T19:02:02.097523] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-30T19:02:02.138241] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-30T19:02:02.790446] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T19:02:02.897479] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-30T19:02:03.485399] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T19:02:03.697472] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-30T19:02:04.083528] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T19:02:04.497499] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-30T19:02:04.873430] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T19:02:05.297496] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-30T19:02:05.835407] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-30T19:02:05.846343] [INFO ] [REMOTE ] GNW: Full fetch complete (73860 records). [2025-10-30T19:02:05.846517] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-30T19:02:06.102774] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-30T19:02:06.233973] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-30T19:02:06.234056] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-30T19:02:06.234958] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-30T19:02:06.235022] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-30T19:02:06.236581] [DEBUG] [LOCAL ] GNW: Trimmed 73860 records to 51584 (keeping 200 days of data) [2025-10-30T19:02:06.534368] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T19:02:06.559007] [DEBUG] [LOCAL ] GNW: Primary data saved (51584 records). [2025-10-30T19:02:06.559448] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-30T19:02:06.559549] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GNW took 35.7s. Estimated remaining: 3h 1m 18s. Rate: 7.8 symbols/min [2025-10-30T19:02:06.728825] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:02:06.760994] [DEBUG] [LOCAL ] GOTU: Loaded 36497 existing records from primary storage. [2025-10-30T19:02:06.761261] [INFO ] [MAIN ] GOTU: Loaded 36497 existing records. [2025-10-30T19:02:06.902621] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-30T19:02:06.940262] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:02:06.940509] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-30T19:02:06.940562] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-30T19:02:06.940944] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-30T19:02:06.941001] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-30T19:02:07.317416] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:02:07.697506] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-30T19:02:07.915712] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T19:02:08.077523] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-30T19:02:08.089016] [INFO ] [REMOTE ] GOF: Full fetch complete (62949 records). [2025-10-30T19:02:08.089243] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-30T19:02:08.498747] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-30T19:02:08.499981] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-30T19:02:08.500071] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-30T19:02:08.500893] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-30T19:02:08.501066] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-30T19:02:08.502283] [DEBUG] [LOCAL ] GOF: Trimmed 62949 records to 43073 (keeping 200 days of data) [2025-10-30T19:02:08.747745] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T19:02:08.801226] [DEBUG] [LOCAL ] GOF: Primary data saved (43073 records). [2025-10-30T19:02:08.801349] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-30T19:02:08.802341] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GOF took 30.9s. Estimated remaining: 3h 1m 3s. Rate: 7.8 symbols/min [2025-10-30T19:02:08.965682] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:02:09.012561] [DEBUG] [LOCAL ] GPC: Loaded 45708 existing records from primary storage. [2025-10-30T19:02:09.012879] [INFO ] [MAIN ] GPC: Loaded 45708 existing records. [2025-10-30T19:02:09.184082] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:02:09.184304] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-30T19:02:09.184352] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-30T19:02:09.184551] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-30T19:02:09.184605] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-30T19:02:09.302757] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-30T19:02:09.551591] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:02:09.563046] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:02:10.097537] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-30T19:02:10.483856] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T19:02:10.897488] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-30T19:02:11.195855] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:02:11.697494] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-30T19:02:11.789303] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T19:02:12.497508] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-30T19:02:12.927344] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T19:02:13.297500] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-30T19:02:13.359053] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-30T19:02:14.097506] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-30T19:02:14.385741] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T19:02:14.897535] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-30T19:02:15.534011] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T19:02:15.697491] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-30T19:02:16.123175] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T19:02:16.497481] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-30T19:02:16.966158] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T19:02:17.297500] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-30T19:02:17.592094] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T19:02:18.102381] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-30T19:02:18.104399] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T19:02:18.897487] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-30T19:02:19.255377] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-30T19:02:19.263922] [INFO ] [REMOTE ] GOOS: Full fetch complete (64508 records). [2025-10-30T19:02:19.264035] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-30T19:02:19.654220] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-30T19:02:19.654315] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-30T19:02:19.655129] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-30T19:02:19.655191] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-30T19:02:19.656443] [DEBUG] [LOCAL ] GOOS: Trimmed 64508 records to 43816 (keeping 200 days of data) [2025-10-30T19:02:19.707115] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-30T19:02:19.912818] [DEBUG] [LOCAL ] GOOS: Primary data saved (43816 records). [2025-10-30T19:02:19.912940] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-30T19:02:19.913019] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GOOS took 28.7s. Estimated remaining: 3h 1m 0s. Rate: 7.8 symbols/min [2025-10-30T19:02:20.092006] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:02:20.108093] [DEBUG] [LOCAL ] GPI: Loaded 14680 existing records from primary storage. [2025-10-30T19:02:20.108440] [INFO ] [MAIN ] GPI: Loaded 14680 existing records. [2025-10-30T19:02:20.330546] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:02:20.330894] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-30T19:02:20.331075] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-30T19:02:20.331426] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-30T19:02:20.331510] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-30T19:02:20.488850] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-30T19:02:20.500545] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-30T19:02:20.948165] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:02:20.963063] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T19:02:21.297553] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-30T19:02:21.731052] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T19:02:21.736924] [INFO ] [REMOTE ] GOLF: Full fetch complete (45265 records). [2025-10-30T19:02:21.737055] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-30T19:02:22.109494] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-30T19:02:22.126613] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-30T19:02:22.126728] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-30T19:02:22.127412] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-30T19:02:22.127591] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-30T19:02:22.128627] [DEBUG] [LOCAL ] GOLF: Trimmed 45265 records to 29771 (keeping 200 days of data) [2025-10-30T19:02:22.310050] [DEBUG] [LOCAL ] GOLF: Primary data saved (29771 records). [2025-10-30T19:02:22.310186] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-30T19:02:22.310262] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GOLF took 31.5s. Estimated remaining: 3h 0m 45s. Rate: 7.8 symbols/min [2025-10-30T19:02:22.488252] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:02:22.493742] [DEBUG] [LOCAL ] GPJA: Loaded 4032 existing records from primary storage. [2025-10-30T19:02:22.493930] [INFO ] [MAIN ] GPJA: Loaded 4032 existing records. [2025-10-30T19:02:22.671667] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:02:22.671964] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-30T19:02:22.672029] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-30T19:02:22.672260] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-30T19:02:22.672432] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-30T19:02:22.878592] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-30T19:02:22.928018] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-30T19:02:23.078891] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:02:23.108819] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T19:02:23.660844] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-30T19:02:23.697489] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-30T19:02:24.497478] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-30T19:02:24.616860] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T19:02:25.297526] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-30T19:02:25.698987] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T19:02:25.821154] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-30T19:02:26.097504] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-30T19:02:26.897526] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-30T19:02:27.224568] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T19:02:27.556218] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T19:02:27.697497] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-30T19:02:28.487354] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-30T19:02:28.497452] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-30T19:02:29.213419] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-30T19:02:29.297460] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-30T19:02:29.845545] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-30T19:02:30.097547] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-30T19:02:30.897484] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-30T19:02:31.251335] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-30T19:02:31.359100] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T19:02:31.697530] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-30T19:02:32.497501] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-30T19:02:32.703469] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T19:02:32.826781] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T19:02:33.297505] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-30T19:02:33.646846] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-30T19:02:34.097533] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-30T19:02:34.370105] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-30T19:02:34.897732] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-30T19:02:35.519295] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-30T19:02:35.697518] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-30T19:02:36.497591] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-30T19:02:36.846235] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:02:37.297677] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-30T19:02:37.324806] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-30T19:02:37.674437] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-30T19:02:38.097751] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-30T19:02:38.897545] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-30T19:02:39.261128] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-30T19:02:39.326998] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T19:02:39.339000] [INFO ] [REMOTE ] GPC: Full fetch complete (68545 records). [2025-10-30T19:02:39.339156] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-30T19:02:39.702626] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-30T19:02:39.747537] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-30T19:02:39.747621] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-30T19:02:39.748488] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-30T19:02:39.748542] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-30T19:02:39.749848] [DEBUG] [LOCAL ] GPC: Trimmed 68545 records to 46012 (keeping 200 days of data) [2025-10-30T19:02:40.033373] [DEBUG] [LOCAL ] GPC: Primary data saved (46012 records). [2025-10-30T19:02:40.033713] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-30T19:02:40.034534] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GPC took 31.2s. Estimated remaining: 3h 0m 52s. Rate: 7.8 symbols/min [2025-10-30T19:02:40.218916] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-30T19:02:40.246417] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:02:40.300888] [DEBUG] [LOCAL ] GPK: Loaded 52759 existing records from primary storage. [2025-10-30T19:02:40.301220] [INFO ] [MAIN ] GPK: Loaded 52759 existing records. [2025-10-30T19:02:40.499702] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-30T19:02:40.529052] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:02:40.529296] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-30T19:02:40.529371] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-30T19:02:40.529724] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-30T19:02:40.529781] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-30T19:02:40.897482] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:02:41.003745] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T19:02:41.297474] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-30T19:02:42.097495] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-30T19:02:42.342767] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T19:02:42.486782] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-30T19:02:42.487940] [INFO ] [REMOTE ] GPJA: Full fetch complete (6718 records). [2025-10-30T19:02:42.488009] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-30T19:02:42.864687] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-30T19:02:42.864818] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-30T19:02:42.865064] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-30T19:02:42.865122] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-30T19:02:42.865516] [DEBUG] [LOCAL ] GPJA: Trimmed 6718 records to 4055 (keeping 200 days of data) [2025-10-30T19:02:42.889328] [DEBUG] [LOCAL ] GPJA: Primary data saved (4055 records). [2025-10-30T19:02:42.889415] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-30T19:02:42.889490] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GPJA took 20.6s. Estimated remaining: 3h 0m 37s. Rate: 7.8 symbols/min [2025-10-30T19:02:42.897455] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-30T19:02:43.582976] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-30T19:02:43.697519] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-30T19:02:44.354372] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-30T19:02:44.497533] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-30T19:02:45.246179] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-30T19:02:45.297537] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-30T19:02:46.097523] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-30T19:02:46.495334] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T19:02:46.897539] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-30T19:02:47.152326] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T19:02:47.697546] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-30T19:02:47.823461] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T19:02:47.828228] [INFO ] [REMOTE ] GPI: Full fetch complete (22328 records). [2025-10-30T19:02:47.828314] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-30T19:02:48.195828] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-30T19:02:48.195908] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-30T19:02:48.196389] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-30T19:02:48.196455] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-30T19:02:48.197082] [DEBUG] [LOCAL ] GPI: Trimmed 22328 records to 14834 (keeping 200 days of data) [2025-10-30T19:02:48.288206] [DEBUG] [LOCAL ] GPI: Primary data saved (14834 records). [2025-10-30T19:02:48.288337] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-30T19:02:48.288412] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GPI took 28.4s. Estimated remaining: 3h 0m 26s. Rate: 7.8 symbols/min [2025-10-30T19:02:48.497568] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-30T19:02:48.813991] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T19:02:49.297575] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-30T19:02:49.435392] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T19:02:49.443543] [INFO ] [REMOTE ] GOTU: Full fetch complete (57686 records). [2025-10-30T19:02:49.443736] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-30T19:02:49.850805] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-30T19:02:49.850895] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-30T19:02:49.851674] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-30T19:02:49.851739] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-30T19:02:49.852928] [DEBUG] [LOCAL ] GOTU: Trimmed 57686 records to 36712 (keeping 200 days of data) [2025-10-30T19:02:50.055415] [DEBUG] [LOCAL ] GOTU: Primary data saved (36712 records). [2025-10-30T19:02:50.055551] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-30T19:02:50.055629] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GOTU took 43.5s. Estimated remaining: 3h 0m 9s. Rate: 7.8 symbols/min [2025-10-30T19:02:50.454823] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T19:02:50.466748] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-30T19:02:51.819538] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T19:02:51.831156] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-30T19:02:52.918747] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T19:02:52.930498] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-30T19:02:54.084902] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:02:54.097434] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-30T19:02:55.294747] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T19:02:55.306316] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-30T19:02:56.455038] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T19:02:56.471319] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-30T19:02:57.761031] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T19:02:57.773415] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-30T19:02:59.292513] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T19:02:59.304430] [INFO ] [REMOTE ] GPK: Full fetch complete (76163 records). [2025-10-30T19:02:59.304599] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-30T19:02:59.711018] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-30T19:02:59.711107] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-30T19:02:59.712027] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-30T19:02:59.712095] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-30T19:02:59.713563] [DEBUG] [LOCAL ] GPK: Trimmed 76163 records to 53148 (keeping 200 days of data) [2025-10-30T19:03:00.041969] [DEBUG] [LOCAL ] GPK: Primary data saved (53148 records). [2025-10-30T19:03:00.042124] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-30T19:03:00.042208] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GPK took 20.0s. Estimated remaining: 3h 0m 5s. Rate: 7.8 symbols/min [2025-10-30T19:03:00.632710] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:00.652358] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:00.828391] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:00.830836] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:00.875348] [DEBUG] [LOCAL ] GPOR: Loaded 23396 existing records from primary storage. [2025-10-30T19:03:00.884392] [INFO ] [MAIN ] GPOR: Loaded 23396 existing records. [2025-10-30T19:03:00.914617] [DEBUG] [LOCAL ] GPMT: Loaded 25299 existing records from primary storage. [2025-10-30T19:03:00.979530] [INFO ] [MAIN ] GPMT: Loaded 25299 existing records. [2025-10-30T19:03:01.111255] [DEBUG] [LOCAL ] GPRK: Loaded 40004 existing records from primary storage. [2025-10-30T19:03:01.142563] [DEBUG] [LOCAL ] GPN: Loaded 51694 existing records from primary storage. [2025-10-30T19:03:01.155348] [INFO ] [MAIN ] GPRK: Loaded 40004 existing records. [2025-10-30T19:03:01.165890] [INFO ] [MAIN ] GPN: Loaded 51694 existing records. [2025-10-30T19:03:01.293197] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:01.402314] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-30T19:03:01.455398] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-30T19:03:01.539691] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-30T19:03:01.554519] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-30T19:03:01.620810] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:01.769191] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-30T19:03:01.769047] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:01.792893] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-30T19:03:01.792713] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:01.803669] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-30T19:03:01.803871] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-30T19:03:01.810492] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-30T19:03:01.835460] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-30T19:03:01.835708] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-30T19:03:01.835771] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-30T19:03:01.927314] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-30T19:03:01.937912] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-30T19:03:01.948537] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-30T19:03:01.948718] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-30T19:03:02.975602] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:03.158241] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:03.056945] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-30T19:03:03.189602] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-30T19:03:03.316218] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:03.380784] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-30T19:03:03.386849] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:03.387265] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-30T19:03:04.170531] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T19:03:04.176685] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-30T19:03:04.222957] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T19:03:04.227982] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-30T19:03:04.513831] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T19:03:04.522585] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-30T19:03:04.562913] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T19:03:04.573018] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-30T19:03:04.918486] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-30T19:03:04.925824] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-30T19:03:05.010236] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T19:03:05.017611] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-30T19:03:05.636616] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T19:03:05.645415] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-30T19:03:05.738876] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T19:03:05.747400] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-30T19:03:05.850250] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T19:03:05.860398] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-30T19:03:05.895071] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-30T19:03:06.097520] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-30T19:03:06.713966] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T19:03:06.756968] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T19:03:06.897486] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-30T19:03:06.979593] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-30T19:03:07.176923] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T19:03:07.697465] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-30T19:03:07.842747] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-30T19:03:08.462455] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T19:03:08.497586] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-30T19:03:09.297581] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-30T19:03:09.647827] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T19:03:09.911126] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-30T19:03:10.097494] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-30T19:03:10.897518] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-30T19:03:11.640165] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T19:03:11.697506] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-30T19:03:12.006627] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T19:03:12.497492] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-30T19:03:13.125812] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T19:03:13.297526] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-30T19:03:13.782308] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T19:03:14.097465] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-30T19:03:14.200632] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-30T19:03:14.897469] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-30T19:03:14.983725] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-30T19:03:15.585795] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-30T19:03:15.697514] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-30T19:03:16.360762] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T19:03:16.497503] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-30T19:03:17.297498] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-30T19:03:17.504035] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T19:03:17.508533] [INFO ] [REMOTE ] GPMT: Full fetch complete (35842 records). [2025-10-30T19:03:17.508675] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-30T19:03:17.897408] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-30T19:03:17.897505] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-30T19:03:17.898125] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-30T19:03:17.898187] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-30T19:03:17.898989] [DEBUG] [LOCAL ] GPMT: Trimmed 35842 records to 25410 (keeping 200 days of data) [2025-10-30T19:03:18.045737] [DEBUG] [LOCAL ] GPMT: Primary data saved (25410 records). [2025-10-30T19:03:18.045864] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-30T19:03:18.045961] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GPMT took 18.0s. Estimated remaining: 3h 0m 12s. Rate: 7.8 symbols/min [2025-10-30T19:03:18.102785] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-30T19:03:18.236763] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:18.253410] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T19:03:18.280470] [DEBUG] [LOCAL ] GRBK: Loaded 26181 existing records from primary storage. [2025-10-30T19:03:18.280763] [INFO ] [MAIN ] GRBK: Loaded 26181 existing records. [2025-10-30T19:03:18.457742] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:18.457971] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-30T19:03:18.458021] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-30T19:03:18.458504] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-30T19:03:18.458569] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-30T19:03:18.810997] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:18.897471] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-30T19:03:19.644276] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-30T19:03:19.697579] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-30T19:03:19.881596] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T19:03:20.497411] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-30T19:03:20.612113] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-30T19:03:21.297494] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-30T19:03:21.348567] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-30T19:03:22.097556] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-30T19:03:22.651367] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T19:03:22.660228] [INFO ] [REMOTE ] GPOR: Full fetch complete (34761 records). [2025-10-30T19:03:22.660378] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-30T19:03:22.907111] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-30T19:03:23.049538] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-30T19:03:23.049743] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-30T19:03:23.050680] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-30T19:03:23.050765] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-30T19:03:23.051831] [DEBUG] [LOCAL ] GPOR: Trimmed 34761 records to 23510 (keeping 200 days of data) [2025-10-30T19:03:23.169963] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T19:03:23.234681] [DEBUG] [LOCAL ] GPOR: Primary data saved (23510 records). [2025-10-30T19:03:23.234823] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-30T19:03:23.234907] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPOR took 23.2s. Estimated remaining: 3h 0m 1s. Rate: 7.8 symbols/min [2025-10-30T19:03:23.409411] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:23.419408] [DEBUG] [LOCAL ] GRC: Loaded 9341 existing records from primary storage. [2025-10-30T19:03:23.419608] [INFO ] [MAIN ] GRC: Loaded 9341 existing records. [2025-10-30T19:03:23.595247] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:23.595462] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-30T19:03:23.595508] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-30T19:03:23.595739] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-30T19:03:23.595796] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-30T19:03:23.702737] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-30T19:03:23.963107] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:23.979541] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T19:03:24.497507] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-30T19:03:25.086542] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T19:03:25.106030] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T19:03:25.297464] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-30T19:03:26.097514] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-30T19:03:26.286428] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T19:03:26.897546] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-30T19:03:27.125254] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T19:03:27.697513] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-30T19:03:28.146936] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T19:03:28.498188] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-30T19:03:28.499589] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T19:03:29.297495] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-30T19:03:29.778473] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T19:03:30.097474] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-30T19:03:30.190889] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T19:03:30.897496] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-30T19:03:31.059861] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T19:03:31.546387] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T19:03:31.697520] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-30T19:03:32.172430] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T19:03:32.497484] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-30T19:03:33.297482] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-30T19:03:33.407562] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T19:03:33.773698] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-30T19:03:34.097494] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-30T19:03:34.897510] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-30T19:03:35.499431] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-30T19:03:35.706753] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-30T19:03:35.712428] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T19:03:35.723961] [INFO ] [REMOTE ] GPN: Full fetch complete (74979 records). [2025-10-30T19:03:35.724089] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-30T19:03:36.152100] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-30T19:03:36.152196] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-30T19:03:36.153188] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-30T19:03:36.153253] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-30T19:03:36.154666] [DEBUG] [LOCAL ] GPN: Trimmed 74979 records to 52081 (keeping 200 days of data) [2025-10-30T19:03:36.471772] [DEBUG] [LOCAL ] GPN: Primary data saved (52081 records). [2025-10-30T19:03:36.471910] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-30T19:03:36.472558] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPN took 36.4s. Estimated remaining: 3h 0m 1s. Rate: 7.8 symbols/min [2025-10-30T19:03:36.503145] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-30T19:03:36.657981] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:36.697982] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T19:03:36.723707] [DEBUG] [LOCAL ] GRDN: Loaded 21743 existing records from primary storage. [2025-10-30T19:03:36.723997] [INFO ] [MAIN ] GRDN: Loaded 21743 existing records. [2025-10-30T19:03:36.901503] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:36.901752] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-30T19:03:36.901806] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-30T19:03:36.901987] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-30T19:03:36.902024] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-30T19:03:37.247245] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:37.297456] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-30T19:03:37.387146] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T19:03:37.815395] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-30T19:03:38.097522] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-30T19:03:38.897564] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-30T19:03:39.418324] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T19:03:39.450743] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T19:03:39.460944] [INFO ] [REMOTE ] GPRK: Full fetch complete (58709 records). [2025-10-30T19:03:39.461105] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-30T19:03:39.702772] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-30T19:03:39.856014] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-30T19:03:39.856099] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-30T19:03:39.856913] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-30T19:03:39.856977] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-30T19:03:39.858205] [DEBUG] [LOCAL ] GPRK: Trimmed 58709 records to 40388 (keeping 200 days of data) [2025-10-30T19:03:40.080863] [DEBUG] [LOCAL ] GPRK: Primary data saved (40388 records). [2025-10-30T19:03:40.080977] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-30T19:03:40.081978] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPRK took 40.0s. Estimated remaining: 2h 59m 48s. Rate: 7.8 symbols/min [2025-10-30T19:03:40.251171] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:40.291304] [DEBUG] [LOCAL ] GRMN: Loaded 39407 existing records from primary storage. [2025-10-30T19:03:40.291622] [INFO ] [MAIN ] GRMN: Loaded 39407 existing records. [2025-10-30T19:03:40.472846] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:40.473060] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-30T19:03:40.473108] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-30T19:03:40.473394] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-30T19:03:40.473450] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-30T19:03:40.504429] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-30T19:03:40.836740] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:40.876181] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-30T19:03:40.882962] [INFO ] [REMOTE ] GRBK: Full fetch complete (39826 records). [2025-10-30T19:03:40.883121] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-30T19:03:41.012800] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T19:03:41.283718] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-30T19:03:41.283827] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-30T19:03:41.284432] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-30T19:03:41.284492] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-30T19:03:41.285329] [DEBUG] [LOCAL ] GRBK: Trimmed 39826 records to 26380 (keeping 200 days of data) [2025-10-30T19:03:41.332272] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-30T19:03:41.435755] [DEBUG] [LOCAL ] GRBK: Primary data saved (26380 records). [2025-10-30T19:03:41.435882] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-30T19:03:41.435955] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GRBK took 23.4s. Estimated remaining: 2h 59m 31s. Rate: 7.8 symbols/min [2025-10-30T19:03:41.602978] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:41.646554] [DEBUG] [LOCAL ] GRND: Loaded 50171 existing records from primary storage. [2025-10-30T19:03:41.646924] [INFO ] [MAIN ] GRND: Loaded 50171 existing records. [2025-10-30T19:03:41.825467] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:41.825736] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-30T19:03:41.825794] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-30T19:03:41.826189] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-30T19:03:41.826244] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-30T19:03:41.949811] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-30T19:03:42.102734] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-30T19:03:42.198975] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:42.635045] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-30T19:03:42.897496] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-30T19:03:43.697495] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-30T19:03:44.061138] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T19:03:44.344692] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T19:03:44.497531] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-30T19:03:45.297508] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-30T19:03:45.677206] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T19:03:46.097563] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-30T19:03:46.348871] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T19:03:46.648048] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T19:03:46.897500] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-30T19:03:47.697587] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-30T19:03:48.206574] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T19:03:48.374050] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T19:03:48.377440] [INFO ] [REMOTE ] GRC: Full fetch complete (13652 records). [2025-10-30T19:03:48.377534] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-30T19:03:48.502638] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-30T19:03:48.753091] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-30T19:03:48.753174] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-30T19:03:48.753482] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-30T19:03:48.753521] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-30T19:03:48.754075] [DEBUG] [LOCAL ] GRC: Trimmed 13652 records to 9395 (keeping 200 days of data) [2025-10-30T19:03:48.811379] [DEBUG] [LOCAL ] GRC: Primary data saved (9395 records). [2025-10-30T19:03:48.811517] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-30T19:03:48.811596] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRC took 25.6s. Estimated remaining: 2h 59m 23s. Rate: 7.8 symbols/min [2025-10-30T19:03:48.979223] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:03:49.008272] [DEBUG] [LOCAL ] GRNT: Loaded 33472 existing records from primary storage. [2025-10-30T19:03:49.008545] [INFO ] [MAIN ] GRNT: Loaded 33472 existing records. [2025-10-30T19:03:49.184009] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:03:49.184244] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-30T19:03:49.184293] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-30T19:03:49.184503] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-30T19:03:49.184542] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-30T19:03:49.303165] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-30T19:03:49.573421] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:03:49.599625] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:03:50.097516] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-30T19:03:50.326207] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T19:03:50.737271] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-30T19:03:50.897466] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-30T19:03:51.697476] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-30T19:03:51.870966] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T19:03:52.354831] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-30T19:03:52.497518] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-30T19:03:53.297526] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-30T19:03:53.720298] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T19:03:54.097549] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-30T19:03:54.306819] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T19:03:54.897524] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-30T19:03:55.571692] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T19:03:55.608146] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-30T19:03:55.697506] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-30T19:03:56.497530] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-30T19:03:56.942922] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T19:03:57.186012] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T19:03:57.297482] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-30T19:03:58.097530] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-30T19:03:58.740317] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T19:03:58.897486] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-30T19:03:59.301053] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T19:03:59.697499] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-30T19:04:00.006829] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-30T19:04:00.497495] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-30T19:04:01.180689] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-30T19:04:01.293040] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-30T19:04:01.298928] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-30T19:04:02.097494] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-30T19:04:02.507091] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T19:04:02.897472] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-30T19:04:02.983525] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T19:04:03.697493] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-30T19:04:03.863790] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T19:04:04.497545] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-30T19:04:05.015880] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-30T19:04:05.297519] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-30T19:04:05.691470] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T19:04:06.097497] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-30T19:04:06.121983] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-30T19:04:06.897497] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-30T19:04:07.697459] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-30T19:04:07.899161] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-30T19:04:07.910549] [INFO ] [REMOTE ] GRND: Full fetch complete (72153 records). [2025-10-30T19:04:07.910691] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-30T19:04:08.281251] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T19:04:08.344489] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-30T19:04:08.344567] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-30T19:04:08.345456] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-30T19:04:08.345519] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-30T19:04:08.346925] [DEBUG] [LOCAL ] GRND: Trimmed 72153 records to 50547 (keeping 200 days of data) [2025-10-30T19:04:08.506618] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-30T19:04:08.638555] [DEBUG] [LOCAL ] GRND: Primary data saved (50547 records). [2025-10-30T19:04:08.638703] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-30T19:04:08.639406] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRND took 27.2s. Estimated remaining: 2h 59m 33s. Rate: 7.8 symbols/min [2025-10-30T19:04:08.823087] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:08.842081] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T19:04:08.848096] [INFO ] [REMOTE ] GRDN: Full fetch complete (27145 records). [2025-10-30T19:04:08.851792] [DEBUG] [LOCAL ] GROV: Loaded 8732 existing records from primary storage. [2025-10-30T19:04:08.851883] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-30T19:04:08.852072] [INFO ] [MAIN ] GROV: Loaded 8732 existing records. [2025-10-30T19:04:09.227238] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:09.301556] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-30T19:04:09.314116] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-30T19:04:09.345407] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-30T19:04:09.369425] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-30T19:04:09.374631] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-30T19:04:09.510516] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-30T19:04:09.538029] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-30T19:04:09.549423] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-30T19:04:09.549675] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-30T19:04:09.624818] [DEBUG] [LOCAL ] GRDN: Trimmed 27145 records to 21901 (keeping 200 days of data) [2025-10-30T19:04:09.740224] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:04:09.948094] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:09.982117] [DEBUG] [LOCAL ] GRDN: Primary data saved (21901 records). [2025-10-30T19:04:09.982219] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-30T19:04:09.982288] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GRDN took 33.5s. Estimated remaining: 2h 59m 16s. Rate: 7.8 symbols/min [2025-10-30T19:04:10.102621] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-30T19:04:10.149834] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:10.155343] [DEBUG] [LOCAL ] GRX: Loaded 4793 existing records from primary storage. [2025-10-30T19:04:10.155585] [INFO ] [MAIN ] GRX: Loaded 4793 existing records. [2025-10-30T19:04:10.328515] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:10.328701] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-30T19:04:10.328757] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-30T19:04:10.328928] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-30T19:04:10.329008] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-30T19:04:10.686993] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:10.715966] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T19:04:10.897462] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-30T19:04:11.238330] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-30T19:04:11.259828] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T19:04:11.697490] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-30T19:04:12.497503] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-30T19:04:12.555450] [DEBUG] [REMOTE ] GROV: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-30T19:04:12.555812] [WARN ] [REMOTE ] GROV: No data returned for month 2025-01 [2025-10-30T19:04:12.555902] [FATAL] [REMOTE ] GROV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:04:12.555947] [FATAL] [MAIN ] GROV: Failed to fetch primary data. [2025-10-30T19:04:12.555980] [WARN ] [MAIN ] GROV: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:04:12.556016] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-30T19:04:12.556070] [DEBUG] [LOCAL ] GROV: No primary data file found to delete. [2025-10-30T19:04:12.556103] [INFO ] [LOCAL ] GROV: Starting deletion of derivative data. [2025-10-30T19:04:12.556287] [DEBUG] [LOCAL ] GROV: Deleted derivative data file. [2025-10-30T19:04:12.558223] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GROV took 3.9s. Estimated remaining: 2h 59m 1s. Rate: 7.8 symbols/min [2025-10-30T19:04:12.729904] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:12.784400] [DEBUG] [LOCAL ] GS: Loaded 51721 existing records from primary storage. [2025-10-30T19:04:12.796489] [INFO ] [MAIN ] GS: Loaded 51721 existing records. [2025-10-30T19:04:12.797228] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T19:04:12.980398] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:12.980604] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-30T19:04:12.980678] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-30T19:04:12.981279] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-30T19:04:12.981335] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-30T19:04:13.304986] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-30T19:04:13.335808] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:13.716831] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T19:04:14.097514] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-30T19:04:14.897534] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-30T19:04:15.301198] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-30T19:04:15.697501] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-30T19:04:15.943437] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-30T19:04:16.497492] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-30T19:04:17.134478] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T19:04:17.169505] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-30T19:04:17.297490] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-30T19:04:17.700083] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-30T19:04:18.097491] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-30T19:04:18.897452] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-30T19:04:19.176258] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T19:04:19.313930] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-30T19:04:19.697471] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-30T19:04:20.497521] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-30T19:04:20.735072] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T19:04:21.297533] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-30T19:04:21.703098] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T19:04:21.767608] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T19:04:21.775986] [INFO ] [REMOTE ] GRMN: Full fetch complete (59438 records). [2025-10-30T19:04:21.776134] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-30T19:04:22.102701] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-30T19:04:22.174060] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-30T19:04:22.174140] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-30T19:04:22.174920] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-30T19:04:22.174984] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-30T19:04:22.176128] [DEBUG] [LOCAL ] GRMN: Trimmed 59438 records to 39779 (keeping 200 days of data) [2025-10-30T19:04:22.419022] [DEBUG] [LOCAL ] GRMN: Primary data saved (39779 records). [2025-10-30T19:04:22.419171] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-30T19:04:22.420014] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GRMN took 42.3s. Estimated remaining: 2h 58m 56s. Rate: 7.8 symbols/min [2025-10-30T19:04:22.587754] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:22.624923] [DEBUG] [LOCAL ] GSBD: Loaded 39257 existing records from primary storage. [2025-10-30T19:04:22.625214] [INFO ] [MAIN ] GSBD: Loaded 39257 existing records. [2025-10-30T19:04:22.799105] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:22.799373] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-30T19:04:22.799423] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-30T19:04:22.799605] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-30T19:04:22.799671] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-30T19:04:22.902720] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-30T19:04:23.147011] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:23.402574] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-30T19:04:23.697523] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-30T19:04:24.016231] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-30T19:04:24.497550] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-30T19:04:25.235760] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-30T19:04:25.243040] [INFO ] [REMOTE ] GRNT: Full fetch complete (48119 records). [2025-10-30T19:04:25.243167] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-30T19:04:25.306184] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-30T19:04:25.631465] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-30T19:04:25.631577] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-30T19:04:25.632420] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-30T19:04:25.632583] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-30T19:04:25.639735] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T19:04:25.642950] [DEBUG] [LOCAL ] GRNT: Trimmed 48119 records to 33700 (keeping 200 days of data) [2025-10-30T19:04:25.828546] [DEBUG] [LOCAL ] GRNT: Primary data saved (33700 records). [2025-10-30T19:04:25.828689] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-30T19:04:25.828777] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GRNT took 37.0s. Estimated remaining: 2h 58m 42s. Rate: 7.8 symbols/min [2025-10-30T19:04:25.995133] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:26.043378] [DEBUG] [LOCAL ] GSK: Loaded 53510 existing records from primary storage. [2025-10-30T19:04:26.043719] [INFO ] [MAIN ] GSK: Loaded 53510 existing records. [2025-10-30T19:04:26.105354] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-30T19:04:26.218503] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:26.218726] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-30T19:04:26.218780] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-30T19:04:26.219339] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-30T19:04:26.219394] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-30T19:04:26.580579] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:26.651731] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-30T19:04:26.653245] [INFO ] [REMOTE ] GRX: Full fetch complete (6525 records). [2025-10-30T19:04:26.653311] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-30T19:04:26.902543] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-30T19:04:27.007558] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T19:04:27.047911] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-30T19:04:27.047967] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-30T19:04:27.048132] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-30T19:04:27.048169] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-30T19:04:27.048526] [DEBUG] [LOCAL ] GRX: Trimmed 6525 records to 4815 (keeping 200 days of data) [2025-10-30T19:04:27.075363] [DEBUG] [LOCAL ] GRX: Primary data saved (4815 records). [2025-10-30T19:04:27.075425] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-30T19:04:27.075488] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GRX took 17.1s. Estimated remaining: 2h 58m 25s. Rate: 7.8 symbols/min [2025-10-30T19:04:27.240183] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:27.270074] [DEBUG] [LOCAL ] GSL: Loaded 32488 existing records from primary storage. [2025-10-30T19:04:27.270318] [INFO ] [MAIN ] GSL: Loaded 32488 existing records. [2025-10-30T19:04:27.441999] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:27.442173] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-30T19:04:27.442218] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-30T19:04:27.442417] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-30T19:04:27.442471] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-30T19:04:27.704280] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-30T19:04:27.790995] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:28.497467] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-30T19:04:28.634316] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-30T19:04:29.297549] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-30T19:04:29.341993] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-30T19:04:29.520801] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T19:04:30.097502] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-30T19:04:30.897494] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-30T19:04:31.137623] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-30T19:04:31.697466] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-30T19:04:31.818635] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T19:04:31.863704] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-30T19:04:32.497544] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-30T19:04:32.733811] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-30T19:04:33.297498] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-30T19:04:34.051403] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-30T19:04:34.097489] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-30T19:04:34.404816] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T19:04:34.897475] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-30T19:04:35.697495] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-30T19:04:35.952326] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-30T19:04:36.267577] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T19:04:36.497509] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-30T19:04:36.824530] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T19:04:37.297494] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-30T19:04:37.823551] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T19:04:38.097481] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-30T19:04:38.402573] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T19:04:38.897495] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-30T19:04:39.607328] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-30T19:04:39.697454] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-30T19:04:39.830626] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T19:04:40.497460] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-30T19:04:41.149409] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T19:04:41.297452] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-30T19:04:41.694030] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T19:04:42.097528] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-30T19:04:42.865123] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T19:04:42.897458] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-30T19:04:43.697501] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-30T19:04:43.746492] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-30T19:04:44.502922] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-30T19:04:44.523031] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-30T19:04:44.676700] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T19:04:45.297501] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-30T19:04:46.097509] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-30T19:04:46.246541] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-30T19:04:46.428283] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-30T19:04:46.897471] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-30T19:04:47.150561] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T19:04:47.697494] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-30T19:04:47.968868] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:04:48.497563] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-30T19:04:49.297516] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-30T19:04:49.406806] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-30T19:04:49.474064] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T19:04:50.097547] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-30T19:04:50.805993] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T19:04:50.897508] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-30T19:04:51.697569] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-30T19:04:51.780056] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-30T19:04:52.072390] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T19:04:52.497501] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-30T19:04:52.906974] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T19:04:52.914142] [INFO ] [REMOTE ] GSL: Full fetch complete (48257 records). [2025-10-30T19:04:52.914240] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-30T19:04:53.288586] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-30T19:04:53.288710] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-30T19:04:53.289412] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-30T19:04:53.289457] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-30T19:04:53.290563] [DEBUG] [LOCAL ] GSL: Trimmed 48257 records to 32670 (keeping 200 days of data) [2025-10-30T19:04:53.343635] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-30T19:04:53.489561] [DEBUG] [LOCAL ] GSL: Primary data saved (32670 records). [2025-10-30T19:04:53.489739] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-30T19:04:53.490312] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GSL took 26.4s. Estimated remaining: 2h 58m 45s. Rate: 7.8 symbols/min [2025-10-30T19:04:53.658716] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:53.706008] [DEBUG] [LOCAL ] GTES: Loaded 50233 existing records from primary storage. [2025-10-30T19:04:53.706343] [INFO ] [MAIN ] GTES: Loaded 50233 existing records. [2025-10-30T19:04:53.884413] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:53.884702] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-30T19:04:53.884762] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-30T19:04:53.885091] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-30T19:04:53.885147] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-30T19:04:54.120750] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-30T19:04:54.269242] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:54.396089] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T19:04:54.474685] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-30T19:04:54.486218] [INFO ] [REMOTE ] GS: Full fetch complete (75815 records). [2025-10-30T19:04:54.486435] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-30T19:04:54.871200] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-30T19:04:54.871278] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-30T19:04:54.872171] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-30T19:04:54.872233] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-30T19:04:54.873606] [DEBUG] [LOCAL ] GS: Trimmed 75815 records to 52100 (keeping 200 days of data) [2025-10-30T19:04:54.930157] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-30T19:04:55.195322] [DEBUG] [LOCAL ] GS: Primary data saved (52100 records). [2025-10-30T19:04:55.195465] [INFO ] [MAIN ] GS: Full history saved. [2025-10-30T19:04:55.196268] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GS took 42.6s. Estimated remaining: 2h 58m 28s. Rate: 7.8 symbols/min [2025-10-30T19:04:55.366742] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:55.410816] [DEBUG] [LOCAL ] GTLS: Loaded 42780 existing records from primary storage. [2025-10-30T19:04:55.411097] [INFO ] [MAIN ] GTLS: Loaded 42780 existing records. [2025-10-30T19:04:55.594086] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:55.594269] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-30T19:04:55.594317] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-30T19:04:55.594630] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-30T19:04:55.594710] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-30T19:04:55.704496] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-30T19:04:55.980870] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:56.017705] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-30T19:04:56.029418] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-10-30T19:04:56.029569] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-30T19:04:56.455384] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-30T19:04:56.456782] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-30T19:04:56.456703] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-30T19:04:56.457971] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-30T19:04:56.466476] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-30T19:04:56.468319] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 53900 (keeping 200 days of data) [2025-10-30T19:04:56.522326] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-30T19:04:56.793596] [DEBUG] [LOCAL ] GSK: Primary data saved (53900 records). [2025-10-30T19:04:56.793767] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-30T19:04:56.793851] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSK took 31.0s. Estimated remaining: 2h 58m 12s. Rate: 7.8 symbols/min [2025-10-30T19:04:56.970514] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:57.000071] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T19:04:57.046929] [DEBUG] [LOCAL ] GTN: Loaded 44308 existing records from primary storage. [2025-10-30T19:04:57.047229] [INFO ] [MAIN ] GTN: Loaded 44308 existing records. [2025-10-30T19:04:57.222539] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:57.222772] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-30T19:04:57.222824] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-30T19:04:57.223139] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-30T19:04:57.223196] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-30T19:04:57.302696] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-30T19:04:57.602307] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:58.082113] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T19:04:58.092183] [INFO ] [REMOTE ] GSBD: Full fetch complete (58479 records). [2025-10-30T19:04:58.092303] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-30T19:04:58.104613] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-30T19:04:58.479456] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-30T19:04:58.479689] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-30T19:04:58.480551] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-30T19:04:58.480681] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-30T19:04:58.482235] [DEBUG] [LOCAL ] GSBD: Trimmed 58479 records to 39607 (keeping 200 days of data) [2025-10-30T19:04:58.718290] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-30T19:04:58.761733] [DEBUG] [LOCAL ] GSBD: Primary data saved (39607 records). [2025-10-30T19:04:58.761874] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-30T19:04:58.761956] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GSBD took 36.3s. Estimated remaining: 2h 57m 56s. Rate: 7.8 symbols/min [2025-10-30T19:04:58.911455] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-30T19:04:58.945429] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:04:58.974745] [DEBUG] [LOCAL ] GTY: Loaded 29630 existing records from primary storage. [2025-10-30T19:04:58.975031] [INFO ] [MAIN ] GTY: Loaded 29630 existing records. [2025-10-30T19:04:59.151635] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:04:59.151865] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-30T19:04:59.151916] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-30T19:04:59.152143] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-30T19:04:59.152200] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-30T19:04:59.527170] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:04:59.549948] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T19:04:59.697501] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-30T19:05:00.185872] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T19:05:00.497533] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-30T19:05:00.800249] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:05:01.297547] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-30T19:05:02.097563] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-30T19:05:02.739163] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-30T19:05:02.897550] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-30T19:05:03.234304] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T19:05:03.445100] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-30T19:05:03.697559] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-30T19:05:04.170725] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T19:05:04.497504] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-30T19:05:04.627283] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T19:05:05.297515] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-30T19:05:06.036276] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T19:05:06.097506] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-30T19:05:06.508911] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T19:05:06.897500] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-30T19:05:07.455242] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T19:05:07.697535] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-30T19:05:08.051099] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T19:05:08.497492] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-30T19:05:08.821276] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T19:05:09.297491] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-30T19:05:09.725318] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:05:10.097524] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-30T19:05:10.319507] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T19:05:10.897499] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-30T19:05:11.146895] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T19:05:11.697508] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-30T19:05:12.045268] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T19:05:12.497518] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-30T19:05:12.722362] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T19:05:13.297513] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-30T19:05:13.925791] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T19:05:14.097486] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-30T19:05:14.365547] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-30T19:05:14.897493] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-30T19:05:15.403783] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T19:05:15.697497] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-30T19:05:16.141926] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T19:05:16.497491] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-30T19:05:16.738975] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:05:17.297562] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-30T19:05:17.923586] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T19:05:18.097510] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-30T19:05:18.771686] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T19:05:18.780839] [INFO ] [REMOTE ] GTLS: Full fetch complete (61365 records). [2025-10-30T19:05:18.780960] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-30T19:05:18.902743] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-30T19:05:19.176723] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-30T19:05:19.176825] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-30T19:05:19.177768] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-30T19:05:19.177848] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-30T19:05:19.179210] [DEBUG] [LOCAL ] GTLS: Trimmed 61365 records to 43014 (keeping 200 days of data) [2025-10-30T19:05:19.320265] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T19:05:19.470327] [DEBUG] [LOCAL ] GTLS: Primary data saved (43014 records). [2025-10-30T19:05:19.470446] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-30T19:05:19.470534] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GTLS took 24.3s. Estimated remaining: 2h 58m 7s. Rate: 7.8 symbols/min [2025-10-30T19:05:19.637209] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:05:19.649192] [DEBUG] [LOCAL ] GUG: Loaded 11942 existing records from primary storage. [2025-10-30T19:05:19.649479] [INFO ] [MAIN ] GUG: Loaded 11942 existing records. [2025-10-30T19:05:19.706818] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-30T19:05:19.831142] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:05:19.831357] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-30T19:05:19.831406] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-30T19:05:19.831746] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-30T19:05:19.831804] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-30T19:05:20.192072] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:05:20.278675] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T19:05:20.497530] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-30T19:05:20.984377] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T19:05:21.265787] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-30T19:05:21.297461] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-30T19:05:22.097469] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-30T19:05:22.173893] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-30T19:05:22.897515] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-30T19:05:23.563795] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T19:05:23.574776] [INFO ] [REMOTE ] GTN: Full fetch complete (65433 records). [2025-10-30T19:05:23.574946] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-30T19:05:23.702607] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-30T19:05:24.029186] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-30T19:05:24.029316] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-30T19:05:24.030344] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-30T19:05:24.030407] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-30T19:05:24.031775] [DEBUG] [LOCAL ] GTN: Trimmed 65433 records to 44608 (keeping 200 days of data) [2025-10-30T19:05:24.277059] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T19:05:24.344048] [DEBUG] [LOCAL ] GTN: Primary data saved (44608 records). [2025-10-30T19:05:24.344203] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-30T19:05:24.344323] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTN took 27.6s. Estimated remaining: 2h 57m 55s. Rate: 7.8 symbols/min [2025-10-30T19:05:24.506844] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-30T19:05:24.539888] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:05:24.541232] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T19:05:24.560760] [DEBUG] [LOCAL ] GUT: Loaded 15365 existing records from primary storage. [2025-10-30T19:05:24.560990] [INFO ] [MAIN ] GUT: Loaded 15365 existing records. [2025-10-30T19:05:24.732970] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:05:24.733143] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-30T19:05:24.733189] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-30T19:05:24.733383] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-30T19:05:24.733437] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-30T19:05:25.074814] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:05:25.297482] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-30T19:05:25.667087] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T19:05:26.032724] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T19:05:26.097465] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-30T19:05:26.592574] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T19:05:26.897494] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-30T19:05:27.415487] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T19:05:27.697689] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-30T19:05:28.297600] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-30T19:05:28.497506] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-30T19:05:29.099273] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-30T19:05:29.297494] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-30T19:05:29.872886] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-30T19:05:30.097507] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-30T19:05:30.897506] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-30T19:05:31.223988] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T19:05:31.499688] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T19:05:31.697497] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-30T19:05:32.408067] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-30T19:05:32.497514] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-30T19:05:33.297551] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-30T19:05:33.886006] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T19:05:33.897543] [INFO ] [REMOTE ] GTES: Full fetch complete (73866 records). [2025-10-30T19:05:33.897777] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-30T19:05:34.101410] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-30T19:05:34.215065] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T19:05:34.347877] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-30T19:05:34.347968] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-30T19:05:34.348951] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-30T19:05:34.349035] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-30T19:05:34.350632] [DEBUG] [LOCAL ] GTES: Trimmed 73866 records to 50623 (keeping 200 days of data) [2025-10-30T19:05:34.654895] [DEBUG] [LOCAL ] GTES: Primary data saved (50623 records). [2025-10-30T19:05:34.655104] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-30T19:05:34.655836] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GTES took 41.2s. Estimated remaining: 2h 57m 51s. Rate: 7.8 symbols/min [2025-10-30T19:05:34.837056] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:05:34.869721] [DEBUG] [LOCAL ] GVA: Loaded 31976 existing records from primary storage. [2025-10-30T19:05:34.870012] [INFO ] [MAIN ] GVA: Loaded 31976 existing records. [2025-10-30T19:05:34.903281] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-30T19:05:34.929542] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-30T19:05:35.103128] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:05:35.103370] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-30T19:05:35.103419] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-30T19:05:35.103729] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-30T19:05:35.103795] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-30T19:05:35.462097] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:05:35.697507] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-30T19:05:35.799007] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T19:05:36.286993] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-30T19:05:36.497475] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-30T19:05:37.118035] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-30T19:05:37.297491] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-30T19:05:37.842451] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T19:05:38.097480] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-30T19:05:38.770893] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-30T19:05:38.897466] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-30T19:05:39.469440] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-30T19:05:39.697509] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-30T19:05:40.373208] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T19:05:40.497544] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-30T19:05:41.123341] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T19:05:41.297480] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-30T19:05:42.086758] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-30T19:05:42.091294] [INFO ] [REMOTE ] GUT: Full fetch complete (22406 records). [2025-10-30T19:05:42.091386] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-30T19:05:42.103309] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-30T19:05:42.501146] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-30T19:05:42.501219] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-30T19:05:42.501688] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-30T19:05:42.501749] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-30T19:05:42.502326] [DEBUG] [LOCAL ] GUT: Trimmed 22406 records to 15452 (keeping 200 days of data) [2025-10-30T19:05:42.589131] [DEBUG] [LOCAL ] GUT: Primary data saved (15452 records). [2025-10-30T19:05:42.589260] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-30T19:05:42.589338] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GUT took 18.2s. Estimated remaining: 2h 57m 44s. Rate: 7.8 symbols/min [2025-10-30T19:05:42.757781] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:05:42.777998] [DEBUG] [LOCAL ] GWH: Loaded 21456 existing records from primary storage. [2025-10-30T19:05:42.778250] [INFO ] [MAIN ] GWH: Loaded 21456 existing records. [2025-10-30T19:05:42.899053] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-30T19:05:42.976059] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:05:42.976961] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-30T19:05:42.980510] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-30T19:05:42.980722] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-30T19:05:42.980811] [INFO ] [REMOTE ] GUG: Full fetch complete (18679 records). [2025-10-30T19:05:42.980925] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-30T19:05:42.981031] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-30T19:05:42.981121] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-30T19:05:43.714304] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-30T19:05:43.752179] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:05:43.763146] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-30T19:05:43.764016] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-30T19:05:43.764606] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-30T19:05:43.764840] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-30T19:05:43.765709] [DEBUG] [LOCAL ] GUG: Trimmed 18679 records to 12042 (keeping 200 days of data) [2025-10-30T19:05:43.845916] [DEBUG] [LOCAL ] GUG: Primary data saved (12042 records). [2025-10-30T19:05:43.846055] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-30T19:05:43.846257] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GUG took 24.4s. Estimated remaining: 2h 57m 27s. Rate: 7.8 symbols/min [2025-10-30T19:05:43.937193] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T19:05:44.035048] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:05:44.069286] [DEBUG] [LOCAL ] GWRE: Loaded 39216 existing records from primary storage. [2025-10-30T19:05:44.069552] [INFO ] [MAIN ] GWRE: Loaded 39216 existing records. [2025-10-30T19:05:44.240558] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:05:44.240840] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-30T19:05:44.240893] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-30T19:05:44.241327] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-30T19:05:44.241383] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-30T19:05:44.502609] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-30T19:05:44.593895] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:05:44.781384] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-30T19:05:45.106714] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-30T19:05:45.297520] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-30T19:05:45.878194] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-30T19:05:46.097538] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-30T19:05:46.593077] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-30T19:05:46.897499] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-30T19:05:47.697512] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-30T19:05:48.072895] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T19:05:48.497501] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-30T19:05:48.611718] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T19:05:48.619279] [INFO ] [REMOTE ] GTY: Full fetch complete (43832 records). [2025-10-30T19:05:48.619395] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-30T19:05:49.050812] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-30T19:05:49.050891] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-30T19:05:49.051542] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-30T19:05:49.051582] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-30T19:05:49.052505] [DEBUG] [LOCAL ] GTY: Trimmed 43832 records to 29837 (keeping 200 days of data) [2025-10-30T19:05:49.235538] [DEBUG] [LOCAL ] GTY: Primary data saved (29837 records). [2025-10-30T19:05:49.235689] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-30T19:05:49.235784] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GTY took 50.5s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-30T19:05:49.302593] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-30T19:05:49.407208] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:05:49.426151] [DEBUG] [LOCAL ] GWW: Loaded 18804 existing records from primary storage. [2025-10-30T19:05:49.426401] [INFO ] [MAIN ] GWW: Loaded 18804 existing records. [2025-10-30T19:05:49.603243] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:05:49.603484] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-30T19:05:49.603606] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-30T19:05:49.603966] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-30T19:05:49.604020] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-30T19:05:49.947908] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T19:05:49.989848] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:05:50.097466] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-30T19:05:50.328319] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T19:05:50.859181] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T19:05:50.897454] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-30T19:05:51.697535] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-30T19:05:51.714814] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T19:05:52.497523] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-30T19:05:53.024314] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T19:05:53.297573] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-30T19:05:53.483405] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T19:05:54.097523] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-30T19:05:54.448737] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T19:05:54.897503] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-30T19:05:55.228978] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T19:05:55.697550] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-30T19:05:56.038633] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T19:05:56.500369] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-30T19:05:56.505668] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T19:05:57.297533] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-30T19:05:57.586212] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T19:05:58.097554] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-30T19:05:58.203400] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T19:05:58.897495] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-30T19:05:59.231050] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T19:05:59.377345] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T19:05:59.697504] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-30T19:06:00.478815] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-30T19:06:00.497465] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-30T19:06:01.297499] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-30T19:06:02.097483] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-30T19:06:02.180699] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-30T19:06:02.822934] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T19:06:02.897462] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-30T19:06:03.098882] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-30T19:06:03.527723] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T19:06:03.697486] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-30T19:06:04.497474] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-30T19:06:04.533015] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-30T19:06:05.297529] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-30T19:06:05.534538] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-30T19:06:06.097469] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-30T19:06:06.298187] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T19:06:06.902573] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-30T19:06:06.911158] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T19:06:07.697489] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-30T19:06:07.976679] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:06:08.391305] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-30T19:06:08.497508] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-30T19:06:09.297498] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-30T19:06:09.330101] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T19:06:10.097498] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-30T19:06:10.291432] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-30T19:06:10.897505] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-30T19:06:11.672690] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T19:06:11.697461] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-30T19:06:12.175279] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-30T19:06:12.184545] [INFO ] [REMOTE ] GWH: Full fetch complete (26096 records). [2025-10-30T19:06:12.184662] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-30T19:06:12.522943] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-30T19:06:12.562683] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-30T19:06:12.562872] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-30T19:06:12.563485] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-30T19:06:12.563700] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-30T19:06:12.570015] [DEBUG] [LOCAL ] GWH: Trimmed 26096 records to 21737 (keeping 200 days of data) [2025-10-30T19:06:12.579142] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T19:06:12.703089] [DEBUG] [LOCAL ] GWH: Primary data saved (21737 records). [2025-10-30T19:06:12.703210] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-30T19:06:12.703283] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GWH took 30.1s. Estimated remaining: 2h 57m 31s. Rate: 7.8 symbols/min [2025-10-30T19:06:12.867075] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:12.911226] [DEBUG] [LOCAL ] GXO: Loaded 45996 existing records from primary storage. [2025-10-30T19:06:12.911569] [INFO ] [MAIN ] GXO: Loaded 45996 existing records. [2025-10-30T19:06:13.084010] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:13.084266] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-30T19:06:13.084323] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-30T19:06:13.084972] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-30T19:06:13.085030] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-30T19:06:13.302638] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-30T19:06:13.465369] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:13.722767] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T19:06:14.097478] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-30T19:06:14.247288] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T19:06:14.897490] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-30T19:06:15.299752] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T19:06:15.308777] [INFO ] [REMOTE ] GWRE: Full fetch complete (59766 records). [2025-10-30T19:06:15.308907] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-30T19:06:15.700411] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-30T19:06:15.737436] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-30T19:06:15.737512] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-30T19:06:15.738442] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-30T19:06:15.738505] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-30T19:06:15.739760] [DEBUG] [LOCAL ] GWRE: Trimmed 59766 records to 39496 (keeping 200 days of data) [2025-10-30T19:06:15.932495] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T19:06:15.974666] [INFO ] [REMOTE ] GWW: Full fetch complete (29015 records). [2025-10-30T19:06:15.991706] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-30T19:06:15.997422] [DEBUG] [LOCAL ] GWRE: Primary data saved (39496 records). [2025-10-30T19:06:16.003135] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-30T19:06:16.023902] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GWRE took 32.2s. Estimated remaining: 2h 57m 17s. Rate: 7.8 symbols/min [2025-10-30T19:06:16.425146] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:16.477052] [DEBUG] [LOCAL ] GYLD: Loaded 1514 existing records from primary storage. [2025-10-30T19:06:16.487609] [INFO ] [MAIN ] GYLD: Loaded 1514 existing records. [2025-10-30T19:06:16.513539] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-30T19:06:16.565070] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-30T19:06:16.579419] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-30T19:06:16.599598] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-30T19:06:16.604854] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-30T19:06:16.673111] [DEBUG] [LOCAL ] GWW: Trimmed 29015 records to 19011 (keeping 200 days of data) [2025-10-30T19:06:16.866049] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:16.868417] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-30T19:06:16.868856] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-30T19:06:16.875995] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-30T19:06:16.880132] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-30T19:06:16.964173] [DEBUG] [LOCAL ] GWW: Primary data saved (19011 records). [2025-10-30T19:06:16.981031] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-30T19:06:16.996765] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GWW took 27.8s. Estimated remaining: 2h 56m 60s. Rate: 7.8 symbols/min [2025-10-30T19:06:17.364087] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-30T19:06:17.365591] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:17.413086] [INFO ] [REMOTE ] GVA: Full fetch complete (48450 records). [2025-10-30T19:06:17.439169] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-30T19:06:17.468127] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:17.482307] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-30T19:06:17.725342] [DEBUG] [LOCAL ] H: Loaded 44201 existing records from primary storage. [2025-10-30T19:06:17.731015] [INFO ] [MAIN ] H: Loaded 44201 existing records. [2025-10-30T19:06:17.849916] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-30T19:06:18.063552] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:18.091438] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-30T19:06:18.108013] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-30T19:06:18.108081] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-30T19:06:18.153107] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-30T19:06:18.170130] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-30T19:06:18.190898] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-30T19:06:18.191058] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-30T19:06:18.203347] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-30T19:06:18.204295] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-30T19:06:18.239426] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-30T19:06:18.286635] [DEBUG] [LOCAL ] GVA: Trimmed 48450 records to 32179 (keeping 200 days of data) [2025-10-30T19:06:18.492897] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-30T19:06:18.682256] [DEBUG] [LOCAL ] GVA: Primary data saved (32179 records). [2025-10-30T19:06:18.685265] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-30T19:06:18.686164] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. GVA took 44.0s. Estimated remaining: 2h 56m 44s. Rate: 7.8 symbols/min [2025-10-30T19:06:18.872255] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:18.902595] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-30T19:06:18.956984] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:18.996309] [DEBUG] [LOCAL ] HAE: Loaded 38768 existing records from primary storage. [2025-10-30T19:06:18.996672] [INFO ] [MAIN ] HAE: Loaded 38768 existing records. [2025-10-30T19:06:19.209155] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:19.209438] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-30T19:06:19.209490] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-30T19:06:19.209837] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-30T19:06:19.209897] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-30T19:06:19.596839] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:19.697473] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-30T19:06:19.895844] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T19:06:20.497476] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-30T19:06:20.831432] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T19:06:21.297502] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-30T19:06:21.667489] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T19:06:22.097502] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-30T19:06:22.372341] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-30T19:06:22.488042] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T19:06:22.897502] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-30T19:06:23.194957] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-30T19:06:23.697522] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-30T19:06:24.497527] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-30T19:06:25.012310] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T19:06:25.297502] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-30T19:06:25.482202] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T19:06:25.614025] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T19:06:26.097523] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-30T19:06:26.897500] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-30T19:06:27.638843] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T19:06:27.697471] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-30T19:06:28.245388] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T19:06:28.497469] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-30T19:06:28.747362] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T19:06:29.297504] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-30T19:06:29.540475] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T19:06:30.097494] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-30T19:06:30.421535] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T19:06:30.897539] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-30T19:06:31.158704] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T19:06:31.189320] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-30T19:06:31.697485] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-30T19:06:32.079559] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-30T19:06:32.497495] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-30T19:06:32.786086] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-30T19:06:33.297517] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-30T19:06:33.573261] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-30T19:06:34.097531] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-30T19:06:34.897496] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-30T19:06:35.137529] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T19:06:35.697488] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-30T19:06:35.809808] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T19:06:36.497513] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-30T19:06:36.668328] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T19:06:37.297517] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-30T19:06:37.771350] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:06:38.097493] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-30T19:06:38.555414] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T19:06:38.567763] [INFO ] [REMOTE ] GXO: Full fetch complete (69032 records). [2025-10-30T19:06:38.567978] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-30T19:06:38.902739] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-30T19:06:39.006169] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-30T19:06:39.006366] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-30T19:06:39.007357] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-30T19:06:39.007519] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-30T19:06:39.009058] [DEBUG] [LOCAL ] GXO: Trimmed 69032 records to 46301 (keeping 200 days of data) [2025-10-30T19:06:39.272546] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T19:06:39.330353] [DEBUG] [LOCAL ] GXO: Primary data saved (46301 records). [2025-10-30T19:06:39.330480] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-30T19:06:39.330557] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GXO took 26.6s. Estimated remaining: 2h 56m 54s. Rate: 7.8 symbols/min [2025-10-30T19:06:39.473538] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-30T19:06:39.487974] [INFO ] [REMOTE ] GYLD: Full fetch complete (2118 records). [2025-10-30T19:06:39.505776] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-30T19:06:39.539837] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:39.710241] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-30T19:06:39.884128] [DEBUG] [LOCAL ] HAFN: Loaded 42360 existing records from primary storage. [2025-10-30T19:06:39.922584] [INFO ] [MAIN ] HAFN: Loaded 42360 existing records. [2025-10-30T19:06:39.990905] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-30T19:06:40.014628] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-30T19:06:40.021045] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-30T19:06:40.027807] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-30T19:06:40.033711] [DEBUG] [LOCAL ] GYLD: Trimmed 2118 records to 1521 (keeping 200 days of data) [2025-10-30T19:06:40.115865] [DEBUG] [LOCAL ] GYLD: Primary data saved (1521 records). [2025-10-30T19:06:40.148158] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-30T19:06:40.153885] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:40.154467] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-30T19:06:40.154586] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-30T19:06:40.154289] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. GYLD took 24.1s. Estimated remaining: 2h 56m 37s. Rate: 7.8 symbols/min [2025-10-30T19:06:40.160169] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-30T19:06:40.184980] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-30T19:06:40.499873] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-30T19:06:40.553724] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:40.771036] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:40.807522] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-30T19:06:40.807838] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-30T19:06:40.989756] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:40.990046] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-30T19:06:40.990170] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-30T19:06:40.990756] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-30T19:06:40.990815] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-30T19:06:41.198159] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-30T19:06:41.302690] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-30T19:06:41.410746] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:41.432198] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T19:06:42.097492] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-30T19:06:42.448221] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:06:42.897499] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-30T19:06:43.556777] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-30T19:06:43.697516] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-30T19:06:44.250421] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T19:06:44.497554] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-30T19:06:45.134522] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T19:06:45.297572] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-30T19:06:45.454894] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T19:06:46.097510] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-30T19:06:46.467960] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T19:06:46.897524] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-30T19:06:47.108140] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T19:06:47.697478] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-30T19:06:48.254810] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T19:06:48.497529] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-30T19:06:49.088673] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-30T19:06:49.297506] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-30T19:06:49.569492] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-30T19:06:50.097507] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-30T19:06:50.897471] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-30T19:06:50.990962] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-30T19:06:51.368903] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T19:06:51.697499] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-30T19:06:51.938010] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T19:06:51.947377] [INFO ] [REMOTE ] HAE: Full fetch complete (59428 records). [2025-10-30T19:06:51.947555] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-30T19:06:52.355081] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-30T19:06:52.355177] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-30T19:06:52.356098] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-30T19:06:52.356187] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-30T19:06:52.357399] [DEBUG] [LOCAL ] HAE: Trimmed 59428 records to 39086 (keeping 200 days of data) [2025-10-30T19:06:52.540921] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-30T19:06:52.614549] [DEBUG] [LOCAL ] HAE: Primary data saved (39086 records). [2025-10-30T19:06:52.614721] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-30T19:06:52.614843] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. HAE took 33.9s. Estimated remaining: 2h 56m 36s. Rate: 7.8 symbols/min [2025-10-30T19:06:52.812354] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:52.855423] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:06:52.866484] [INFO ] [REMOTE ] H: Full fetch complete (63741 records). [2025-10-30T19:06:52.866797] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-30T19:06:53.066862] [DEBUG] [LOCAL ] HASI: Loaded 47312 existing records from primary storage. [2025-10-30T19:06:53.085215] [INFO ] [MAIN ] HASI: Loaded 47312 existing records. [2025-10-30T19:06:53.301878] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-30T19:06:53.504194] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:53.532102] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-30T19:06:53.546454] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-30T19:06:53.550056] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-30T19:06:53.550262] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-30T19:06:53.551233] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-30T19:06:53.551310] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-30T19:06:53.551513] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-30T19:06:53.551435] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-30T19:06:53.658716] [DEBUG] [LOCAL ] H: Trimmed 63741 records to 44565 (keeping 200 days of data) [2025-10-30T19:06:54.188939] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:54.190581] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-30T19:06:54.284985] [DEBUG] [LOCAL ] H: Primary data saved (44565 records). [2025-10-30T19:06:54.285794] [INFO ] [MAIN ] H: Full history saved. [2025-10-30T19:06:54.287602] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. H took 37.3s. Estimated remaining: 2h 56m 20s. Rate: 7.8 symbols/min [2025-10-30T19:06:54.287471] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-30T19:06:54.469390] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:06:54.512261] [DEBUG] [LOCAL ] HAYW: Loaded 48740 existing records from primary storage. [2025-10-30T19:06:54.512581] [INFO ] [MAIN ] HAYW: Loaded 48740 existing records. [2025-10-30T19:06:54.690388] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:06:54.690598] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-30T19:06:54.690675] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-30T19:06:54.691423] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-30T19:06:54.691478] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-30T19:06:54.908490] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-30T19:06:55.052023] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:06:55.085940] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-30T19:06:55.401195] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T19:06:55.697494] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-30T19:06:56.304753] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-30T19:06:56.497475] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-30T19:06:56.719940] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T19:06:57.297576] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-30T19:06:57.907847] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T19:06:58.097509] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-30T19:06:58.395523] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T19:06:58.897534] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-30T19:06:59.520059] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-30T19:06:59.697503] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-30T19:07:00.071426] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T19:07:00.497526] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-30T19:07:01.297530] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-30T19:07:01.676478] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-30T19:07:02.097525] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-30T19:07:02.589087] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-30T19:07:02.897488] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-30T19:07:03.587021] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-30T19:07:03.697491] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-30T19:07:03.749358] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-30T19:07:03.881686] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T19:07:04.497500] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-30T19:07:04.853060] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T19:07:05.297503] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-30T19:07:05.713754] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T19:07:06.097515] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-30T19:07:06.645386] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T19:07:06.897489] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-30T19:07:07.250222] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T19:07:07.697493] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-30T19:07:08.497489] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-30T19:07:08.639829] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T19:07:08.652886] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-30T19:07:08.653126] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-30T19:07:08.970973] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T19:07:09.107864] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-30T19:07:09.107952] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-30T19:07:09.109297] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-30T19:07:09.109382] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-30T19:07:09.111004] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54108 (keeping 200 days of data) [2025-10-30T19:07:09.319784] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-30T19:07:09.436059] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-10-30T19:07:09.437238] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-30T19:07:09.437918] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HAL took 29.3s. Estimated remaining: 2h 56m 22s. Rate: 7.8 symbols/min [2025-10-30T19:07:09.617335] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:07:09.656204] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T19:07:09.656637] [DEBUG] [LOCAL ] HBB: Loaded 5936 existing records from primary storage. [2025-10-30T19:07:09.667150] [INFO ] [MAIN ] HBB: Loaded 5936 existing records. [2025-10-30T19:07:09.848994] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:07:09.849210] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-30T19:07:09.849260] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-30T19:07:09.849533] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-30T19:07:09.849592] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-30T19:07:10.102724] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-30T19:07:10.204493] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:07:10.471503] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T19:07:10.897505] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-30T19:07:11.293822] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T19:07:11.697533] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-30T19:07:12.095223] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T19:07:12.497492] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-30T19:07:12.914033] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-30T19:07:12.971504] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T19:07:12.981706] [INFO ] [REMOTE ] HASI: Full fetch complete (68189 records). [2025-10-30T19:07:12.981857] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-30T19:07:13.302591] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-30T19:07:13.373981] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-30T19:07:13.374074] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-30T19:07:13.374997] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-30T19:07:13.375062] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-30T19:07:13.376433] [DEBUG] [LOCAL ] HASI: Trimmed 68189 records to 47673 (keeping 200 days of data) [2025-10-30T19:07:13.659106] [DEBUG] [LOCAL ] HASI: Primary data saved (47673 records). [2025-10-30T19:07:13.659248] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-30T19:07:13.659890] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HASI took 21.0s. Estimated remaining: 2h 56m 10s. Rate: 7.8 symbols/min [2025-10-30T19:07:13.832908] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:07:13.880970] [DEBUG] [LOCAL ] HBI: Loaded 52885 existing records from primary storage. [2025-10-30T19:07:13.881269] [INFO ] [MAIN ] HBI: Loaded 52885 existing records. [2025-10-30T19:07:14.055767] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:07:14.055998] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-30T19:07:14.056045] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-30T19:07:14.057088] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-30T19:07:14.057146] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-30T19:07:14.102567] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-30T19:07:14.413723] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:07:14.437888] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:07:14.541607] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-30T19:07:14.897477] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-30T19:07:15.697489] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-30T19:07:16.120724] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T19:07:16.173812] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-30T19:07:16.497511] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-30T19:07:17.297528] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-30T19:07:17.616882] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T19:07:18.097515] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-30T19:07:18.438135] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:07:18.897530] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-30T19:07:19.193910] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-30T19:07:19.697513] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-30T19:07:20.200983] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:07:20.497501] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-30T19:07:21.105448] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-30T19:07:21.124104] [INFO ] [REMOTE ] HAFN: Full fetch complete (64379 records). [2025-10-30T19:07:21.125014] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-30T19:07:21.125423] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-30T19:07:21.319994] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-30T19:07:21.559542] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-30T19:07:21.559717] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-30T19:07:21.561328] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-30T19:07:21.561411] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-30T19:07:21.563470] [DEBUG] [LOCAL ] HAFN: Trimmed 64379 records to 42646 (keeping 200 days of data) [2025-10-30T19:07:21.841700] [DEBUG] [LOCAL ] HAFN: Primary data saved (42646 records). [2025-10-30T19:07:21.841877] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-30T19:07:21.841977] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HAFN took 42.5s. Estimated remaining: 2h 56m 3s. Rate: 7.8 symbols/min [2025-10-30T19:07:22.022863] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:07:22.082023] [DEBUG] [LOCAL ] HBM: Loaded 52979 existing records from primary storage. [2025-10-30T19:07:22.082609] [INFO ] [MAIN ] HBM: Loaded 52979 existing records. [2025-10-30T19:07:22.107097] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-30T19:07:22.276535] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:07:22.276876] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-30T19:07:22.276936] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-30T19:07:22.278097] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-30T19:07:22.278158] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-30T19:07:22.754288] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:07:22.795142] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-30T19:07:22.897572] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-30T19:07:23.534136] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T19:07:23.697492] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-30T19:07:23.940960] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:07:24.497549] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-30T19:07:25.005333] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T19:07:25.297500] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-30T19:07:25.694351] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T19:07:26.097519] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-30T19:07:26.442863] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T19:07:26.897536] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-30T19:07:27.217238] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T19:07:27.307412] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T19:07:27.697538] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-30T19:07:28.497500] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-30T19:07:28.982937] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-30T19:07:29.297485] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-30T19:07:29.641594] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T19:07:30.097502] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-30T19:07:30.660436] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T19:07:30.897510] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-30T19:07:31.281298] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T19:07:31.294158] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T19:07:31.697549] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-30T19:07:32.497682] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-30T19:07:32.975527] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T19:07:33.297500] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-30T19:07:33.755001] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T19:07:34.097499] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-30T19:07:34.514373] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T19:07:34.897506] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-30T19:07:35.489244] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T19:07:35.500348] [INFO ] [REMOTE ] HAYW: Full fetch complete (70988 records). [2025-10-30T19:07:35.500483] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-30T19:07:35.702751] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-30T19:07:35.881676] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-30T19:07:35.881783] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-30T19:07:35.882760] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-30T19:07:35.882822] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-30T19:07:35.884413] [DEBUG] [LOCAL ] HAYW: Trimmed 70988 records to 49130 (keeping 200 days of data) [2025-10-30T19:07:36.173968] [DEBUG] [LOCAL ] HAYW: Primary data saved (49130 records). [2025-10-30T19:07:36.174101] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-30T19:07:36.175031] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HAYW took 41.9s. Estimated remaining: 2h 56m 4s. Rate: 7.8 symbols/min [2025-10-30T19:07:36.344072] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:07:36.379137] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-30T19:07:36.428562] [DEBUG] [LOCAL ] HCA: Loaded 46781 existing records from primary storage. [2025-10-30T19:07:36.428911] [INFO ] [MAIN ] HCA: Loaded 46781 existing records. [2025-10-30T19:07:36.502691] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-30T19:07:36.604802] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:07:36.604987] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-30T19:07:36.605034] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-30T19:07:36.605888] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-30T19:07:36.605945] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-30T19:07:36.963627] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:07:37.062089] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-30T19:07:37.297590] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-30T19:07:37.803186] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T19:07:38.097581] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-30T19:07:38.618448] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:07:38.897504] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-30T19:07:39.262906] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T19:07:39.697553] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-30T19:07:40.215979] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T19:07:40.497511] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-30T19:07:40.816803] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T19:07:41.297503] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-30T19:07:41.828930] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T19:07:42.097476] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-30T19:07:42.515957] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-30T19:07:42.554232] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T19:07:42.897522] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-30T19:07:43.697534] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-30T19:07:44.045086] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-30T19:07:44.281255] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T19:07:44.296560] [INFO ] [REMOTE ] HBI: Full fetch complete (76942 records). [2025-10-30T19:07:44.296861] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-30T19:07:44.503279] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-30T19:07:44.748114] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-30T19:07:44.748232] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-30T19:07:44.749358] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-30T19:07:44.749428] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-30T19:07:44.751088] [DEBUG] [LOCAL ] HBI: Trimmed 76942 records to 53268 (keeping 200 days of data) [2025-10-30T19:07:45.022592] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T19:07:45.063776] [DEBUG] [LOCAL ] HBI: Primary data saved (53268 records). [2025-10-30T19:07:45.063922] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-30T19:07:45.064572] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HBI took 31.4s. Estimated remaining: 2h 55m 58s. Rate: 7.8 symbols/min [2025-10-30T19:07:45.253978] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:07:45.296630] [DEBUG] [LOCAL ] HCC: Loaded 44577 existing records from primary storage. [2025-10-30T19:07:45.296967] [INFO ] [MAIN ] HCC: Loaded 44577 existing records. [2025-10-30T19:07:45.302866] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-30T19:07:45.491278] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:07:45.491547] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-30T19:07:45.491600] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-30T19:07:45.491818] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-30T19:07:45.491872] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-30T19:07:45.888148] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:07:45.911576] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-30T19:07:45.913110] [INFO ] [REMOTE ] HBB: Full fetch complete (9098 records). [2025-10-30T19:07:45.913200] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-30T19:07:46.102637] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-30T19:07:46.291660] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-30T19:07:46.291748] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-30T19:07:46.292014] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-30T19:07:46.292055] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-30T19:07:46.292468] [DEBUG] [LOCAL ] HBB: Trimmed 9098 records to 5952 (keeping 200 days of data) [2025-10-30T19:07:46.328154] [DEBUG] [LOCAL ] HBB: Primary data saved (5952 records). [2025-10-30T19:07:46.328269] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-30T19:07:46.328345] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HBB took 36.9s. Estimated remaining: 2h 55m 42s. Rate: 7.8 symbols/min [2025-10-30T19:07:46.499700] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:07:46.521206] [DEBUG] [LOCAL ] HCI: Loaded 13869 existing records from primary storage. [2025-10-30T19:07:46.521501] [INFO ] [MAIN ] HCI: Loaded 13869 existing records. [2025-10-30T19:07:46.715164] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:07:46.715380] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-30T19:07:46.715430] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-30T19:07:46.715588] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-30T19:07:46.715625] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-30T19:07:46.897707] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-30T19:07:47.078487] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:07:47.234845] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T19:07:47.697571] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-30T19:07:48.497566] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-30T19:07:48.581280] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T19:07:48.593006] [INFO ] [REMOTE ] HBM: Full fetch complete (76815 records). [2025-10-30T19:07:48.593166] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-30T19:07:48.996454] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-30T19:07:48.996605] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-30T19:07:48.997639] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-30T19:07:48.997747] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-30T19:07:49.024135] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T19:07:49.022833] [DEBUG] [LOCAL ] HBM: Trimmed 76815 records to 53368 (keeping 200 days of data) [2025-10-30T19:07:49.225947] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-30T19:07:49.319499] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-30T19:07:49.367614] [DEBUG] [LOCAL ] HBM: Primary data saved (53368 records). [2025-10-30T19:07:49.367786] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-30T19:07:49.367869] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HBM took 27.5s. Estimated remaining: 2h 55m 28s. Rate: 7.8 symbols/min [2025-10-30T19:07:50.097499] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-30T19:07:50.650459] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-30T19:07:50.694879] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-30T19:07:50.897541] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-30T19:07:51.513235] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-30T19:07:51.697504] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-30T19:07:52.497519] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-30T19:07:52.813139] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T19:07:53.297542] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-30T19:07:53.599207] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T19:07:54.097525] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-30T19:07:54.430600] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T19:07:54.897551] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-30T19:07:55.252844] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T19:07:55.697516] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-30T19:07:56.214724] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-30T19:07:56.497509] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-30T19:07:57.032510] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T19:07:57.297525] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-30T19:07:57.651186] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:07:58.097529] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-30T19:07:58.508214] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T19:07:58.897526] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-30T19:07:59.441829] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T19:07:59.697495] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-30T19:08:00.092280] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T19:08:00.497505] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-30T19:08:01.297501] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-30T19:08:01.512556] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-30T19:08:01.810789] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T19:08:02.097501] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-30T19:08:02.897562] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-30T19:08:03.512814] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-30T19:08:03.540082] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T19:08:03.697492] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-30T19:08:03.981329] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-30T19:08:03.991509] [INFO ] [REMOTE ] HCA: Full fetch complete (68878 records). [2025-10-30T19:08:03.991678] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-30T19:08:04.396628] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-30T19:08:04.396802] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-30T19:08:04.397915] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-30T19:08:04.398033] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-30T19:08:04.399747] [DEBUG] [LOCAL ] HCA: Trimmed 68878 records to 47150 (keeping 200 days of data) [2025-10-30T19:08:04.500210] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-30T19:08:04.513002] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T19:08:04.712688] [DEBUG] [LOCAL ] HCA: Primary data saved (47150 records). [2025-10-30T19:08:04.712813] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-30T19:08:04.713521] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HCA took 28.5s. Estimated remaining: 2h 55m 30s. Rate: 7.8 symbols/min [2025-10-30T19:08:05.297484] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-30T19:08:05.801048] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T19:08:05.810750] [INFO ] [REMOTE ] HCC: Full fetch complete (64612 records). [2025-10-30T19:08:05.810877] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-30T19:08:06.156088] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-30T19:08:06.198884] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-30T19:08:06.238308] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-30T19:08:06.238399] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-30T19:08:06.239371] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-30T19:08:06.239443] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-30T19:08:06.240880] [DEBUG] [LOCAL ] HCC: Trimmed 64612 records to 44872 (keeping 200 days of data) [2025-10-30T19:08:06.513305] [DEBUG] [LOCAL ] HCC: Primary data saved (44872 records). [2025-10-30T19:08:06.513441] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-30T19:08:06.514041] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HCC took 21.4s. Estimated remaining: 2h 55m 15s. Rate: 7.8 symbols/min [2025-10-30T19:08:06.813438] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T19:08:06.897471] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-30T19:08:07.458685] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-30T19:08:07.697503] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-30T19:08:08.550022] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-30T19:08:08.553850] [INFO ] [REMOTE ] HCI: Full fetch complete (19494 records). [2025-10-30T19:08:08.553932] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-30T19:08:08.966748] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-30T19:08:08.966835] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-30T19:08:08.967285] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-30T19:08:08.967324] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-30T19:08:08.968002] [DEBUG] [LOCAL ] HCI: Trimmed 19494 records to 13931 (keeping 200 days of data) [2025-10-30T19:08:09.059156] [DEBUG] [LOCAL ] HCI: Primary data saved (13931 records). [2025-10-30T19:08:09.059294] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-30T19:08:09.059375] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCI took 22.7s. Estimated remaining: 2h 54m 60s. Rate: 7.8 symbols/min [2025-10-30T19:08:09.682700] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:09.769748] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-30T19:08:09.853128] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:09.864275] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:09.865216] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-30T19:08:09.887842] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:09.888282] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-30T19:08:09.888803] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-30T19:08:09.888973] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-30T19:08:09.889031] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-30T19:08:10.225535] [DEBUG] [LOCAL ] HE: Loaded 48542 existing records from primary storage. [2025-10-30T19:08:10.242080] [INFO ] [MAIN ] HE: Loaded 48542 existing records. [2025-10-30T19:08:10.344524] [DEBUG] [LOCAL ] HD: Loaded 53442 existing records from primary storage. [2025-10-30T19:08:10.419375] [INFO ] [MAIN ] HD: Loaded 53442 existing records. [2025-10-30T19:08:10.462217] [DEBUG] [LOCAL ] HDB: Loaded 51889 existing records from primary storage. [2025-10-30T19:08:10.507080] [INFO ] [MAIN ] HDB: Loaded 51889 existing records. [2025-10-30T19:08:10.455871] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:10.581981] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-30T19:08:10.758468] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:08:10.781852] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-30T19:08:10.793231] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-30T19:08:10.804893] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-30T19:08:10.828370] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-30T19:08:10.828508] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-30T19:08:10.941208] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-30T19:08:10.993046] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:08:11.036876] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:08:11.031444] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-30T19:08:11.037327] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-30T19:08:11.037263] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-30T19:08:11.042571] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-30T19:08:11.072792] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-30T19:08:11.072910] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-30T19:08:11.072719] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-30T19:08:11.101040] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-30T19:08:11.440478] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T19:08:11.532800] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-30T19:08:11.680397] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:11.716012] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-30T19:08:11.912375] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-30T19:08:11.955325] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-30T19:08:12.088524] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:12.112249] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:12.199904] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-30T19:08:12.497491] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-30T19:08:13.123248] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T19:08:13.297491] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-30T19:08:13.480283] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.18 seconds). [2025-10-30T19:08:13.948914] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-30T19:08:14.097489] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-30T19:08:14.897494] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-30T19:08:15.274969] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T19:08:15.697521] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-30T19:08:15.936236] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-30T19:08:16.320515] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-30T19:08:16.497521] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-30T19:08:17.297503] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-30T19:08:17.500679] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-10-30T19:08:18.094552] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-30T19:08:18.105560] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-30T19:08:18.897509] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-30T19:08:19.411558] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T19:08:19.697554] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-30T19:08:20.307740] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-30T19:08:20.497536] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-30T19:08:20.967180] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:08:21.297545] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-30T19:08:21.995732] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T19:08:22.097509] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-30T19:08:22.568689] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T19:08:22.897498] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-30T19:08:23.697482] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-30T19:08:23.742365] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-30T19:08:23.874427] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-30T19:08:23.971558] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T19:08:24.497509] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-30T19:08:25.297582] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-30T19:08:25.866699] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T19:08:26.097723] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-30T19:08:26.472926] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-30T19:08:26.897506] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-30T19:08:27.491780] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T19:08:27.697469] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-30T19:08:28.468335] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-30T19:08:28.497472] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-30T19:08:28.891167] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T19:08:29.297517] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-30T19:08:29.468173] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-10-30T19:08:30.044472] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-30T19:08:30.097554] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-30T19:08:30.897512] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-30T19:08:31.347974] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T19:08:31.697589] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-30T19:08:32.001077] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-30T19:08:32.001807] [INFO ] [REMOTE ] HCXY: Full fetch complete (519 records). [2025-10-30T19:08:32.001875] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-30T19:08:32.205912] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-30T19:08:32.206135] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:08:32.206205] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:08:32.206256] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-30T19:08:32.206328] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-30T19:08:32.206406] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-30T19:08:32.206471] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-30T19:08:32.206555] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HCXY took 23.1s. Estimated remaining: 2h 55m 13s. Rate: 7.8 symbols/min [2025-10-30T19:08:32.399989] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:32.430955] [DEBUG] [LOCAL ] HEI: Loaded 29812 existing records from primary storage. [2025-10-30T19:08:32.431230] [INFO ] [MAIN ] HEI: Loaded 29812 existing records. [2025-10-30T19:08:32.502751] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-30T19:08:32.633575] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:08:32.634024] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-30T19:08:32.634152] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-30T19:08:32.634916] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-30T19:08:32.635037] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-30T19:08:33.037591] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:33.032107] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-30T19:08:33.297503] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-30T19:08:33.831991] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T19:08:34.097521] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-30T19:08:34.342781] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T19:08:34.897545] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-30T19:08:35.396769] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T19:08:35.697547] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-30T19:08:35.839047] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T19:08:36.497468] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-30T19:08:37.157996] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T19:08:37.297563] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-30T19:08:37.527370] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T19:08:38.097508] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-30T19:08:38.877438] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-30T19:08:38.897455] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-30T19:08:39.163217] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-30T19:08:39.697551] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-30T19:08:40.497519] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-30T19:08:40.813703] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-30T19:08:40.826258] [INFO ] [REMOTE ] HD: Full fetch complete (77521 records). [2025-10-30T19:08:40.826485] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-30T19:08:41.233113] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-30T19:08:41.233363] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-30T19:08:41.234434] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-30T19:08:41.234518] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-30T19:08:41.263503] [DEBUG] [LOCAL ] HD: Trimmed 77521 records to 53827 (keeping 200 days of data) [2025-10-30T19:08:41.264857] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T19:08:41.331469] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-30T19:08:41.607634] [DEBUG] [LOCAL ] HD: Primary data saved (53827 records). [2025-10-30T19:08:41.607789] [INFO ] [MAIN ] HD: Full history saved. [2025-10-30T19:08:41.607866] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HD took 32.5s. Estimated remaining: 2h 55m 8s. Rate: 7.8 symbols/min [2025-10-30T19:08:41.802351] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:41.829252] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T19:08:41.841048] [DEBUG] [LOCAL ] HEQ: Loaded 6539 existing records from primary storage. [2025-10-30T19:08:41.841303] [INFO ] [MAIN ] HEQ: Loaded 6539 existing records. [2025-10-30T19:08:42.039308] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:08:42.039550] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-30T19:08:42.039600] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-30T19:08:42.039908] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-30T19:08:42.039966] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-30T19:08:42.110285] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-30T19:08:42.451018] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:42.565744] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T19:08:42.897528] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-30T19:08:43.695300] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T19:08:43.704894] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-30T19:08:43.706985] [INFO ] [REMOTE ] HE: Full fetch complete (71788 records). [2025-10-30T19:08:43.707074] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-30T19:08:44.116586] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-30T19:08:44.116733] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-30T19:08:44.117667] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-30T19:08:44.117751] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-30T19:08:44.119484] [DEBUG] [LOCAL ] HE: Trimmed 71788 records to 48887 (keeping 200 days of data) [2025-10-30T19:08:44.247181] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T19:08:44.451408] [DEBUG] [LOCAL ] HE: Primary data saved (48887 records). [2025-10-30T19:08:44.451534] [INFO ] [MAIN ] HE: Full history saved. [2025-10-30T19:08:44.451610] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HE took 35.4s. Estimated remaining: 2h 54m 54s. Rate: 7.8 symbols/min [2025-10-30T19:08:44.506720] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-30T19:08:44.629083] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:44.670783] [DEBUG] [LOCAL ] HESM: Loaded 48546 existing records from primary storage. [2025-10-30T19:08:44.671067] [INFO ] [MAIN ] HESM: Loaded 48546 existing records. [2025-10-30T19:08:44.859051] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:08:44.865957] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-30T19:08:44.878466] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T19:08:44.877551] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-30T19:08:44.886558] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-30T19:08:44.886691] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-30T19:08:45.265791] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:45.297486] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-30T19:08:45.987250] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T19:08:46.000226] [INFO ] [REMOTE ] HDB: Full fetch complete (75672 records). [2025-10-30T19:08:46.000425] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-30T19:08:46.102618] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-30T19:08:46.477367] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-30T19:08:46.477527] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-30T19:08:46.478543] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-30T19:08:46.478629] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-30T19:08:46.494773] [DEBUG] [LOCAL ] HDB: Trimmed 75672 records to 52275 (keeping 200 days of data) [2025-10-30T19:08:46.509754] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T19:08:46.831348] [DEBUG] [LOCAL ] HDB: Primary data saved (52275 records). [2025-10-30T19:08:46.831477] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-30T19:08:46.831553] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HDB took 37.7s. Estimated remaining: 2h 54m 39s. Rate: 7.8 symbols/min [2025-10-30T19:08:46.899696] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-30T19:08:47.009929] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:47.010122] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-30T19:08:47.010196] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-30T19:08:47.010495] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-30T19:08:47.010680] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-30T19:08:47.010834] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-30T19:08:47.010940] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-30T19:08:47.155908] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-30T19:08:47.390116] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:47.410940] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-30T19:08:47.697529] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-30T19:08:48.497499] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-30T19:08:48.897351] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-30T19:08:48.898890] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T19:08:49.297493] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-30T19:08:49.659713] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-30T19:08:50.097512] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-30T19:08:50.634427] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T19:08:50.897524] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-30T19:08:51.697516] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-30T19:08:51.909349] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-10-30T19:08:51.946004] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T19:08:52.497504] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-30T19:08:53.297480] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-30T19:08:53.347468] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T19:08:53.552867] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-30T19:08:54.097495] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-30T19:08:54.897507] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-30T19:08:55.144944] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T19:08:55.150440] [INFO ] [REMOTE ] HEI: Full fetch complete (46399 records). [2025-10-30T19:08:55.150581] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-30T19:08:55.260825] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-30T19:08:55.538730] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-30T19:08:55.538810] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-30T19:08:55.539542] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-30T19:08:55.539584] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-30T19:08:55.540518] [DEBUG] [LOCAL ] HEI: Trimmed 46399 records to 29965 (keeping 200 days of data) [2025-10-30T19:08:55.705465] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-30T19:08:55.723701] [DEBUG] [LOCAL ] HEI: Primary data saved (29965 records). [2025-10-30T19:08:55.723842] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-30T19:08:55.723920] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HEI took 23.5s. Estimated remaining: 2h 54m 33s. Rate: 7.8 symbols/min [2025-10-30T19:08:55.904561] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:08:55.904790] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-30T19:08:55.904835] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-30T19:08:55.904948] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-30T19:08:55.904991] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-30T19:08:55.905033] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-30T19:08:55.905066] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-30T19:08:56.106040] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T19:08:56.284480] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:08:56.497499] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-30T19:08:57.297499] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-30T19:08:57.483572] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-10-30T19:08:57.692315] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T19:08:58.097514] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-30T19:08:58.897503] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-30T19:08:59.131353] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-30T19:08:59.329423] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T19:08:59.697494] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-30T19:09:00.497470] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-30T19:09:00.511546] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-30T19:09:00.960451] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-30T19:09:01.297512] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-30T19:09:02.097686] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-30T19:09:02.220366] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-30T19:09:02.650272] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-30T19:09:02.897505] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-30T19:09:03.378453] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T19:09:03.697469] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-30T19:09:03.981199] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-30T19:09:04.497512] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-30T19:09:04.678834] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.18 seconds). [2025-10-30T19:09:05.297495] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-30T19:09:05.496630] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-10-30T19:09:06.097505] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-30T19:09:06.291336] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.19 seconds). [2025-10-30T19:09:06.897552] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-30T19:09:07.197883] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-30T19:09:07.697493] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-30T19:09:08.273470] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-30T19:09:08.276011] [INFO ] [REMOTE ] HEQ: Full fetch complete (9724 records). [2025-10-30T19:09:08.276086] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-30T19:09:08.506893] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-30T19:09:08.635632] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-30T19:09:08.635732] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-30T19:09:08.635959] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-30T19:09:08.635997] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-30T19:09:08.636434] [DEBUG] [LOCAL ] HEQ: Trimmed 9724 records to 6572 (keeping 200 days of data) [2025-10-30T19:09:08.674597] [DEBUG] [LOCAL ] HEQ: Primary data saved (6572 records). [2025-10-30T19:09:08.674721] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-30T19:09:08.674802] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HEQ took 27.1s. Estimated remaining: 2h 54m 32s. Rate: 7.8 symbols/min [2025-10-30T19:09:08.844595] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:08.857229] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-30T19:09:08.864768] [DEBUG] [LOCAL ] HFRO: Loaded 15645 existing records from primary storage. [2025-10-30T19:09:08.864961] [INFO ] [MAIN ] HFRO: Loaded 15645 existing records. [2025-10-30T19:09:09.062197] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:09.063036] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-30T19:09:09.063100] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-30T19:09:09.063834] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-30T19:09:09.063894] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-30T19:09:09.303781] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-30T19:09:09.426543] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:10.097517] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-30T19:09:10.396314] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T19:09:10.823984] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-30T19:09:10.897490] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-30T19:09:11.697519] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-30T19:09:12.131750] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T19:09:12.378266] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-30T19:09:12.497488] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-30T19:09:13.204416] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-30T19:09:13.297503] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-30T19:09:13.468684] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-10-30T19:09:14.097489] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-30T19:09:14.888959] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T19:09:14.897447] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-30T19:09:15.424275] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-30T19:09:15.697538] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-30T19:09:16.497511] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-30T19:09:16.677480] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-10-30T19:09:16.785326] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T19:09:17.297486] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-30T19:09:17.901912] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-30T19:09:18.097495] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-30T19:09:18.714439] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-30T19:09:18.897484] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-30T19:09:19.115172] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-30T19:09:19.697549] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-30T19:09:19.982271] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-30T19:09:19.983212] [INFO ] [REMOTE ] HF: Full fetch complete (412 records). [2025-10-30T19:09:19.983338] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-30T19:09:19.983837] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T19:09:19.983931] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:09:19.984009] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:09:19.984092] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-30T19:09:19.984178] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-30T19:09:19.984232] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-30T19:09:19.984288] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-30T19:09:19.984372] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HF took 33.2s. Estimated remaining: 2h 54m 29s. Rate: 7.8 symbols/min [2025-10-30T19:09:20.170049] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:20.187029] [DEBUG] [LOCAL ] HGER: Loaded 15997 existing records from primary storage. [2025-10-30T19:09:20.187253] [INFO ] [MAIN ] HGER: Loaded 15997 existing records. [2025-10-30T19:09:20.362021] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:20.362224] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-30T19:09:20.362271] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-30T19:09:20.362488] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-30T19:09:20.362545] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-30T19:09:20.502761] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-30T19:09:20.740952] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:21.297494] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-30T19:09:21.732066] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-30T19:09:21.814668] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T19:09:22.097568] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-30T19:09:22.543347] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T19:09:22.897517] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-30T19:09:23.149669] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-30T19:09:23.697553] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-30T19:09:24.004023] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-30T19:09:24.497518] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-30T19:09:25.035369] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T19:09:25.297490] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-30T19:09:25.976402] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T19:09:26.097536] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-30T19:09:26.813117] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T19:09:26.897481] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-30T19:09:27.179438] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-30T19:09:27.697518] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-30T19:09:28.366921] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-30T19:09:28.370047] [INFO ] [REMOTE ] HFRO: Full fetch complete (25953 records). [2025-10-30T19:09:28.370121] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-30T19:09:28.502616] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-30T19:09:28.760177] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-30T19:09:28.760251] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-30T19:09:28.760788] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-30T19:09:28.760848] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-30T19:09:28.761448] [DEBUG] [LOCAL ] HFRO: Trimmed 25953 records to 15775 (keeping 200 days of data) [2025-10-30T19:09:28.850530] [DEBUG] [LOCAL ] HFRO: Primary data saved (15775 records). [2025-10-30T19:09:28.850672] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-30T19:09:28.850766] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HFRO took 20.2s. Estimated remaining: 2h 54m 23s. Rate: 7.8 symbols/min [2025-10-30T19:09:29.018899] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:29.030167] [DEBUG] [LOCAL ] HGLB: Loaded 9139 existing records from primary storage. [2025-10-30T19:09:29.030372] [INFO ] [MAIN ] HGLB: Loaded 9139 existing records. [2025-10-30T19:09:29.217977] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:29.218229] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-30T19:09:29.218288] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-30T19:09:29.218480] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-30T19:09:29.218546] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-30T19:09:29.302612] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-30T19:09:29.587244] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:29.735336] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-30T19:09:29.736210] [INFO ] [REMOTE ] HFND: Full fetch complete (1796 records). [2025-10-30T19:09:29.736276] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-30T19:09:29.942205] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-30T19:09:29.945156] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:09:29.945444] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:09:29.945939] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-30T19:09:29.946950] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T19:09:29.947160] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-30T19:09:29.957500] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-30T19:09:29.957885] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-30T19:09:29.958107] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HFND took 34.2s. Estimated remaining: 2h 54m 6s. Rate: 7.8 symbols/min [2025-10-30T19:09:30.105295] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-30T19:09:30.125143] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:30.139722] [DEBUG] [LOCAL ] HGTY: Loaded 13437 existing records from primary storage. [2025-10-30T19:09:30.139961] [INFO ] [MAIN ] HGTY: Loaded 13437 existing records. [2025-10-30T19:09:30.311536] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:30.311790] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-30T19:09:30.311840] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-30T19:09:30.312072] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-30T19:09:30.312112] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-30T19:09:30.661234] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:30.897477] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-30T19:09:31.404158] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-30T19:09:31.559773] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T19:09:31.570844] [INFO ] [REMOTE ] HESM: Full fetch complete (70053 records). [2025-10-30T19:09:31.570982] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-30T19:09:31.711784] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-30T19:09:32.014247] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-30T19:09:32.014368] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-30T19:09:32.015560] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-30T19:09:32.015634] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-30T19:09:32.017191] [DEBUG] [LOCAL ] HESM: Trimmed 70053 records to 48919 (keeping 200 days of data) [2025-10-30T19:09:32.272413] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T19:09:32.349872] [DEBUG] [LOCAL ] HESM: Primary data saved (48919 records). [2025-10-30T19:09:32.350017] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-30T19:09:32.350846] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HESM took 47.9s. Estimated remaining: 2h 53m 52s. Rate: 7.8 symbols/min [2025-10-30T19:09:32.519459] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-30T19:09:32.523956] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:32.568590] [DEBUG] [LOCAL ] HGV: Loaded 45882 existing records from primary storage. [2025-10-30T19:09:32.568942] [INFO ] [MAIN ] HGV: Loaded 45882 existing records. [2025-10-30T19:09:32.742565] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:32.742787] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-30T19:09:32.742835] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-30T19:09:32.743159] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-30T19:09:32.743216] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-30T19:09:33.044509] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T19:09:33.116183] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:33.297492] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-30T19:09:33.803056] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T19:09:34.097579] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-30T19:09:34.606754] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T19:09:34.897577] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-30T19:09:35.385047] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-30T19:09:35.697495] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-30T19:09:36.128186] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-30T19:09:36.497502] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-30T19:09:37.001897] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-30T19:09:37.297523] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-30T19:09:37.756776] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-30T19:09:38.097518] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-30T19:09:38.627851] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-30T19:09:38.897536] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-30T19:09:39.576279] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-30T19:09:39.697490] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-30T19:09:40.181960] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-30T19:09:40.497496] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-30T19:09:41.297472] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-30T19:09:41.454163] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-30T19:09:41.769251] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T19:09:42.097575] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-30T19:09:42.557675] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-30T19:09:42.897504] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-30T19:09:43.438264] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-30T19:09:43.697536] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-30T19:09:44.237283] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T19:09:44.497512] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-30T19:09:45.167086] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-30T19:09:45.170003] [INFO ] [REMOTE ] HGLB: Full fetch complete (14417 records). [2025-10-30T19:09:45.170139] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-30T19:09:45.302637] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-30T19:09:45.556442] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-30T19:09:45.556522] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-30T19:09:45.556863] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-30T19:09:45.556922] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-30T19:09:45.557398] [DEBUG] [LOCAL ] HGLB: Trimmed 14417 records to 9236 (keeping 200 days of data) [2025-10-30T19:09:45.610196] [DEBUG] [LOCAL ] HGLB: Primary data saved (9236 records). [2025-10-30T19:09:45.610316] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-30T19:09:45.610392] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HGLB took 16.8s. Estimated remaining: 2h 53m 51s. Rate: 7.8 symbols/min [2025-10-30T19:09:45.781173] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:45.789679] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T19:09:45.819599] [DEBUG] [LOCAL ] HHH: Loaded 32671 existing records from primary storage. [2025-10-30T19:09:45.819909] [INFO ] [MAIN ] HHH: Loaded 32671 existing records. [2025-10-30T19:09:45.999946] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:46.000112] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-30T19:09:46.000162] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-30T19:09:46.000680] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-30T19:09:46.000739] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-30T19:09:46.100025] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-30T19:09:46.352477] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:46.647399] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-30T19:09:46.897561] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-30T19:09:47.457011] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-30T19:09:47.697485] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-30T19:09:48.497475] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-30T19:09:48.593406] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T19:09:48.885606] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-30T19:09:49.297486] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-30T19:09:50.097508] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-30T19:09:50.347492] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T19:09:50.634087] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-30T19:09:50.897528] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-30T19:09:51.697464] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-30T19:09:51.823156] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T19:09:51.829846] [INFO ] [REMOTE ] HGER: Full fetch complete (19782 records). [2025-10-30T19:09:51.829938] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-30T19:09:52.231681] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-30T19:09:52.231380] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-30T19:09:52.234633] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-30T19:09:52.235334] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-30T19:09:52.235384] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-30T19:09:52.235957] [DEBUG] [LOCAL ] HGER: Trimmed 19782 records to 16178 (keeping 200 days of data) [2025-10-30T19:09:52.327209] [DEBUG] [LOCAL ] HGER: Primary data saved (16178 records). [2025-10-30T19:09:52.327337] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-30T19:09:52.327425] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HGER took 32.3s. Estimated remaining: 2h 53m 42s. Rate: 7.8 symbols/min [2025-10-30T19:09:52.492145] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:52.497572] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-30T19:09:52.524781] [DEBUG] [LOCAL ] HI: Loaded 36127 existing records from primary storage. [2025-10-30T19:09:52.525029] [INFO ] [MAIN ] HI: Loaded 36127 existing records. [2025-10-30T19:09:52.699494] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:52.699701] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-30T19:09:52.699757] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-30T19:09:52.700135] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-30T19:09:52.700174] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-30T19:09:53.072084] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:53.297467] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-30T19:09:53.440244] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T19:09:54.097508] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-30T19:09:54.463516] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T19:09:54.755884] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-30T19:09:54.897534] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-30T19:09:55.570107] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T19:09:55.697505] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-30T19:09:56.398287] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-30T19:09:56.401566] [INFO ] [REMOTE ] HGTY: Full fetch complete (17612 records). [2025-10-30T19:09:56.401673] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-30T19:09:56.502011] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-30T19:09:56.759068] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-30T19:09:56.759143] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-30T19:09:56.759486] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-30T19:09:56.759524] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-30T19:09:56.760043] [DEBUG] [LOCAL ] HGTY: Trimmed 17612 records to 13528 (keeping 200 days of data) [2025-10-30T19:09:56.835371] [DEBUG] [LOCAL ] HGTY: Primary data saved (13528 records). [2025-10-30T19:09:56.835506] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-30T19:09:56.835582] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HGTY took 26.9s. Estimated remaining: 2h 53m 30s. Rate: 7.8 symbols/min [2025-10-30T19:09:57.007907] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:09:57.056011] [DEBUG] [LOCAL ] HIG: Loaded 51007 existing records from primary storage. [2025-10-30T19:09:57.056316] [INFO ] [MAIN ] HIG: Loaded 51007 existing records. [2025-10-30T19:09:57.235977] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:09:57.236180] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-30T19:09:57.236229] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-30T19:09:57.236745] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-30T19:09:57.236808] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-30T19:09:57.302205] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-30T19:09:57.618360] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:09:57.629670] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T19:09:58.097465] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-30T19:09:58.587957] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T19:09:58.897494] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-30T19:09:59.002793] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T19:09:59.697514] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-30T19:10:00.214751] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:10:00.497511] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-30T19:10:01.200354] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T19:10:01.297522] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-30T19:10:02.097530] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-30T19:10:02.403307] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T19:10:02.499637] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-30T19:10:02.897522] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-30T19:10:03.115236] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T19:10:03.697509] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-30T19:10:03.982356] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T19:10:04.497491] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-30T19:10:04.782540] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T19:10:05.297505] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-30T19:10:06.081868] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T19:10:06.102587] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-30T19:10:06.118479] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-30T19:10:06.897493] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-30T19:10:07.195461] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T19:10:07.697478] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-30T19:10:08.388863] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T19:10:08.497493] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-30T19:10:08.638202] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T19:10:09.297481] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-30T19:10:09.830152] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T19:10:10.097471] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-30T19:10:10.574798] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T19:10:10.897460] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-30T19:10:11.071967] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T19:10:11.697491] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-30T19:10:11.855294] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-30T19:10:12.497502] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-30T19:10:12.725524] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T19:10:13.297486] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-30T19:10:13.738850] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T19:10:14.097496] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-30T19:10:14.348712] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-30T19:10:14.897501] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-30T19:10:15.050041] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-30T19:10:15.697506] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-30T19:10:15.952741] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T19:10:16.497497] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-30T19:10:16.697158] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T19:10:17.297470] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-30T19:10:17.493234] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T19:10:18.097466] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-30T19:10:18.292915] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T19:10:18.897501] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-30T19:10:19.453384] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T19:10:19.462915] [INFO ] [REMOTE ] HI: Full fetch complete (51980 records). [2025-10-30T19:10:19.463028] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-30T19:10:19.703297] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-30T19:10:19.889911] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-30T19:10:19.890006] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-30T19:10:19.890797] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-30T19:10:19.890859] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-30T19:10:19.892070] [DEBUG] [LOCAL ] HI: Trimmed 51980 records to 36480 (keeping 200 days of data) [2025-10-30T19:10:20.084340] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T19:10:20.122733] [INFO ] [REMOTE ] HHH: Full fetch complete (45931 records). [2025-10-30T19:10:20.131436] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-30T19:10:20.148698] [DEBUG] [LOCAL ] HI: Primary data saved (36480 records). [2025-10-30T19:10:20.173768] [INFO ] [MAIN ] HI: Full history saved. [2025-10-30T19:10:20.174378] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HI took 27.8s. Estimated remaining: 2h 53m 44s. Rate: 7.8 symbols/min [2025-10-30T19:10:20.517781] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:10:20.537194] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-30T19:10:20.736586] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-30T19:10:20.736778] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-30T19:10:20.737471] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-30T19:10:20.738282] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-30T19:10:20.749700] [DEBUG] [LOCAL ] HII: Loaded 32737 existing records from primary storage. [2025-10-30T19:10:20.750239] [DEBUG] [LOCAL ] HHH: Trimmed 45931 records to 32877 (keeping 200 days of data) [2025-10-30T19:10:20.750372] [INFO ] [MAIN ] HII: Loaded 32737 existing records. [2025-10-30T19:10:21.108903] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:10:21.109875] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-30T19:10:21.111119] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-30T19:10:21.116346] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-30T19:10:21.116575] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-30T19:10:21.402236] [DEBUG] [LOCAL ] HHH: Primary data saved (32877 records). [2025-10-30T19:10:21.408080] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-30T19:10:21.442628] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HHH took 35.8s. Estimated remaining: 2h 53m 27s. Rate: 7.8 symbols/min [2025-10-30T19:10:21.845858] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-30T19:10:21.928792] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-30T19:10:22.014356] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:10:22.050724] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:10:22.085228] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T19:10:22.099896] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-30T19:10:22.101447] [INFO ] [REMOTE ] HGV: Full fetch complete (65935 records). [2025-10-30T19:10:22.101572] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-30T19:10:22.415236] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-30T19:10:22.447120] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-30T19:10:22.779715] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-30T19:10:22.779349] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:10:22.779888] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-30T19:10:22.781001] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-30T19:10:22.781093] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-30T19:10:22.781245] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-30T19:10:22.781525] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-30T19:10:22.782051] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-30T19:10:22.782148] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-30T19:10:22.873930] [DEBUG] [LOCAL ] HGV: Trimmed 65935 records to 46263 (keeping 200 days of data) [2025-10-30T19:10:23.414358] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:10:23.418318] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-30T19:10:23.494802] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-30T19:10:23.515402] [DEBUG] [LOCAL ] HGV: Primary data saved (46263 records). [2025-10-30T19:10:23.544513] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-30T19:10:23.548583] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HGV took 51.2s. Estimated remaining: 2h 53m 12s. Rate: 7.8 symbols/min [2025-10-30T19:10:23.556624] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-30T19:10:23.705181] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-30T19:10:23.738360] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:10:23.760827] [DEBUG] [LOCAL ] HIO: Loaded 23363 existing records from primary storage. [2025-10-30T19:10:23.761082] [INFO ] [MAIN ] HIO: Loaded 23363 existing records. [2025-10-30T19:10:23.937069] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:10:23.937337] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-30T19:10:23.937387] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-30T19:10:23.937734] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-30T19:10:23.937794] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-30T19:10:24.292185] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:10:24.497512] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-30T19:10:24.993086] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T19:10:25.202325] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-30T19:10:25.297468] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-30T19:10:25.347140] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T19:10:26.097512] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-30T19:10:26.897586] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-30T19:10:27.101445] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-30T19:10:27.289322] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T19:10:27.697471] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-30T19:10:27.733391] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T19:10:28.497496] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-30T19:10:29.011634] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T19:10:29.193137] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T19:10:29.297536] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-30T19:10:30.097499] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-30T19:10:30.897478] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-30T19:10:30.923174] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-30T19:10:31.229788] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-30T19:10:31.697552] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-30T19:10:32.263164] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T19:10:32.497496] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-30T19:10:33.297489] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-30T19:10:33.618431] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-30T19:10:33.758225] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T19:10:33.968144] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T19:10:34.097497] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-30T19:10:34.897494] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-30T19:10:35.472638] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-30T19:10:35.485026] [INFO ] [REMOTE ] HIG: Full fetch complete (73699 records). [2025-10-30T19:10:35.485166] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-30T19:10:35.708610] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-30T19:10:35.922942] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-30T19:10:35.923045] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-30T19:10:35.923952] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-30T19:10:35.924016] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-30T19:10:35.925591] [DEBUG] [LOCAL ] HIG: Trimmed 73699 records to 51369 (keeping 200 days of data) [2025-10-30T19:10:36.252408] [DEBUG] [LOCAL ] HIG: Primary data saved (51369 records). [2025-10-30T19:10:36.252532] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-30T19:10:36.252608] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HIG took 39.4s. Estimated remaining: 2h 53m 11s. Rate: 7.8 symbols/min [2025-10-30T19:10:36.415705] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:10:36.434263] [DEBUG] [LOCAL ] HIPO: Loaded 20959 existing records from primary storage. [2025-10-30T19:10:36.434520] [INFO ] [MAIN ] HIPO: Loaded 20959 existing records. [2025-10-30T19:10:36.504632] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-30T19:10:36.617708] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:10:36.617895] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-30T19:10:36.617941] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-30T19:10:36.618117] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-30T19:10:36.618154] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-30T19:10:36.975035] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:10:36.997163] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T19:10:37.035684] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-30T19:10:37.219753] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-30T19:10:37.297496] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-30T19:10:38.033623] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-30T19:10:38.097498] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-30T19:10:38.839338] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-30T19:10:38.897584] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-30T19:10:39.697549] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-30T19:10:40.497543] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-30T19:10:40.741977] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:10:40.821305] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-30T19:10:41.124304] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-30T19:10:41.297502] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-30T19:10:42.101794] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-30T19:10:42.106049] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T19:10:42.897519] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-30T19:10:43.697549] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-30T19:10:44.014214] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T19:10:44.509025] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-30T19:10:44.514889] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-30T19:10:44.785262] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-30T19:10:44.792509] [INFO ] [REMOTE ] HIO: Full fetch complete (38259 records). [2025-10-30T19:10:44.792676] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-30T19:10:45.199178] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-30T19:10:45.199265] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-30T19:10:45.199991] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-30T19:10:45.200058] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-30T19:10:45.201009] [DEBUG] [LOCAL ] HIO: Trimmed 38259 records to 23611 (keeping 200 days of data) [2025-10-30T19:10:45.303074] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-30T19:10:45.342287] [DEBUG] [LOCAL ] HIO: Primary data saved (23611 records). [2025-10-30T19:10:45.342401] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-30T19:10:45.342480] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HIO took 21.8s. Estimated remaining: 2h 53m 5s. Rate: 7.8 symbols/min [2025-10-30T19:10:45.516911] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:10:45.558153] [DEBUG] [LOCAL ] HIW: Loaded 44310 existing records from primary storage. [2025-10-30T19:10:45.558437] [INFO ] [MAIN ] HIW: Loaded 44310 existing records. [2025-10-30T19:10:45.761880] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:10:45.757270] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T19:10:45.768512] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-30T19:10:45.769013] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-30T19:10:45.769889] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-30T19:10:45.769958] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-30T19:10:46.100561] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-30T19:10:46.187512] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:10:46.202660] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T19:10:46.897536] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-30T19:10:47.246044] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:10:47.697495] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-30T19:10:48.497506] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-30T19:10:48.926241] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T19:10:48.933339] [INFO ] [REMOTE ] HII: Full fetch complete (52186 records). [2025-10-30T19:10:48.933444] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-30T19:10:49.309029] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-30T19:10:49.354793] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-30T19:10:49.354881] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-30T19:10:49.355821] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-30T19:10:49.355986] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-30T19:10:49.357633] [DEBUG] [LOCAL ] HII: Trimmed 52186 records to 33035 (keeping 200 days of data) [2025-10-30T19:10:49.488217] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-30T19:10:49.620296] [DEBUG] [LOCAL ] HII: Primary data saved (33035 records). [2025-10-30T19:10:49.620513] [INFO ] [MAIN ] HII: Full history saved. [2025-10-30T19:10:49.621231] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HII took 29.4s. Estimated remaining: 2h 52m 53s. Rate: 7.8 symbols/min [2025-10-30T19:10:49.828825] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:10:49.852437] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T19:10:49.876765] [DEBUG] [LOCAL ] HIX: Loaded 19998 existing records from primary storage. [2025-10-30T19:10:49.877041] [INFO ] [MAIN ] HIX: Loaded 19998 existing records. [2025-10-30T19:10:50.059799] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:10:50.060056] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-30T19:10:50.060111] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-30T19:10:50.060290] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-30T19:10:50.060329] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-30T19:10:50.107756] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-30T19:10:50.385031] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-30T19:10:50.453801] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:10:50.897512] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-30T19:10:51.169056] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T19:10:51.697499] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-30T19:10:52.466885] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-30T19:10:52.497484] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-30T19:10:53.146364] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-30T19:10:53.176146] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T19:10:53.297490] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-30T19:10:53.986945] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-30T19:10:54.097464] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-30T19:10:54.755170] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-30T19:10:54.897478] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-30T19:10:55.686784] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-30T19:10:55.697458] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-30T19:10:56.497510] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-30T19:10:56.612927] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T19:10:57.297497] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-30T19:10:57.644604] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T19:10:58.075186] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T19:10:58.097497] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-30T19:10:58.897498] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-30T19:10:59.634908] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-30T19:10:59.697505] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-30T19:11:00.497507] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-30T19:11:00.842637] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-30T19:11:01.297498] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-30T19:11:01.425347] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-30T19:11:01.514166] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (3.42 seconds). [2025-10-30T19:11:01.526068] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-30T19:11:01.526191] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-30T19:11:01.954702] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-30T19:11:01.954833] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-30T19:11:01.955794] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-30T19:11:01.955873] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-30T19:11:01.957355] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 54207 (keeping 200 days of data) [2025-10-30T19:11:02.067277] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-30T19:11:02.140509] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-30T19:11:02.292682] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-10-30T19:11:02.292815] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-30T19:11:02.293679] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HIMS took 40.8s. Estimated remaining: 2h 52m 52s. Rate: 7.8 symbols/min [2025-10-30T19:11:02.462354] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:11:02.480374] [DEBUG] [LOCAL ] HKD: Loaded 18714 existing records from primary storage. [2025-10-30T19:11:02.480597] [INFO ] [MAIN ] HKD: Loaded 18714 existing records. [2025-10-30T19:11:02.653874] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:11:02.654139] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-30T19:11:02.654186] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-30T19:11:02.654558] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-30T19:11:02.654633] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-30T19:11:02.902594] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-30T19:11:03.005474] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:11:03.054807] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T19:11:03.624164] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T19:11:03.697492] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-30T19:11:04.457817] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T19:11:04.461908] [INFO ] [REMOTE ] HIPO: Full fetch complete (30805 records). [2025-10-30T19:11:04.462017] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-30T19:11:04.502576] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-30T19:11:04.842747] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-30T19:11:04.842827] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-30T19:11:04.843383] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-30T19:11:04.843422] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-30T19:11:04.844113] [DEBUG] [LOCAL ] HIPO: Trimmed 30805 records to 21087 (keeping 200 days of data) [2025-10-30T19:11:04.963116] [DEBUG] [LOCAL ] HIPO: Primary data saved (21087 records). [2025-10-30T19:11:04.963240] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-30T19:11:04.963323] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIPO took 28.7s. Estimated remaining: 2h 52m 38s. Rate: 7.8 symbols/min [2025-10-30T19:11:05.134351] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:11:05.184312] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-30T19:11:05.184622] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-30T19:11:05.302602] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-30T19:11:05.372371] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:11:05.384783] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-30T19:11:05.384897] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-30T19:11:05.385878] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T19:11:05.390875] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-30T19:11:05.390953] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-30T19:11:05.750517] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:11:06.097481] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-30T19:11:06.199903] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T19:11:06.897506] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-30T19:11:07.095834] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-30T19:11:07.697487] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-30T19:11:08.075893] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T19:11:08.421520] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T19:11:08.497489] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-30T19:11:09.297482] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-30T19:11:09.555966] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T19:11:09.831747] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T19:11:10.097486] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-30T19:11:10.900814] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-30T19:11:11.234184] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T19:11:11.697499] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-30T19:11:12.388583] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-30T19:11:12.497900] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-30T19:11:12.500952] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T19:11:13.248707] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-30T19:11:13.297514] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-30T19:11:14.072594] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T19:11:14.097565] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-30T19:11:14.897542] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-30T19:11:15.086164] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-30T19:11:15.090773] [INFO ] [REMOTE ] HIX: Full fetch complete (29852 records). [2025-10-30T19:11:15.090851] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-30T19:11:15.452325] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-30T19:11:15.452406] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-30T19:11:15.452985] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-30T19:11:15.453048] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-30T19:11:15.453891] [DEBUG] [LOCAL ] HIX: Trimmed 29852 records to 20098 (keeping 200 days of data) [2025-10-30T19:11:15.564436] [DEBUG] [LOCAL ] HIX: Primary data saved (20098 records). [2025-10-30T19:11:15.564553] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-30T19:11:15.564638] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HIX took 25.9s. Estimated remaining: 2h 52m 34s. Rate: 7.8 symbols/min [2025-10-30T19:11:15.702717] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-30T19:11:15.734407] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:11:15.776693] [DEBUG] [LOCAL ] HLF: Loaded 48128 existing records from primary storage. [2025-10-30T19:11:15.776988] [INFO ] [MAIN ] HLF: Loaded 48128 existing records. [2025-10-30T19:11:15.951489] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:11:15.951744] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-30T19:11:15.951797] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-30T19:11:15.952207] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-30T19:11:15.952263] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-30T19:11:16.312889] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:11:16.398629] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-30T19:11:16.497532] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-30T19:11:16.613567] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T19:11:17.297503] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-30T19:11:17.646979] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T19:11:18.097512] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-30T19:11:18.751499] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T19:11:18.831415] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T19:11:18.897545] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-30T19:11:19.697500] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-30T19:11:20.035880] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T19:11:20.497553] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-30T19:11:21.065124] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-30T19:11:21.297514] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-30T19:11:21.374827] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T19:11:22.097521] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-30T19:11:22.734638] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T19:11:22.897461] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-30T19:11:22.925009] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T19:11:22.929551] [INFO ] [REMOTE ] HKD: Full fetch complete (27643 records). [2025-10-30T19:11:22.929625] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-30T19:11:23.288461] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-30T19:11:23.288538] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-30T19:11:23.289095] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-30T19:11:23.289156] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-30T19:11:23.289827] [DEBUG] [LOCAL ] HKD: Trimmed 27643 records to 18811 (keeping 200 days of data) [2025-10-30T19:11:23.393795] [DEBUG] [LOCAL ] HKD: Primary data saved (18811 records). [2025-10-30T19:11:23.393931] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-30T19:11:23.394006] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HKD took 21.1s. Estimated remaining: 2h 52m 26s. Rate: 7.8 symbols/min [2025-10-30T19:11:23.557389] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:11:23.587978] [DEBUG] [LOCAL ] HLI: Loaded 30346 existing records from primary storage. [2025-10-30T19:11:23.588243] [INFO ] [MAIN ] HLI: Loaded 30346 existing records. [2025-10-30T19:11:23.702730] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-30T19:11:23.768694] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:11:23.769014] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-30T19:11:23.769064] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-30T19:11:23.769394] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-30T19:11:23.769450] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-30T19:11:24.120969] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:11:24.217944] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T19:11:24.497499] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-30T19:11:25.031770] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T19:11:25.297492] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-30T19:11:25.496349] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T19:11:26.097504] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-30T19:11:26.732708] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T19:11:26.743373] [INFO ] [REMOTE ] HIW: Full fetch complete (65035 records). [2025-10-30T19:11:26.743499] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-30T19:11:26.898491] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-30T19:11:27.192180] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-30T19:11:27.192947] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-30T19:11:27.193708] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:11:27.200520] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-30T19:11:27.200926] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-30T19:11:27.202605] [DEBUG] [LOCAL ] HIW: Trimmed 65035 records to 44645 (keeping 200 days of data) [2025-10-30T19:11:27.465576] [DEBUG] [LOCAL ] HIW: Primary data saved (44645 records). [2025-10-30T19:11:27.465730] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-30T19:11:27.466415] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HIW took 42.1s. Estimated remaining: 2h 52m 14s. Rate: 7.8 symbols/min [2025-10-30T19:11:27.634088] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:11:27.664945] [DEBUG] [LOCAL ] HLIO: Loaded 27852 existing records from primary storage. [2025-10-30T19:11:27.665199] [INFO ] [MAIN ] HLIO: Loaded 27852 existing records. [2025-10-30T19:11:27.707588] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-30T19:11:27.844352] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:11:27.844584] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-30T19:11:27.844693] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-30T19:11:27.844929] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-30T19:11:27.844968] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-30T19:11:28.199253] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:11:28.497472] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-30T19:11:28.705291] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-30T19:11:28.876168] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-30T19:11:29.297554] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-30T19:11:29.737121] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T19:11:29.940569] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-30T19:11:30.097495] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-30T19:11:30.897499] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-30T19:11:31.453620] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T19:11:31.563954] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T19:11:31.697505] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-30T19:11:32.497524] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-30T19:11:33.301275] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-30T19:11:33.309180] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T19:11:33.485138] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-30T19:11:34.097533] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-30T19:11:34.292106] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T19:11:34.897482] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-30T19:11:35.252627] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T19:11:35.697510] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-30T19:11:36.497483] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-30T19:11:36.537307] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-30T19:11:36.621520] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T19:11:37.297471] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-30T19:11:37.353010] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-30T19:11:38.097465] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-30T19:11:38.202603] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T19:11:38.897536] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-30T19:11:39.697472] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-30T19:11:39.833732] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T19:11:40.258599] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-30T19:11:40.271237] [INFO ] [REMOTE ] HL: Full fetch complete (77830 records). [2025-10-30T19:11:40.271448] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-30T19:11:40.503602] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-30T19:11:40.718271] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-30T19:11:40.718489] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-30T19:11:40.719861] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-30T19:11:40.719947] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-30T19:11:40.722252] [DEBUG] [LOCAL ] HL: Trimmed 77830 records to 54066 (keeping 200 days of data) [2025-10-30T19:11:40.972426] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:11:41.084201] [DEBUG] [LOCAL ] HL: Primary data saved (54066 records). [2025-10-30T19:11:41.084337] [INFO ] [MAIN ] HL: Full history saved. [2025-10-30T19:11:41.084415] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HL took 36.1s. Estimated remaining: 2h 52m 14s. Rate: 7.8 symbols/min [2025-10-30T19:11:41.254939] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:11:41.284469] [DEBUG] [LOCAL ] HLLY: Loaded 33175 existing records from primary storage. [2025-10-30T19:11:41.284765] [INFO ] [MAIN ] HLLY: Loaded 33175 existing records. [2025-10-30T19:11:41.305297] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-30T19:11:41.468799] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:11:41.469078] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-30T19:11:41.469209] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-30T19:11:41.469519] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-30T19:11:41.469574] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-30T19:11:41.638633] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:11:41.856359] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:11:42.097493] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-30T19:11:42.139824] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T19:11:42.897517] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-30T19:11:43.325691] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:11:43.697471] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-30T19:11:43.743335] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-30T19:11:44.497533] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-30T19:11:44.634322] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T19:11:45.297512] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-30T19:11:45.315284] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T19:11:46.074894] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T19:11:46.097459] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-30T19:11:46.897491] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-30T19:11:47.138197] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T19:11:47.143949] [INFO ] [REMOTE ] HLIO: Full fetch complete (37309 records). [2025-10-30T19:11:47.144027] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-30T19:11:47.510377] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-30T19:11:47.510451] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-30T19:11:47.511057] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-30T19:11:47.511117] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-30T19:11:47.511899] [DEBUG] [LOCAL ] HLIO: Trimmed 37309 records to 27987 (keeping 200 days of data) [2025-10-30T19:11:47.672238] [DEBUG] [LOCAL ] HLIO: Primary data saved (27987 records). [2025-10-30T19:11:47.672353] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-30T19:11:47.672427] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HLIO took 20.2s. Estimated remaining: 2h 52m 5s. Rate: 7.8 symbols/min [2025-10-30T19:11:47.702711] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-30T19:11:47.845962] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:11:47.893554] [DEBUG] [LOCAL ] HLN: Loaded 53092 existing records from primary storage. [2025-10-30T19:11:47.893904] [INFO ] [MAIN ] HLN: Loaded 53092 existing records. [2025-10-30T19:11:48.067814] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:11:48.068067] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-30T19:11:48.068128] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-30T19:11:48.068309] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-30T19:11:48.068347] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-30T19:11:48.424159] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:11:48.462925] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T19:11:48.497542] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-30T19:11:48.526016] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T19:11:49.297495] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-30T19:11:49.728426] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T19:11:50.097470] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-30T19:11:50.143049] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-30T19:11:50.897509] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-30T19:11:51.295728] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T19:11:51.697484] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-30T19:11:51.869995] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T19:11:52.497552] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-30T19:11:52.897685] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T19:11:53.297515] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-30T19:11:53.518326] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T19:11:54.097537] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-30T19:11:54.205776] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T19:11:54.897571] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-30T19:11:55.609010] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-30T19:11:55.697468] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-30T19:11:55.896932] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-30T19:11:56.497541] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-30T19:11:57.043846] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T19:11:57.297555] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-30T19:11:57.510497] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T19:11:58.097574] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-30T19:11:58.760017] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-30T19:11:58.897470] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-30T19:11:59.067248] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T19:11:59.697567] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-30T19:12:00.191039] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T19:12:00.497516] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-30T19:12:01.297554] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-30T19:12:01.336488] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T19:12:01.349764] [INFO ] [REMOTE ] HLF: Full fetch complete (70556 records). [2025-10-30T19:12:01.349934] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-30T19:12:01.955702] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-30T19:12:01.955847] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-30T19:12:01.957561] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-30T19:12:01.957896] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-30T19:12:01.973415] [DEBUG] [LOCAL ] HLF: Trimmed 70556 records to 48430 (keeping 200 days of data) [2025-10-30T19:12:01.988448] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T19:12:02.094602] [INFO ] [REMOTE ] HLI: Full fetch complete (45531 records). [2025-10-30T19:12:02.103811] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-30T19:12:02.103693] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-30T19:12:02.705257] [DEBUG] [LOCAL ] HLF: Primary data saved (48430 records). [2025-10-30T19:12:02.734760] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-30T19:12:02.735575] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HLF took 47.2s. Estimated remaining: 2h 52m 6s. Rate: 7.8 symbols/min [2025-10-30T19:12:02.734679] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-30T19:12:02.735875] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-30T19:12:02.736785] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-30T19:12:02.748863] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-30T19:12:02.848864] [DEBUG] [LOCAL ] HLI: Trimmed 45531 records to 30683 (keeping 200 days of data) [2025-10-30T19:12:02.926213] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:03.064378] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-30T19:12:03.096191] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-30T19:12:03.181376] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-30T19:12:03.201420] [DEBUG] [LOCAL ] HLI: Primary data saved (30683 records). [2025-10-30T19:12:03.202043] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-30T19:12:03.215936] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLI took 39.8s. Estimated remaining: 2h 51m 49s. Rate: 7.8 symbols/min [2025-10-30T19:12:03.249841] [DEBUG] [LOCAL ] HLT: Loaded 50366 existing records from primary storage. [2025-10-30T19:12:03.289215] [INFO ] [MAIN ] HLT: Loaded 50366 existing records. [2025-10-30T19:12:03.555462] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:03.590762] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:12:03.591072] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-30T19:12:03.591123] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-30T19:12:03.591481] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-30T19:12:03.591524] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-30T19:12:03.697778] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-30T19:12:03.875602] [DEBUG] [LOCAL ] HLX: Loaded 47244 existing records from primary storage. [2025-10-30T19:12:03.898012] [INFO ] [MAIN ] HLX: Loaded 47244 existing records. [2025-10-30T19:12:04.127413] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:04.166112] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:12:04.166323] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-30T19:12:04.166371] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-30T19:12:04.166639] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-30T19:12:04.166729] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-30T19:12:04.500635] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-30T19:12:04.521289] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:04.597037] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T19:12:04.627311] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T19:12:05.297515] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-30T19:12:05.898493] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T19:12:06.097504] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-30T19:12:06.538862] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T19:12:06.897509] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-30T19:12:07.036577] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T19:12:07.697464] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-30T19:12:07.925106] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T19:12:08.497509] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-30T19:12:08.726105] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T19:12:09.297492] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-30T19:12:10.048203] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T19:12:10.060948] [INFO ] [REMOTE ] HLN: Full fetch complete (77026 records). [2025-10-30T19:12:10.061133] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-30T19:12:10.102673] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-30T19:12:10.483924] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-30T19:12:10.491357] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-30T19:12:10.505342] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-30T19:12:10.506046] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-30T19:12:10.507122] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T19:12:10.516423] [DEBUG] [LOCAL ] HLN: Trimmed 77026 records to 53482 (keeping 200 days of data) [2025-10-30T19:12:10.839268] [DEBUG] [LOCAL ] HLN: Primary data saved (53482 records). [2025-10-30T19:12:10.839438] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-30T19:12:10.840199] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLN took 23.2s. Estimated remaining: 2h 51m 41s. Rate: 7.8 symbols/min [2025-10-30T19:12:10.904554] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-30T19:12:11.029078] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:11.072463] [DEBUG] [LOCAL ] HMC: Loaded 46014 existing records from primary storage. [2025-10-30T19:12:11.072795] [INFO ] [MAIN ] HMC: Loaded 46014 existing records. [2025-10-30T19:12:11.250541] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:12:11.250797] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-30T19:12:11.250884] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-30T19:12:11.251076] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-30T19:12:11.251116] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-30T19:12:11.621750] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:11.648914] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-30T19:12:11.697535] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-30T19:12:12.042074] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T19:12:12.049009] [INFO ] [REMOTE ] HLLY: Full fetch complete (46021 records). [2025-10-30T19:12:12.049109] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-30T19:12:12.416222] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-30T19:12:12.416296] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-30T19:12:12.417016] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-30T19:12:12.417078] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-30T19:12:12.418014] [DEBUG] [LOCAL ] HLLY: Trimmed 46021 records to 33343 (keeping 200 days of data) [2025-10-30T19:12:12.498698] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-30T19:12:12.598834] [DEBUG] [LOCAL ] HLLY: Primary data saved (33343 records). [2025-10-30T19:12:12.598967] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-30T19:12:12.599043] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLLY took 31.5s. Estimated remaining: 2h 51m 26s. Rate: 7.8 symbols/min [2025-10-30T19:12:12.765016] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:12.786793] [DEBUG] [LOCAL ] HMN: Loaded 22853 existing records from primary storage. [2025-10-30T19:12:12.787047] [INFO ] [MAIN ] HMN: Loaded 22853 existing records. [2025-10-30T19:12:12.963134] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:12:12.963357] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-30T19:12:12.963403] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-30T19:12:12.963629] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-30T19:12:12.963719] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-30T19:12:13.297693] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-30T19:12:13.319797] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:13.349879] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-30T19:12:13.810514] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T19:12:14.097511] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-30T19:12:14.479355] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T19:12:14.805030] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-30T19:12:14.897494] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-30T19:12:15.697526] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-30T19:12:16.224096] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T19:12:16.497520] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-30T19:12:16.980371] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T19:12:17.225399] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:12:17.297478] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-30T19:12:17.879238] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-30T19:12:18.097526] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-30T19:12:18.897512] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-30T19:12:19.329445] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:12:19.697468] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-30T19:12:19.821311] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T19:12:20.497501] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-30T19:12:20.794378] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:12:21.297535] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-30T19:12:22.097547] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-30T19:12:22.152713] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-30T19:12:22.668736] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T19:12:22.897543] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-30T19:12:23.445313] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T19:12:23.697558] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-30T19:12:24.371676] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T19:12:24.497526] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-30T19:12:25.082181] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T19:12:25.297462] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-30T19:12:25.345374] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T19:12:26.097502] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-30T19:12:26.465841] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T19:12:26.897494] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-30T19:12:27.329275] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T19:12:27.697537] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-30T19:12:27.807013] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-30T19:12:28.497503] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-30T19:12:29.097106] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T19:12:29.297478] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-30T19:12:29.853061] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T19:12:30.097484] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-30T19:12:30.470890] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T19:12:30.897508] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-30T19:12:31.380560] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T19:12:31.697501] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-30T19:12:32.186339] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T19:12:32.497475] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-30T19:12:32.599200] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-30T19:12:33.297518] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-30T19:12:33.780947] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T19:12:34.097525] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-30T19:12:34.812975] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T19:12:34.824502] [INFO ] [REMOTE ] HLX: Full fetch complete (68994 records). [2025-10-30T19:12:34.824784] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-30T19:12:34.902784] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-30T19:12:35.243360] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-30T19:12:35.243456] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-30T19:12:35.244453] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-30T19:12:35.244522] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-30T19:12:35.245918] [DEBUG] [LOCAL ] HLX: Trimmed 68994 records to 47564 (keeping 200 days of data) [2025-10-30T19:12:35.520767] [DEBUG] [LOCAL ] HLX: Primary data saved (47564 records). [2025-10-30T19:12:35.536095] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-30T19:12:35.540323] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLX took 32.3s. Estimated remaining: 2h 51m 38s. Rate: 7.8 symbols/min [2025-10-30T19:12:35.600284] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-30T19:12:35.704529] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-30T19:12:35.733056] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:35.748043] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-30T19:12:35.811092] [DEBUG] [LOCAL ] HMY: Loaded 53163 existing records from primary storage. [2025-10-30T19:12:35.811425] [INFO ] [MAIN ] HMY: Loaded 53163 existing records. [2025-10-30T19:12:35.988405] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:12:35.988699] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-30T19:12:35.988757] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-30T19:12:35.989509] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-30T19:12:35.989568] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-30T19:12:36.338204] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:36.497497] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-30T19:12:36.909573] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T19:12:37.297483] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-30T19:12:37.691546] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T19:12:38.097494] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-30T19:12:38.838546] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-30T19:12:38.849054] [INFO ] [REMOTE ] HMC: Full fetch complete (68373 records). [2025-10-30T19:12:38.849184] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-30T19:12:38.908933] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-30T19:12:39.251631] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-30T19:12:39.251755] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-30T19:12:39.252610] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-30T19:12:39.252685] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-30T19:12:39.254044] [DEBUG] [LOCAL ] HMC: Trimmed 68373 records to 46367 (keeping 200 days of data) [2025-10-30T19:12:39.517156] [DEBUG] [LOCAL ] HMC: Primary data saved (46367 records). [2025-10-30T19:12:39.517293] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-30T19:12:39.518121] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HMC took 28.7s. Estimated remaining: 2h 51m 26s. Rate: 7.8 symbols/min [2025-10-30T19:12:39.711188] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-30T19:12:39.730827] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:39.731289] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-30T19:12:39.731461] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-30T19:12:39.731871] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-30T19:12:39.731959] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-30T19:12:39.732068] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-30T19:12:39.732151] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-30T19:12:40.141484] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:40.135967] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-30T19:12:40.152885] [INFO ] [REMOTE ] HLT: Full fetch complete (73662 records). [2025-10-30T19:12:40.152997] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-30T19:12:40.500540] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-30T19:12:40.573769] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-30T19:12:40.575086] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-30T19:12:40.575188] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-30T19:12:40.580711] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-30T19:12:40.597053] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-30T19:12:40.609085] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T19:12:40.620155] [DEBUG] [LOCAL ] HLT: Trimmed 73662 records to 50747 (keeping 200 days of data) [2025-10-30T19:12:40.708716] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T19:12:40.710176] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-30T19:12:40.714714] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:12:40.722671] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-30T19:12:40.734444] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:12:40.734552] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-30T19:12:40.741763] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-30T19:12:40.746081] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-30T19:12:40.746178] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-30T19:12:40.746290] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HNGE took 1.2s. Estimated remaining: 2h 51m 9s. Rate: 7.8 symbols/min [2025-10-30T19:12:41.039777] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:41.118814] [DEBUG] [LOCAL ] HLT: Primary data saved (50747 records). [2025-10-30T19:12:41.119023] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-30T19:12:41.119585] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HLT took 38.4s. Estimated remaining: 2h 50m 52s. Rate: 7.8 symbols/min [2025-10-30T19:12:41.279158] [DEBUG] [LOCAL ] HNI: Loaded 29870 existing records from primary storage. [2025-10-30T19:12:41.307712] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-30T19:12:41.292157] [INFO ] [MAIN ] HNI: Loaded 29870 existing records. [2025-10-30T19:12:41.311013] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:41.312152] [DEBUG] [LOCAL ] HOG: No existing data file found in primary storage. [2025-10-30T19:12:41.323345] [WARN ] [MAIN ] HOG: No existing data found, performing full refresh instead. [2025-10-30T19:12:41.350478] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-30T19:12:41.350731] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-30T19:12:41.367752] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-30T19:12:41.388353] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-30T19:12:41.663946] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:12:41.675165] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-30T19:12:41.684380] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-30T19:12:41.712006] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-30T19:12:41.752806] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-30T19:12:42.053802] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:42.102609] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-30T19:12:42.270895] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-30T19:12:42.270363] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:42.275871] [INFO ] [REMOTE ] HMN: Full fetch complete (31809 records). [2025-10-30T19:12:42.275995] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-30T19:12:42.644839] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-30T19:12:42.644917] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-30T19:12:42.645575] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-30T19:12:42.645615] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-30T19:12:42.646385] [DEBUG] [LOCAL ] HMN: Trimmed 31809 records to 23042 (keeping 200 days of data) [2025-10-30T19:12:42.783059] [DEBUG] [LOCAL ] HMN: Primary data saved (23042 records). [2025-10-30T19:12:42.783180] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-30T19:12:42.783255] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HMN took 30.2s. Estimated remaining: 2h 50m 37s. Rate: 7.8 symbols/min [2025-10-30T19:12:42.902581] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-30T19:12:42.962553] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:12:43.003387] [DEBUG] [LOCAL ] HOMB: Loaded 43495 existing records from primary storage. [2025-10-30T19:12:43.003765] [INFO ] [MAIN ] HOMB: Loaded 43495 existing records. [2025-10-30T19:12:43.180469] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:12:43.180752] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-30T19:12:43.180805] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-30T19:12:43.180979] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-30T19:12:43.181019] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-30T19:12:43.543130] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:12:43.584847] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-30T19:12:43.697478] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-30T19:12:43.768124] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-30T19:12:44.497526] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-30T19:12:44.792599] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T19:12:45.297472] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-30T19:12:45.439250] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T19:12:46.097538] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-30T19:12:46.839046] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-30T19:12:46.897480] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-30T19:12:47.218195] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T19:12:47.697509] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-30T19:12:48.381199] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T19:12:48.497537] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-30T19:12:48.801560] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:12:49.297557] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-30T19:12:49.476502] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T19:12:50.097568] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-30T19:12:50.526839] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T19:12:50.897515] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-30T19:12:51.545075] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-30T19:12:51.697466] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-30T19:12:51.757631] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T19:12:52.497505] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-30T19:12:53.297468] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-30T19:12:53.588131] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-30T19:12:53.926573] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T19:12:53.963115] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T19:12:54.097548] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-30T19:12:54.897554] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-30T19:12:55.402022] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T19:12:55.697505] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-30T19:12:56.461903] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-30T19:12:56.497490] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-30T19:12:56.904491] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T19:12:57.297526] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-30T19:12:57.915995] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-30T19:12:58.097495] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-30T19:12:58.327439] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T19:12:58.897502] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-30T19:12:59.665714] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T19:12:59.697486] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-30T19:13:00.192490] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T19:13:00.497513] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-30T19:13:01.297503] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-30T19:13:01.406350] [DEBUG] [REMOTE ] HMY: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-30T19:13:01.406533] [WARN ] [REMOTE ] HMY: No data returned for month 2025-08 [2025-10-30T19:13:01.406614] [FATAL] [REMOTE ] HMY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:13:01.406699] [FATAL] [MAIN ] HMY: Failed to fetch primary data. [2025-10-30T19:13:01.406781] [WARN ] [MAIN ] HMY: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:13:01.406855] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-30T19:13:01.406917] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-30T19:13:01.406953] [INFO ] [LOCAL ] HMY: Starting deletion of derivative data. [2025-10-30T19:13:01.407120] [DEBUG] [LOCAL ] HMY: Deleted derivative data file. [2025-10-30T19:13:01.407191] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HMY took 25.9s. Estimated remaining: 2h 50m 43s. Rate: 7.8 symbols/min [2025-10-30T19:13:01.583215] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:13:01.632603] [DEBUG] [LOCAL ] HOUS: Loaded 45845 existing records from primary storage. [2025-10-30T19:13:01.633031] [INFO ] [MAIN ] HOUS: Loaded 45845 existing records. [2025-10-30T19:13:01.815758] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:13:01.815960] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-30T19:13:01.816008] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-30T19:13:01.816283] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-30T19:13:01.816325] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-30T19:13:02.099992] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-30T19:13:02.206200] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:13:02.221753] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T19:13:02.256528] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-30T19:13:02.897497] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-30T19:13:03.217017] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T19:13:03.697456] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-30T19:13:03.741569] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-30T19:13:04.497493] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-30T19:13:04.894407] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-30T19:13:05.297479] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-30T19:13:05.478958] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-30T19:13:06.097491] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-30T19:13:06.719447] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T19:13:06.897469] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-30T19:13:07.126893] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T19:13:07.697496] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-30T19:13:08.138588] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T19:13:08.497488] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-30T19:13:08.723611] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T19:13:09.297499] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-30T19:13:10.103157] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-30T19:13:10.121905] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-30T19:13:10.133730] [INFO ] [REMOTE ] HOG: Full fetch complete (74221 records). [2025-10-30T19:13:10.133917] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-30T19:13:10.749574] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-30T19:13:10.749730] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-30T19:13:10.750940] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-30T19:13:10.751023] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-30T19:13:10.791608] [DEBUG] [LOCAL ] HOG: Trimmed 74221 records to 50819 (keeping 200 days of data) [2025-10-30T19:13:10.794390] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T19:13:10.897705] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-30T19:13:11.131846] [DEBUG] [LOCAL ] HOG: Primary data saved (50819 records). [2025-10-30T19:13:11.131974] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-30T19:13:11.132049] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HOG took 30.0s. Estimated remaining: 2h 50m 38s. Rate: 7.8 symbols/min [2025-10-30T19:13:11.337555] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T19:13:11.697531] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-30T19:13:12.021349] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-30T19:13:12.028948] [INFO ] [REMOTE ] HNI: Full fetch complete (42472 records). [2025-10-30T19:13:12.029064] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-30T19:13:12.408789] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-30T19:13:12.408866] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-30T19:13:12.409515] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-30T19:13:12.409555] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-30T19:13:12.410399] [DEBUG] [LOCAL ] HNI: Trimmed 42472 records to 30158 (keeping 200 days of data) [2025-10-30T19:13:12.499799] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-30T19:13:12.596270] [DEBUG] [LOCAL ] HNI: Primary data saved (30158 records). [2025-10-30T19:13:12.596436] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-30T19:13:12.596536] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HNI took 31.9s. Estimated remaining: 2h 50m 22s. Rate: 7.8 symbols/min [2025-10-30T19:13:13.117463] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T19:13:13.128575] [INFO ] [REMOTE ] HOMB: Full fetch complete (64426 records). [2025-10-30T19:13:13.128754] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-30T19:13:13.562266] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-30T19:13:13.562370] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-30T19:13:13.563262] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-30T19:13:13.563343] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-30T19:13:13.586282] [DEBUG] [LOCAL ] HOMB: Trimmed 64426 records to 43836 (keeping 200 days of data) [2025-10-30T19:13:13.588211] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-30T19:13:13.648539] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-30T19:13:13.853811] [DEBUG] [LOCAL ] HOMB: Primary data saved (43836 records). [2025-10-30T19:13:13.853931] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-30T19:13:13.854005] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOMB took 31.1s. Estimated remaining: 2h 50m 6s. Rate: 7.8 symbols/min [2025-10-30T19:13:14.945733] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:13:14.954735] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-30T19:13:16.184049] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T19:13:16.193444] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-30T19:13:17.149610] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T19:13:17.158874] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-30T19:14:11.346012] [DEBUG] [REMOTE ] HOUS: Error fetching primary data for 2025-06: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-30T19:14:11.346179] [WARN ] [REMOTE ] HOUS: No data returned for month 2025-06 [2025-10-30T19:14:11.346257] [FATAL] [REMOTE ] HOUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:14:11.346303] [FATAL] [MAIN ] HOUS: Failed to fetch primary data. [2025-10-30T19:14:11.346337] [WARN ] [MAIN ] HOUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:14:11.346375] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-30T19:14:11.346468] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-30T19:14:11.346518] [INFO ] [LOCAL ] HOUS: Starting deletion of derivative data. [2025-10-30T19:14:11.346727] [DEBUG] [LOCAL ] HOUS: Deleted derivative data file. [2025-10-30T19:14:11.346818] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HOUS took 1m 10s. Estimated remaining: 2h 51m 2s. Rate: 7.8 symbols/min [2025-10-30T19:14:12.101060] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:12.102143] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:12.130893] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:12.154051] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:12.167150] [DEBUG] [LOCAL ] HPF: Loaded 7269 existing records from primary storage. [2025-10-30T19:14:12.167515] [INFO ] [MAIN ] HPF: Loaded 7269 existing records. [2025-10-30T19:14:12.221007] [DEBUG] [LOCAL ] HOV: Loaded 13593 existing records from primary storage. [2025-10-30T19:14:12.261474] [INFO ] [MAIN ] HOV: Loaded 13593 existing records. [2025-10-30T19:14:12.462819] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:12.491389] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-30T19:14:12.515399] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-30T19:14:12.582416] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-30T19:14:12.600682] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:12.616100] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-30T19:14:12.623486] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-30T19:14:12.621576] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-30T19:14:12.623639] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-30T19:14:12.623843] [DEBUG] [LOCAL ] HP: Loaded 51212 existing records from primary storage. [2025-10-30T19:14:12.668801] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-30T19:14:12.669274] [INFO ] [MAIN ] HP: Loaded 51212 existing records. [2025-10-30T19:14:12.668998] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-30T19:14:12.669378] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-30T19:14:13.478850] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:13.521966] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:13.565636] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-30T19:14:13.582612] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-30T19:14:13.596991] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-30T19:14:13.631135] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-30T19:14:13.625868] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-30T19:14:13.646721] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-30T19:14:13.719792] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:13.756514] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-30T19:14:13.767326] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-30T19:14:13.787811] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-30T19:14:14.031541] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:14.073175] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-30T19:14:14.475995] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-30T19:14:14.493119] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-30T19:14:14.591328] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:14.637823] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-30T19:14:14.685514] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:14.685848] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-30T19:14:14.870207] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T19:14:14.873267] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-30T19:14:14.917488] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T19:14:14.919440] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-30T19:14:15.324692] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T19:14:15.327830] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-30T19:14:15.353442] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T19:14:15.356160] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-30T19:14:15.885329] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-30T19:14:15.887862] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-30T19:14:15.919912] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T19:14:15.929803] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-30T19:14:15.940784] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-30T19:14:15.944723] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-30T19:14:16.060744] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-30T19:14:16.071200] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-30T19:14:16.362807] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T19:14:16.364953] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-30T19:14:16.589270] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-30T19:14:16.592666] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-30T19:14:16.909567] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T19:14:16.912013] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-30T19:14:17.193102] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-30T19:14:17.210174] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-30T19:14:17.209937] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-30T19:14:17.213705] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-30T19:14:17.387235] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-30T19:14:17.389931] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-30T19:14:17.601351] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-30T19:14:17.611465] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-30T19:14:17.730992] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-30T19:14:17.733166] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-30T19:14:18.013035] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-30T19:14:18.017322] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-30T19:14:18.239627] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-30T19:14:18.243325] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-30T19:14:18.362036] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T19:14:18.372885] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-30T19:14:18.666245] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-30T19:14:18.670590] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-30T19:14:18.798756] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-30T19:14:18.801502] [INFO ] [REMOTE ] HPF: Full fetch complete (10326 records). [2025-10-30T19:14:18.801607] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-30T19:14:19.198600] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-30T19:14:19.198877] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-30T19:14:19.199382] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-30T19:14:19.199604] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-30T19:14:19.200326] [DEBUG] [LOCAL ] HPF: Trimmed 10326 records to 7324 (keeping 200 days of data) [2025-10-30T19:14:19.274155] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-30T19:14:19.289108] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-30T19:14:19.290572] [DEBUG] [LOCAL ] HPF: Primary data saved (7324 records). [2025-10-30T19:14:19.291522] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-30T19:14:19.291751] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HPF took 7.9s. Estimated remaining: 2h 50m 55s. Rate: 7.8 symbols/min [2025-10-30T19:14:19.400529] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T19:14:19.439592] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-30T19:14:19.497135] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:19.534891] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T19:14:19.550122] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-30T19:14:19.549868] [DEBUG] [LOCAL ] HPI: Loaded 10520 existing records from primary storage. [2025-10-30T19:14:19.551054] [INFO ] [MAIN ] HPI: Loaded 10520 existing records. [2025-10-30T19:14:19.731881] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:19.732106] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-30T19:14:19.732154] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-30T19:14:19.732305] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-30T19:14:19.732343] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-30T19:14:20.078320] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:20.078662] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-30T19:14:20.250900] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T19:14:20.255857] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-30T19:14:20.568895] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T19:14:20.571091] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-30T19:14:20.858111] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-30T19:14:20.861458] [INFO ] [REMOTE ] HOV: Full fetch complete (18787 records). [2025-10-30T19:14:20.861595] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-30T19:14:21.041537] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T19:14:21.046067] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-30T19:14:21.266104] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-30T19:14:21.266274] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-30T19:14:21.266733] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-30T19:14:21.267039] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-30T19:14:21.278062] [DEBUG] [LOCAL ] HOV: Trimmed 18787 records to 13690 (keeping 200 days of data) [2025-10-30T19:14:21.329890] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-30T19:14:21.365437] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-30T19:14:21.418906] [DEBUG] [LOCAL ] HOV: Primary data saved (13690 records). [2025-10-30T19:14:21.420445] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-30T19:14:21.420568] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-30T19:14:21.430683] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HOV took 10.1s. Estimated remaining: 2h 50m 40s. Rate: 7.8 symbols/min [2025-10-30T19:14:21.442096] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-30T19:14:21.475602] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T19:14:21.500936] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-30T19:14:21.617486] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:21.664491] [DEBUG] [LOCAL ] HPP: Loaded 51213 existing records from primary storage. [2025-10-30T19:14:21.664816] [INFO ] [MAIN ] HPP: Loaded 51213 existing records. [2025-10-30T19:14:21.846222] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:21.846467] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-30T19:14:21.846550] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-30T19:14:21.846842] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-30T19:14:21.846909] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-30T19:14:22.141359] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-30T19:14:22.164598] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-30T19:14:22.224027] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:22.224366] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-30T19:14:22.705439] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:14:22.716356] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-30T19:14:22.723092] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T19:14:22.725572] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-30T19:14:22.859096] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T19:14:22.870064] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-30T19:14:23.227355] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-30T19:14:23.229747] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-30T19:14:23.463097] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T19:14:23.473202] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-30T19:14:23.749290] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-30T19:14:23.752068] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-30T19:14:23.855994] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:14:23.867558] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-30T19:14:24.230035] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-30T19:14:24.240577] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-30T19:14:24.420572] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-30T19:14:24.424681] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-30T19:14:24.551965] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T19:14:24.561151] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-30T19:14:25.062292] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-30T19:14:25.066355] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-30T19:14:25.326240] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T19:14:25.337239] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-30T19:14:25.570343] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T19:14:25.580845] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-30T19:14:25.591778] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-30T19:14:25.594352] [INFO ] [REMOTE ] HPI: Full fetch complete (13825 records). [2025-10-30T19:14:25.594422] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-30T19:14:25.994342] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-30T19:14:26.005590] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-30T19:14:26.011135] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-30T19:14:26.021664] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-30T19:14:26.025157] [DEBUG] [LOCAL ] HPI: Trimmed 13825 records to 10600 (keeping 200 days of data) [2025-10-30T19:14:26.027680] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-30T19:14:26.085273] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-30T19:14:26.103885] [DEBUG] [LOCAL ] HPI: Primary data saved (10600 records). [2025-10-30T19:14:26.104830] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-30T19:14:26.104925] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HPI took 6.8s. Estimated remaining: 2h 50m 28s. Rate: 7.8 symbols/min [2025-10-30T19:14:26.272756] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:26.323079] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-30T19:14:26.323379] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-30T19:14:26.508524] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:26.509029] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-30T19:14:26.509155] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-30T19:14:26.510070] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-30T19:14:26.510130] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-30T19:14:26.764159] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T19:14:26.809098] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-30T19:14:26.936114] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T19:14:26.973538] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:26.974340] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-30T19:14:26.974043] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-30T19:14:27.780682] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-30T19:14:27.792215] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-30T19:14:28.188195] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T19:14:28.198959] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-30T19:14:28.248777] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T19:14:28.259566] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-30T19:14:28.289710] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T19:14:28.300552] [INFO ] [REMOTE ] HP: Full fetch complete (74169 records). [2025-10-30T19:14:28.300704] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-30T19:14:28.692229] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-30T19:14:28.692308] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-30T19:14:28.693215] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-30T19:14:28.693278] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-30T19:14:28.694610] [DEBUG] [LOCAL ] HP: Trimmed 74169 records to 51595 (keeping 200 days of data) [2025-10-30T19:14:28.998618] [DEBUG] [LOCAL ] HP: Primary data saved (51595 records). [2025-10-30T19:14:28.998774] [INFO ] [MAIN ] HP: Full history saved. [2025-10-30T19:14:28.998859] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HP took 17.7s. Estimated remaining: 2h 50m 14s. Rate: 7.8 symbols/min [2025-10-30T19:14:29.177332] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:29.189446] [DEBUG] [LOCAL ] HPS: Loaded 10061 existing records from primary storage. [2025-10-30T19:14:29.189717] [INFO ] [MAIN ] HPS: Loaded 10061 existing records. [2025-10-30T19:14:29.304629] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T19:14:29.344431] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-30T19:14:29.418851] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:29.419308] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-30T19:14:29.419386] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-30T19:14:29.419745] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-30T19:14:29.419807] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-30T19:14:29.742677] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-30T19:14:29.812558] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-30T19:14:29.834304] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:29.835683] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-30T19:14:29.866660] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-30T19:14:29.877350] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-30T19:14:30.445141] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T19:14:30.447702] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-30T19:14:30.687208] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T19:14:30.699712] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-30T19:14:30.956277] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T19:14:30.959154] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-30T19:14:31.227026] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-30T19:14:31.238277] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-30T19:14:31.418801] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-30T19:14:31.421528] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-30T19:14:31.712276] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-30T19:14:31.724123] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-30T19:14:31.724261] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-30T19:14:31.995817] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-30T19:14:32.029372] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-30T19:14:32.148945] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T19:14:32.189588] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-30T19:14:32.189700] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-30T19:14:32.190638] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-30T19:14:32.191089] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-30T19:14:32.191033] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-30T19:14:32.193013] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 54087 (keeping 200 days of data) [2025-10-30T19:14:32.532250] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-10-30T19:14:32.532446] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-30T19:14:32.532568] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HPE took 21.2s. Estimated remaining: 2h 50m 1s. Rate: 7.8 symbols/min [2025-10-30T19:14:32.726064] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-30T19:14:32.727878] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:32.730940] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-30T19:14:32.766509] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T19:14:32.785016] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-30T19:14:32.797345] [DEBUG] [LOCAL ] HQH: Loaded 25538 existing records from primary storage. [2025-10-30T19:14:32.797600] [INFO ] [MAIN ] HQH: Loaded 25538 existing records. [2025-10-30T19:14:32.975370] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:32.975569] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-30T19:14:32.975617] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-30T19:14:32.975838] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-30T19:14:32.975891] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-30T19:14:33.279376] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T19:14:33.304022] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-30T19:14:33.364887] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:33.365584] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-30T19:14:33.471184] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T19:14:33.482418] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-30T19:14:33.948187] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-30T19:14:33.952589] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-30T19:14:34.279337] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T19:14:34.284968] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-30T19:14:34.328666] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T19:14:34.340104] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-30T19:14:34.441130] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-30T19:14:34.444136] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-30T19:14:34.735599] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T19:14:34.747021] [INFO ] [REMOTE ] HPP: Full fetch complete (73379 records). [2025-10-30T19:14:34.747160] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-30T19:14:35.049999] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T19:14:35.068456] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-30T19:14:35.148134] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-30T19:14:35.148327] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-30T19:14:35.154457] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-30T19:14:35.163140] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-30T19:14:35.164389] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T19:14:35.170215] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-30T19:14:35.171401] [DEBUG] [LOCAL ] HPP: Trimmed 73379 records to 51595 (keeping 200 days of data) [2025-10-30T19:14:35.457445] [DEBUG] [LOCAL ] HPP: Primary data saved (51595 records). [2025-10-30T19:14:35.457579] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-30T19:14:35.458209] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPP took 14.0s. Estimated remaining: 2h 49m 48s. Rate: 7.8 symbols/min [2025-10-30T19:14:35.637756] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:35.671997] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T19:14:35.686887] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-30T19:14:35.694745] [DEBUG] [LOCAL ] HQL: Loaded 17336 existing records from primary storage. [2025-10-30T19:14:35.694937] [INFO ] [MAIN ] HQL: Loaded 17336 existing records. [2025-10-30T19:14:35.822591] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-30T19:14:35.859766] [INFO ] [REMOTE ] HPS: Full fetch complete (14890 records). [2025-10-30T19:14:35.866356] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-30T19:14:35.892681] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:35.960913] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-30T19:14:35.975308] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-30T19:14:36.005087] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-30T19:14:36.008183] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-30T19:14:36.564613] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-30T19:14:36.582103] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T19:14:36.575030] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-30T19:14:36.598945] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-30T19:14:36.599733] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-30T19:14:36.599281] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-30T19:14:36.645358] [DEBUG] [LOCAL ] HPS: Trimmed 14890 records to 10140 (keeping 200 days of data) [2025-10-30T19:14:36.684479] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:36.709340] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-30T19:14:36.748555] [DEBUG] [LOCAL ] HPS: Primary data saved (10140 records). [2025-10-30T19:14:36.748701] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-30T19:14:36.748794] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPS took 7.7s. Estimated remaining: 2h 49m 32s. Rate: 7.8 symbols/min [2025-10-30T19:14:36.916462] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:36.963028] [DEBUG] [LOCAL ] HR: Loaded 52084 existing records from primary storage. [2025-10-30T19:14:36.963316] [INFO ] [MAIN ] HR: Loaded 52084 existing records. [2025-10-30T19:14:37.144205] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:37.144421] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-30T19:14:37.144536] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-30T19:14:37.144851] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-30T19:14:37.144907] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-30T19:14:37.434624] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-30T19:14:37.456227] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-30T19:14:37.540845] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:37.541664] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-30T19:14:37.557972] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T19:14:37.580718] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-30T19:14:37.596567] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-30T19:14:37.608761] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-30T19:14:38.165867] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-30T19:14:38.170023] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-30T19:14:38.483145] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T19:14:38.489214] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-30T19:14:38.756499] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-30T19:14:38.760715] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-30T19:14:38.877938] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T19:14:38.887866] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-30T19:14:39.057596] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T19:14:39.068849] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-30T19:14:39.178459] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T19:14:39.183637] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-30T19:14:39.445996] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T19:14:39.449845] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-30T19:14:40.003820] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T19:14:40.010288] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-30T19:14:40.132114] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-30T19:14:40.136426] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-30T19:14:40.183493] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T19:14:40.192932] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-30T19:14:40.500935] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T19:14:40.512151] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-30T19:14:40.858428] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-30T19:14:40.862409] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-30T19:14:40.898102] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T19:14:40.904099] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-30T19:14:41.418595] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T19:14:41.429058] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-30T19:14:41.553764] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-30T19:14:41.558465] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-30T19:14:41.622138] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-30T19:14:41.627823] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-30T19:14:41.995638] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-30T19:14:42.007507] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-30T19:14:42.007627] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-30T19:14:42.196951] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-30T19:14:42.267390] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-30T19:14:42.427171] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-30T19:14:42.427328] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-30T19:14:42.428292] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-30T19:14:42.428373] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-30T19:14:42.429783] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 54059 (keeping 200 days of data) [2025-10-30T19:14:42.663984] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T19:14:42.735179] [INFO ] [REMOTE ] HQH: Full fetch complete (36697 records). [2025-10-30T19:14:42.742237] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-30T19:14:42.818545] [DEBUG] [LOCAL ] HPQ: Primary data saved (54059 records). [2025-10-30T19:14:42.823937] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-30T19:14:42.865264] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HPQ took 16.8s. Estimated remaining: 2h 49m 22s. Rate: 7.8 symbols/min [2025-10-30T19:14:43.144927] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-30T19:14:43.314723] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:43.315320] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-30T19:14:43.327376] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T19:14:43.408112] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-30T19:14:43.424392] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-30T19:14:43.424510] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-30T19:14:43.425230] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-30T19:14:43.425386] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-30T19:14:43.426627] [DEBUG] [LOCAL ] HQH: Trimmed 36697 records to 25661 (keeping 200 days of data) [2025-10-30T19:14:43.599212] [DEBUG] [LOCAL ] HRB: Loaded 47965 existing records from primary storage. [2025-10-30T19:14:43.603729] [DEBUG] [LOCAL ] HQH: Primary data saved (25661 records). [2025-10-30T19:14:43.604031] [INFO ] [MAIN ] HRB: Loaded 47965 existing records. [2025-10-30T19:14:43.603919] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-30T19:14:43.646984] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HQH took 11.1s. Estimated remaining: 2h 49m 6s. Rate: 7.8 symbols/min [2025-10-30T19:14:43.951193] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:43.953792] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:43.953979] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-30T19:14:43.954406] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-30T19:14:43.955211] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-30T19:14:43.955269] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-30T19:14:44.251303] [DEBUG] [LOCAL ] HRI: Loaded 32045 existing records from primary storage. [2025-10-30T19:14:44.271735] [INFO ] [MAIN ] HRI: Loaded 32045 existing records. [2025-10-30T19:14:44.462318] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:44.468414] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-30T19:14:44.549338] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:44.565319] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-30T19:14:44.566589] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:14:44.566907] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-30T19:14:44.572902] [INFO ] [REMOTE ] HQL: Full fetch complete (25524 records). [2025-10-30T19:14:44.573165] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-30T19:14:44.584974] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-30T19:14:44.609758] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-30T19:14:44.951901] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-30T19:14:45.057958] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-30T19:14:45.322666] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-30T19:14:45.322798] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-30T19:14:45.323382] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-30T19:14:45.323514] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-30T19:14:45.364709] [DEBUG] [LOCAL ] HQL: Trimmed 25524 records to 17521 (keeping 200 days of data) [2025-10-30T19:14:45.404005] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:45.445792] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-30T19:14:45.505702] [DEBUG] [LOCAL ] HQL: Primary data saved (17521 records). [2025-10-30T19:14:45.505806] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-30T19:14:45.505878] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HQL took 10.0s. Estimated remaining: 2h 48m 51s. Rate: 7.8 symbols/min [2025-10-30T19:14:45.675737] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:45.726787] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T19:14:45.736815] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-30T19:14:45.752012] [DEBUG] [LOCAL ] HRL: Loaded 53113 existing records from primary storage. [2025-10-30T19:14:45.752270] [INFO ] [MAIN ] HRL: Loaded 53113 existing records. [2025-10-30T19:14:45.925391] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:45.925560] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-30T19:14:45.925605] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-30T19:14:45.926568] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-30T19:14:45.926625] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-30T19:14:46.285893] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:46.286956] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-30T19:14:46.317853] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T19:14:46.329490] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-30T19:14:46.353528] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T19:14:46.359216] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-30T19:14:46.901711] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T19:14:46.911068] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-30T19:14:47.390785] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T19:14:47.397322] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-30T19:14:47.489893] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T19:14:47.531991] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T19:14:47.697449] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-30T19:14:48.161220] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T19:14:48.497467] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-30T19:14:48.612897] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T19:14:49.157384] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-30T19:14:49.297454] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-30T19:14:49.682348] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T19:14:50.097565] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-30T19:14:50.603405] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T19:14:50.897506] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-30T19:14:51.510284] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T19:14:51.697522] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-30T19:14:52.219432] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T19:14:52.497484] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-30T19:14:52.694256] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T19:14:53.297497] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-30T19:14:53.947110] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-30T19:14:54.097469] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-30T19:14:54.234790] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T19:14:54.897522] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-30T19:14:55.441092] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:14:55.697500] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-30T19:14:55.995474] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-30T19:14:56.497509] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-30T19:14:57.062095] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T19:14:57.297507] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-30T19:14:58.007531] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-30T19:14:58.019278] [INFO ] [REMOTE ] HR: Full fetch complete (75137 records). [2025-10-30T19:14:58.019445] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-30T19:14:58.102588] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-30T19:14:58.453513] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-30T19:14:58.453632] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-30T19:14:58.454741] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-30T19:14:58.454823] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-30T19:14:58.456520] [DEBUG] [LOCAL ] HR: Trimmed 75137 records to 52472 (keeping 200 days of data) [2025-10-30T19:14:58.572746] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T19:14:58.806228] [DEBUG] [LOCAL ] HR: Primary data saved (52472 records). [2025-10-30T19:14:58.806353] [INFO ] [MAIN ] HR: Full history saved. [2025-10-30T19:14:58.807533] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HR took 22.1s. Estimated remaining: 2h 48m 50s. Rate: 7.8 symbols/min [2025-10-30T19:14:58.902766] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-30T19:14:59.009497] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:14:59.047344] [DEBUG] [LOCAL ] HRTG: Loaded 34231 existing records from primary storage. [2025-10-30T19:14:59.047623] [INFO ] [MAIN ] HRTG: Loaded 34231 existing records. [2025-10-30T19:14:59.240624] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:14:59.240942] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-30T19:14:59.240996] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-30T19:14:59.241204] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-30T19:14:59.241243] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-30T19:14:59.611057] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:14:59.648627] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-30T19:14:59.697490] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-30T19:14:59.900455] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-30T19:15:00.497529] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-30T19:15:00.682138] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T19:15:01.297496] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-30T19:15:02.097499] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-30T19:15:02.286023] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-30T19:15:02.897492] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-30T19:15:02.932870] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-30T19:15:03.535772] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T19:15:03.697487] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-30T19:15:04.183589] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T19:15:04.497493] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-30T19:15:05.297537] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-30T19:15:05.465428] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-30T19:15:05.770496] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T19:15:05.910438] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T19:15:06.097526] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-30T19:15:06.897506] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-30T19:15:07.086518] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-30T19:15:07.630177] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-30T19:15:07.697490] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-30T19:15:08.497490] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-30T19:15:09.101965] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T19:15:09.112065] [INFO ] [REMOTE ] HRB: Full fetch complete (69805 records). [2025-10-30T19:15:09.112226] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-30T19:15:09.309982] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-30T19:15:09.551026] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-30T19:15:09.551157] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-30T19:15:09.552322] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-30T19:15:09.552478] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-30T19:15:09.561908] [DEBUG] [LOCAL ] HRB: Trimmed 69805 records to 48303 (keeping 200 days of data) [2025-10-30T19:15:09.578213] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T19:15:09.878154] [DEBUG] [LOCAL ] HRB: Primary data saved (48303 records). [2025-10-30T19:15:09.878295] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-30T19:15:09.879122] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HRB took 27.0s. Estimated remaining: 2h 48m 47s. Rate: 7.8 symbols/min [2025-10-30T19:15:10.057885] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:10.104210] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-30T19:15:10.107733] [DEBUG] [LOCAL ] HSBC: Loaded 50950 existing records from primary storage. [2025-10-30T19:15:10.108024] [INFO ] [MAIN ] HSBC: Loaded 50950 existing records. [2025-10-30T19:15:10.293363] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:15:10.293594] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-30T19:15:10.293664] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-30T19:15:10.294524] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-30T19:15:10.294583] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-30T19:15:10.711258] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:10.897469] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-30T19:15:11.124044] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-30T19:15:11.136073] [INFO ] [REMOTE ] HRL: Full fetch complete (77042 records). [2025-10-30T19:15:11.136194] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-30T19:15:11.457140] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T19:15:11.556985] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-30T19:15:11.557060] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-30T19:15:11.558062] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-30T19:15:11.558126] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-30T19:15:11.559546] [DEBUG] [LOCAL ] HRL: Trimmed 77042 records to 53503 (keeping 200 days of data) [2025-10-30T19:15:11.731340] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-30T19:15:11.883918] [DEBUG] [LOCAL ] HRL: Primary data saved (53503 records). [2025-10-30T19:15:11.884034] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-30T19:15:11.884538] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRL took 26.4s. Estimated remaining: 2h 48m 32s. Rate: 7.8 symbols/min [2025-10-30T19:15:12.055778] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:12.078116] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T19:15:12.095280] [DEBUG] [LOCAL ] HSHP: Loaded 13889 existing records from primary storage. [2025-10-30T19:15:12.095474] [INFO ] [MAIN ] HSHP: Loaded 13889 existing records. [2025-10-30T19:15:12.268907] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:15:12.269053] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-30T19:15:12.269099] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-30T19:15:12.269397] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-30T19:15:12.269453] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-30T19:15:12.502709] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-30T19:15:12.615583] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:13.117090] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-30T19:15:13.124391] [INFO ] [REMOTE ] HRI: Full fetch complete (47026 records). [2025-10-30T19:15:13.124531] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-30T19:15:13.307817] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-30T19:15:13.530616] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-30T19:15:13.530784] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-30T19:15:13.531518] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-30T19:15:13.531561] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-30T19:15:13.532558] [DEBUG] [LOCAL ] HRI: Trimmed 47026 records to 32363 (keeping 200 days of data) [2025-10-30T19:15:13.671488] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T19:15:13.761036] [DEBUG] [LOCAL ] HRI: Primary data saved (32363 records). [2025-10-30T19:15:13.761172] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-30T19:15:13.761256] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HRI took 30.1s. Estimated remaining: 2h 48m 17s. Rate: 7.8 symbols/min [2025-10-30T19:15:13.937027] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:13.947639] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-30T19:15:13.994054] [DEBUG] [LOCAL ] HSY: Loaded 50310 existing records from primary storage. [2025-10-30T19:15:13.994360] [INFO ] [MAIN ] HSY: Loaded 50310 existing records. [2025-10-30T19:15:14.102734] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-30T19:15:14.177102] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:15:14.177314] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-30T19:15:14.177370] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-30T19:15:14.178358] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-30T19:15:14.178415] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-30T19:15:14.529075] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:14.897511] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-30T19:15:15.290979] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T19:15:15.697501] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-30T19:15:16.267449] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T19:15:16.497518] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-30T19:15:17.205359] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T19:15:17.297452] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-30T19:15:17.422223] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-30T19:15:18.097513] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-30T19:15:18.764395] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-30T19:15:18.836134] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T19:15:18.897492] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-30T19:15:19.614378] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T19:15:19.697537] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-30T19:15:20.497508] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-30T19:15:21.068292] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T19:15:21.297476] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-30T19:15:21.634103] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T19:15:22.065194] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-30T19:15:22.097463] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-30T19:15:22.581097] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T19:15:22.897495] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-30T19:15:23.697497] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-30T19:15:24.057550] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:15:24.065103] [INFO ] [REMOTE ] HRTG: Full fetch complete (44520 records). [2025-10-30T19:15:24.065263] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-30T19:15:24.461810] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-30T19:15:24.461918] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-30T19:15:24.472793] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-30T19:15:24.473031] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-30T19:15:24.474207] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T19:15:24.479255] [DEBUG] [LOCAL ] HRTG: Trimmed 44520 records to 34427 (keeping 200 days of data) [2025-10-30T19:15:24.525716] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-30T19:15:24.677158] [DEBUG] [LOCAL ] HRTG: Primary data saved (34427 records). [2025-10-30T19:15:24.677292] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-30T19:15:24.677371] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HRTG took 25.9s. Estimated remaining: 2h 48m 13s. Rate: 7.8 symbols/min [2025-10-30T19:15:24.865801] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:24.865969] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-30T19:15:24.866007] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-30T19:15:24.866117] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-30T19:15:24.866161] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-30T19:15:24.866203] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-30T19:15:24.866235] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-30T19:15:25.262956] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:25.275767] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-30T19:15:25.297464] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-30T19:15:25.464194] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T19:15:25.464491] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-30T19:15:25.464582] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:15:25.464630] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-30T19:15:25.464704] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:15:25.464752] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-30T19:15:25.464809] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-30T19:15:25.464844] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-30T19:15:25.464884] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-30T19:15:25.464934] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HTB took 0.8s. Estimated remaining: 2h 47m 57s. Rate: 7.8 symbols/min [2025-10-30T19:15:25.640601] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:25.654846] [DEBUG] [LOCAL ] HTD: Loaded 14029 existing records from primary storage. [2025-10-30T19:15:25.655081] [INFO ] [MAIN ] HTD: Loaded 14029 existing records. [2025-10-30T19:15:25.842219] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:15:25.842593] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-30T19:15:25.842670] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-30T19:15:25.843178] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-30T19:15:25.843236] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-30T19:15:26.102710] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-30T19:15:26.214199] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:26.897495] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-30T19:15:27.570243] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T19:15:27.697463] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-30T19:15:28.481844] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T19:15:28.497444] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-30T19:15:29.106988] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T19:15:29.297456] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-30T19:15:29.961612] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T19:15:30.097459] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-30T19:15:30.751501] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-30T19:15:30.897455] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-30T19:15:31.672325] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-30T19:15:31.697459] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-30T19:15:32.120839] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T19:15:32.497504] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-30T19:15:33.029770] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-30T19:15:33.273246] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-30T19:15:33.297445] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-30T19:15:34.097498] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-30T19:15:34.648183] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-30T19:15:34.901074] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-30T19:15:34.899317] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-30T19:15:35.612332] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T19:15:35.697461] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-30T19:15:36.270122] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-30T19:15:36.273231] [INFO ] [REMOTE ] HSHP: Full fetch complete (22842 records). [2025-10-30T19:15:36.273324] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-30T19:15:36.502615] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-30T19:15:36.651857] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-30T19:15:36.651933] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-30T19:15:36.652460] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-30T19:15:36.652525] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-30T19:15:36.653190] [DEBUG] [LOCAL ] HSHP: Trimmed 22842 records to 13956 (keeping 200 days of data) [2025-10-30T19:15:36.731470] [DEBUG] [LOCAL ] HSHP: Primary data saved (13956 records). [2025-10-30T19:15:36.731602] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-30T19:15:36.731705] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSHP took 24.8s. Estimated remaining: 2h 47m 54s. Rate: 7.8 symbols/min [2025-10-30T19:15:36.906605] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:36.906798] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-30T19:15:36.906853] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-30T19:15:36.906973] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-30T19:15:36.907022] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-30T19:15:36.907063] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-30T19:15:36.907095] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-30T19:15:37.134126] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T19:15:37.303604] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-30T19:15:37.315576] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:38.097546] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-30T19:15:38.355792] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-30T19:15:38.767682] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-30T19:15:38.897530] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-30T19:15:39.414405] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T19:15:39.697495] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-30T19:15:40.192553] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T19:15:40.497504] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-30T19:15:41.083492] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-30T19:15:41.297491] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-30T19:15:41.885314] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-30T19:15:42.097499] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-30T19:15:42.311821] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-30T19:15:42.897497] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-30T19:15:43.121064] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-30T19:15:43.697540] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-30T19:15:44.419033] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T19:15:44.497523] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-30T19:15:45.297514] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-30T19:15:45.840315] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T19:15:45.893040] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T19:15:46.097495] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-30T19:15:46.897520] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-30T19:15:47.555114] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T19:15:47.586609] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T19:15:47.697500] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-30T19:15:48.497482] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-30T19:15:48.749928] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-30T19:15:49.029538] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T19:15:49.297563] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-30T19:15:50.076874] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-30T19:15:50.080813] [INFO ] [REMOTE ] HTD: Full fetch complete (19534 records). [2025-10-30T19:15:50.080885] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-30T19:15:50.102814] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-30T19:15:50.452442] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-30T19:15:50.452518] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-30T19:15:50.453048] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-30T19:15:50.453112] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-30T19:15:50.453707] [DEBUG] [LOCAL ] HTD: Trimmed 19534 records to 14114 (keeping 200 days of data) [2025-10-30T19:15:50.537534] [DEBUG] [LOCAL ] HTD: Primary data saved (14114 records). [2025-10-30T19:15:50.537702] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-30T19:15:50.537814] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTD took 25.1s. Estimated remaining: 2h 47m 53s. Rate: 7.8 symbols/min [2025-10-30T19:15:50.710576] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:50.754438] [DEBUG] [LOCAL ] HTGC: Loaded 47464 existing records from primary storage. [2025-10-30T19:15:50.754779] [INFO ] [MAIN ] HTGC: Loaded 47464 existing records. [2025-10-30T19:15:50.902826] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-30T19:15:50.938792] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:15:50.939299] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-30T19:15:50.939462] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-30T19:15:50.939920] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-30T19:15:50.939985] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-30T19:15:51.239819] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-30T19:15:51.330219] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:51.697514] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-30T19:15:51.800430] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T19:15:51.812331] [INFO ] [REMOTE ] HSY: Full fetch complete (73557 records). [2025-10-30T19:15:51.812539] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-30T19:15:51.928565] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-30T19:15:52.247948] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-30T19:15:52.248061] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-30T19:15:52.249529] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-30T19:15:52.249600] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-30T19:15:52.251995] [DEBUG] [LOCAL ] HSY: Trimmed 73557 records to 50699 (keeping 200 days of data) [2025-10-30T19:15:52.503782] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-30T19:15:52.605004] [DEBUG] [LOCAL ] HSY: Primary data saved (50699 records). [2025-10-30T19:15:52.605203] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-30T19:15:52.605309] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HSY took 38.8s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-10-30T19:15:52.812237] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:52.847165] [DEBUG] [LOCAL ] HTH: Loaded 32164 existing records from primary storage. [2025-10-30T19:15:52.847562] [INFO ] [MAIN ] HTH: Loaded 32164 existing records. [2025-10-30T19:15:53.029543] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:15:53.029850] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-30T19:15:53.029905] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-30T19:15:53.030691] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-30T19:15:53.030753] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-30T19:15:53.302692] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-30T19:15:53.416516] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:53.529729] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-30T19:15:54.009669] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T19:15:54.097546] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-30T19:15:54.897543] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-30T19:15:54.953483] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-30T19:15:55.697585] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-30T19:15:56.497518] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-30T19:15:56.771003] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-30T19:15:56.782980] [INFO ] [REMOTE ] HSBC: Full fetch complete (74320 records). [2025-10-30T19:15:56.783145] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-30T19:15:57.188017] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-30T19:15:57.188109] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-30T19:15:57.203096] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-30T19:15:57.212504] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-30T19:15:57.214502] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-30T19:15:57.224339] [DEBUG] [LOCAL ] HSBC: Trimmed 74320 records to 51338 (keeping 200 days of data) [2025-10-30T19:15:57.311113] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-30T19:15:57.506779] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-10-30T19:15:57.555802] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T19:15:57.576241] [DEBUG] [LOCAL ] HSBC: Primary data saved (51338 records). [2025-10-30T19:15:57.576350] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-30T19:15:57.576452] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HSBC took 47.7s. Estimated remaining: 2h 47m 28s. Rate: 7.8 symbols/min [2025-10-30T19:15:57.746054] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:15:57.778925] [DEBUG] [LOCAL ] HUBB: Loaded 35620 existing records from primary storage. [2025-10-30T19:15:57.779209] [INFO ] [MAIN ] HUBB: Loaded 35620 existing records. [2025-10-30T19:15:57.956707] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:15:57.956928] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-30T19:15:57.957008] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-30T19:15:57.957755] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-30T19:15:57.957812] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-30T19:15:58.102689] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-30T19:15:58.309904] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:15:58.897503] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-30T19:15:59.109905] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-10-30T19:15:59.476217] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-30T19:15:59.697541] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-30T19:16:00.009728] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-30T19:16:00.010690] [INFO ] [REMOTE ] HTFC: Full fetch complete (834 records). [2025-10-30T19:16:00.010772] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-30T19:16:00.195738] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-30T19:16:00.196015] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:16:00.196089] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:16:00.196170] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-30T19:16:00.196246] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-30T19:16:00.196286] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-30T19:16:00.196361] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-30T19:16:00.196502] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HTFC took 23.5s. Estimated remaining: 2h 47m 14s. Rate: 7.8 symbols/min [2025-10-30T19:16:00.376799] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:16:00.421376] [DEBUG] [LOCAL ] HUBS: Loaded 39510 existing records from primary storage. [2025-10-30T19:16:00.421852] [INFO ] [MAIN ] HUBS: Loaded 39510 existing records. [2025-10-30T19:16:00.502611] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-30T19:16:00.612905] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:16:00.613157] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-30T19:16:00.613208] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-30T19:16:00.613582] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-30T19:16:00.613673] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-30T19:16:00.968090] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:16:01.297495] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-30T19:16:02.097540] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-30T19:16:02.271503] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-30T19:16:02.897508] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-30T19:16:03.430250] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-30T19:16:03.707815] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-30T19:16:03.714051] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-30T19:16:03.869108] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T19:16:04.497496] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-30T19:16:04.959896] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T19:16:05.297528] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-30T19:16:05.853873] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T19:16:06.097497] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-30T19:16:06.700355] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T19:16:06.897496] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-30T19:16:07.384506] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T19:16:07.697501] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-30T19:16:08.085519] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T19:16:08.497509] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-30T19:16:08.870336] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T19:16:09.297543] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-30T19:16:09.639149] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:16:10.097519] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-30T19:16:10.623541] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T19:16:10.897521] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-30T19:16:11.373801] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T19:16:11.697526] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-30T19:16:12.302130] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-30T19:16:12.497462] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-30T19:16:12.771109] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T19:16:13.297521] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-30T19:16:13.856207] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T19:16:14.097734] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-30T19:16:14.398278] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T19:16:14.897535] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-30T19:16:15.215353] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T19:16:15.697494] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-30T19:16:15.973476] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T19:16:16.497544] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-30T19:16:16.726915] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T19:16:17.305080] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-30T19:16:17.307741] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T19:16:18.097486] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-30T19:16:18.510869] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T19:16:18.897491] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-30T19:16:19.021841] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T19:16:19.697492] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-30T19:16:20.031130] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T19:16:20.497518] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-30T19:16:20.791501] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T19:16:21.297495] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-30T19:16:21.505069] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T19:16:22.097559] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-30T19:16:22.500886] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T19:16:22.897557] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-30T19:16:23.697534] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-30T19:16:23.952973] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-30T19:16:23.964124] [INFO ] [REMOTE ] HTGC: Full fetch complete (68896 records). [2025-10-30T19:16:23.964397] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-30T19:16:23.984816] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T19:16:24.383357] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-30T19:16:24.383451] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-30T19:16:24.384360] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-30T19:16:24.384421] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-30T19:16:24.385779] [DEBUG] [LOCAL ] HTGC: Trimmed 68896 records to 47809 (keeping 200 days of data) [2025-10-30T19:16:24.498274] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-30T19:16:24.678281] [DEBUG] [LOCAL ] HTGC: Primary data saved (47809 records). [2025-10-30T19:16:24.678378] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-30T19:16:24.679124] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HTGC took 34.1s. Estimated remaining: 2h 47m 27s. Rate: 7.8 symbols/min [2025-10-30T19:16:24.811204] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T19:16:24.884706] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:16:24.927200] [DEBUG] [LOCAL ] HUM: Loaded 48944 existing records from primary storage. [2025-10-30T19:16:24.927480] [INFO ] [MAIN ] HUM: Loaded 48944 existing records. [2025-10-30T19:16:25.100015] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:16:25.100231] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-30T19:16:25.100276] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-30T19:16:25.100816] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-30T19:16:25.100872] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-30T19:16:25.303483] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-30T19:16:25.448145] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:16:25.967837] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T19:16:25.975295] [INFO ] [REMOTE ] HUBB: Full fetch complete (54387 records). [2025-10-30T19:16:25.975391] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-30T19:16:26.112354] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-30T19:16:26.353698] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-30T19:16:26.353831] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-30T19:16:26.354633] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-30T19:16:26.354769] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-30T19:16:26.355887] [DEBUG] [LOCAL ] HUBB: Trimmed 54387 records to 35910 (keeping 200 days of data) [2025-10-30T19:16:26.488103] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-30T19:16:26.602241] [DEBUG] [LOCAL ] HUBB: Primary data saved (35910 records). [2025-10-30T19:16:26.602365] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-30T19:16:26.603130] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HUBB took 29.0s. Estimated remaining: 2h 47m 12s. Rate: 7.8 symbols/min [2025-10-30T19:16:26.790950] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:16:26.843232] [DEBUG] [LOCAL ] HUN: Loaded 53208 existing records from primary storage. [2025-10-30T19:16:26.843555] [INFO ] [MAIN ] HUN: Loaded 53208 existing records. [2025-10-30T19:16:26.897701] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-30T19:16:27.020242] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:16:27.020484] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-30T19:16:27.020533] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-30T19:16:27.020850] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-30T19:16:27.020909] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-30T19:16:27.329445] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-30T19:16:27.376922] [INFO ] [REMOTE ] HTH: Full fetch complete (47054 records). [2025-10-30T19:16:27.387572] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-30T19:16:27.397989] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:16:27.702569] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-30T19:16:27.772971] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-30T19:16:27.773036] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-30T19:16:27.773766] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-30T19:16:27.773827] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-30T19:16:27.774856] [DEBUG] [LOCAL ] HTH: Trimmed 47054 records to 32443 (keeping 200 days of data) [2025-10-30T19:16:27.963925] [DEBUG] [LOCAL ] HTH: Primary data saved (32443 records). [2025-10-30T19:16:27.964053] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-30T19:16:27.964129] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HTH took 35.4s. Estimated remaining: 2h 46m 56s. Rate: 7.8 symbols/min [2025-10-30T19:16:28.129344] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:16:28.172284] [DEBUG] [LOCAL ] HUYA: Loaded 43549 existing records from primary storage. [2025-10-30T19:16:28.172607] [INFO ] [MAIN ] HUYA: Loaded 43549 existing records. [2025-10-30T19:16:28.356620] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:16:28.356932] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-30T19:16:28.357009] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-30T19:16:28.357308] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-30T19:16:28.357377] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-30T19:16:28.497753] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-30T19:16:28.713233] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-30T19:16:28.759317] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:16:29.211118] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T19:16:29.297518] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-30T19:16:29.847335] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T19:16:30.097531] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-30T19:16:30.710848] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T19:16:30.897551] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-30T19:16:31.229950] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T19:16:31.697528] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-30T19:16:32.252538] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T19:16:32.261911] [INFO ] [REMOTE ] HUBS: Full fetch complete (57295 records). [2025-10-30T19:16:32.262056] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-30T19:16:32.504768] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-30T19:16:32.645103] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-30T19:16:32.645231] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-30T19:16:32.646056] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-30T19:16:32.646204] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-30T19:16:32.647626] [DEBUG] [LOCAL ] HUBS: Trimmed 57295 records to 39815 (keeping 200 days of data) [2025-10-30T19:16:32.759461] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T19:16:32.914385] [DEBUG] [LOCAL ] HUBS: Primary data saved (39815 records). [2025-10-30T19:16:32.914531] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-30T19:16:32.915121] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUBS took 32.7s. Estimated remaining: 2h 46m 45s. Rate: 7.8 symbols/min [2025-10-30T19:16:33.081381] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:16:33.097959] [DEBUG] [LOCAL ] HVT: Loaded 14472 existing records from primary storage. [2025-10-30T19:16:33.098186] [INFO ] [MAIN ] HVT: Loaded 14472 existing records. [2025-10-30T19:16:33.271564] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:16:33.271801] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-30T19:16:33.271856] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-30T19:16:33.272069] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-30T19:16:33.272132] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-30T19:16:33.302761] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-30T19:16:33.626784] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:16:33.756778] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T19:16:34.097523] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-30T19:16:34.750141] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-30T19:16:34.897492] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-30T19:16:35.320026] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T19:16:35.697493] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-30T19:16:36.262081] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T19:16:36.497534] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-30T19:16:36.921150] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T19:16:37.297540] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-30T19:16:37.598259] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T19:16:38.097500] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-30T19:16:38.293018] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T19:16:38.897537] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-30T19:16:39.656074] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-30T19:16:39.697482] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-30T19:16:39.872266] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-30T19:16:40.312265] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T19:16:40.497556] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-30T19:16:41.297500] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-30T19:16:41.924873] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T19:16:42.097490] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-30T19:16:42.532407] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T19:16:42.841185] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T19:16:42.897488] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-30T19:16:43.657480] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T19:16:43.697500] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-30T19:16:44.497513] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-30T19:16:45.039277] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:16:45.297493] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-30T19:16:45.725093] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T19:16:46.097539] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-30T19:16:46.496820] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T19:16:46.897501] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-30T19:16:47.703856] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-30T19:16:47.713086] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-30T19:16:48.275600] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T19:16:48.330522] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-30T19:16:48.497482] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-30T19:16:49.297498] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-30T19:16:49.627752] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-30T19:16:50.097507] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-30T19:16:50.613589] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T19:16:50.897499] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-30T19:16:51.500698] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-30T19:16:51.697505] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-30T19:16:52.437081] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-30T19:16:52.459282] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T19:16:52.497458] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-30T19:16:53.091790] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-30T19:16:53.297496] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-30T19:16:54.097501] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-30T19:16:54.765542] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T19:16:54.776745] [INFO ] [REMOTE ] HUYA: Full fetch complete (64123 records). [2025-10-30T19:16:54.776887] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-30T19:16:54.902579] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-30T19:16:55.175097] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-30T19:16:55.175178] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-30T19:16:55.176199] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-30T19:16:55.176268] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-30T19:16:55.177741] [DEBUG] [LOCAL ] HUYA: Trimmed 64123 records to 43909 (keeping 200 days of data) [2025-10-30T19:16:55.420332] [DEBUG] [LOCAL ] HUYA: Primary data saved (43909 records). [2025-10-30T19:16:55.420452] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-30T19:16:55.420527] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUYA took 27.5s. Estimated remaining: 2h 46m 56s. Rate: 7.8 symbols/min [2025-10-30T19:16:55.587989] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:16:55.636793] [DEBUG] [LOCAL ] HWM: Loaded 52628 existing records from primary storage. [2025-10-30T19:16:55.637127] [INFO ] [MAIN ] HWM: Loaded 52628 existing records. [2025-10-30T19:16:55.701058] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-30T19:16:55.821609] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:16:55.821947] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-30T19:16:55.822000] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-30T19:16:55.822522] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-30T19:16:55.822638] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-30T19:16:56.028002] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-30T19:16:56.131251] [INFO ] [REMOTE ] HUM: Full fetch complete (71044 records). [2025-10-30T19:16:56.144844] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-30T19:16:56.338141] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:16:56.466273] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T19:16:56.512075] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-30T19:16:56.679209] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-30T19:16:56.679915] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-30T19:16:56.682082] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-30T19:16:56.681010] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-30T19:16:56.682256] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-30T19:16:56.694990] [DEBUG] [LOCAL ] HUM: Trimmed 71044 records to 49273 (keeping 200 days of data) [2025-10-30T19:16:57.004580] [DEBUG] [LOCAL ] HUM: Primary data saved (49273 records). [2025-10-30T19:16:57.004743] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-30T19:16:57.004828] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HUM took 32.3s. Estimated remaining: 2h 46m 41s. Rate: 7.8 symbols/min [2025-10-30T19:16:57.172706] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:16:57.215089] [DEBUG] [LOCAL ] HXL: Loaded 45805 existing records from primary storage. [2025-10-30T19:16:57.215409] [INFO ] [MAIN ] HXL: Loaded 45805 existing records. [2025-10-30T19:16:57.305850] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-30T19:16:57.395051] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:16:57.395293] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-30T19:16:57.395341] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-30T19:16:57.395590] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-30T19:16:57.395680] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-30T19:16:57.743719] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:16:58.007884] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-30T19:16:58.097492] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-30T19:16:58.725237] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T19:16:58.897501] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-30T19:16:59.260338] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T19:16:59.697509] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-30T19:17:00.149746] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T19:17:00.497480] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-30T19:17:00.652016] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T19:17:01.297511] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-30T19:17:02.097513] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-30T19:17:02.770001] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T19:17:02.897506] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-30T19:17:03.125419] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-30T19:17:03.137179] [INFO ] [REMOTE ] HUN: Full fetch complete (77044 records). [2025-10-30T19:17:03.137339] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-30T19:17:03.535419] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-30T19:17:03.535794] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-30T19:17:03.536930] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-30T19:17:03.537097] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-30T19:17:03.547576] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T19:17:03.552183] [INFO ] [REMOTE ] HVT: Full fetch complete (22914 records). [2025-10-30T19:17:03.552356] [DEBUG] [LOCAL ] HUN: Trimmed 77044 records to 53597 (keeping 200 days of data) [2025-10-30T19:17:03.552467] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-30T19:17:03.715210] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-30T19:17:03.892542] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-10-30T19:17:04.273600] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-30T19:17:04.291889] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-30T19:17:04.292420] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-30T19:17:04.293533] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-30T19:17:04.315250] [DEBUG] [LOCAL ] HUN: Primary data saved (53597 records). [2025-10-30T19:17:04.315716] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-30T19:17:04.316980] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HUN took 37.7s. Estimated remaining: 2h 46m 32s. Rate: 7.8 symbols/min [2025-10-30T19:17:04.322832] [DEBUG] [LOCAL ] HVT: Trimmed 22914 records to 14594 (keeping 200 days of data) [2025-10-30T19:17:04.501696] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-30T19:17:04.571017] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:04.589336] [DEBUG] [LOCAL ] HVT: Primary data saved (14594 records). [2025-10-30T19:17:04.591418] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-30T19:17:04.591516] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HVT took 31.7s. Estimated remaining: 2h 46m 16s. Rate: 7.8 symbols/min [2025-10-30T19:17:04.651204] [DEBUG] [LOCAL ] HY: Loaded 9537 existing records from primary storage. [2025-10-30T19:17:04.677051] [INFO ] [MAIN ] HY: Loaded 9537 existing records. [2025-10-30T19:17:04.876054] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:04.876557] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-30T19:17:04.956344] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-30T19:17:04.956664] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-30T19:17:04.956940] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-30T19:17:04.956225] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:17:04.957373] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-30T19:17:04.957079] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-30T19:17:04.957557] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-30T19:17:04.957672] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-30T19:17:04.989958] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-30T19:17:05.014188] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-30T19:17:05.238235] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-30T19:17:05.362215] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-30T19:17:05.694319] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:05.714527] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:05.894428] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T19:17:06.097460] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-30T19:17:06.625542] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T19:17:06.746894] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T19:17:06.897475] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-30T19:17:07.697519] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-30T19:17:07.986266] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-30T19:17:08.244210] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T19:17:08.497563] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-30T19:17:09.064883] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-30T19:17:09.297561] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-30T19:17:09.526493] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-30T19:17:10.097505] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-30T19:17:10.897539] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-30T19:17:11.099997] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-10-30T19:17:11.424443] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T19:17:11.697551] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-30T19:17:12.320826] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-30T19:17:12.497490] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-30T19:17:12.712555] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-10-30T19:17:13.297495] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-30T19:17:13.515043] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-30T19:17:14.097499] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-30T19:17:14.305388] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-30T19:17:14.897497] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-30T19:17:15.697557] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-30T19:17:16.327807] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T19:17:16.328225] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-30T19:17:16.497497] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-30T19:17:16.947095] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T19:17:17.297517] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-30T19:17:17.593526] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-30T19:17:18.097502] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-30T19:17:18.897555] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-30T19:17:19.069047] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-10-30T19:17:19.273136] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T19:17:19.697560] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-30T19:17:20.245930] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T19:17:20.497568] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-30T19:17:20.656225] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.16 seconds). [2025-10-30T19:17:21.297535] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-30T19:17:22.097578] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-30T19:17:22.533480] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-30T19:17:22.534782] [INFO ] [REMOTE ] HYAC: Full fetch complete (897 records). [2025-10-30T19:17:22.534861] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-30T19:17:22.535269] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-29) is before last completed trading day (2025-10-30). Symbol may be delisted or halted. [2025-10-30T19:17:22.535356] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:17:22.535403] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:17:22.535542] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-30T19:17:22.535634] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-30T19:17:22.535716] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-30T19:17:22.535769] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-30T19:17:22.535832] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HYAC took 17.9s. Estimated remaining: 2h 46m 20s. Rate: 7.8 symbols/min [2025-10-30T19:17:22.721665] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:22.721996] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-30T19:17:22.722154] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-30T19:17:22.722356] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-30T19:17:22.722454] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-30T19:17:22.722533] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-30T19:17:22.722598] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-30T19:17:22.902359] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-30T19:17:23.123988] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-30T19:17:23.166893] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:23.533263] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T19:17:23.697512] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-30T19:17:23.967236] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-30T19:17:24.497536] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-30T19:17:25.297510] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-30T19:17:25.480047] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.18 seconds). [2025-10-30T19:17:25.848496] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T19:17:26.097495] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-30T19:17:26.304386] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-30T19:17:26.897507] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-30T19:17:27.697528] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-30T19:17:27.960416] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T19:17:28.497538] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-30T19:17:29.050274] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T19:17:29.297526] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-30T19:17:29.797852] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T19:17:30.097497] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-30T19:17:30.310975] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-10-30T19:17:30.588948] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T19:17:30.897502] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-30T19:17:31.697492] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-30T19:17:32.130054] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-30T19:17:32.456527] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T19:17:32.468441] [INFO ] [REMOTE ] HXL: Full fetch complete (66803 records). [2025-10-30T19:17:32.468596] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-30T19:17:32.502701] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-30T19:17:32.793246] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-30T19:17:32.890070] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-30T19:17:32.890147] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-30T19:17:32.891088] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-30T19:17:32.891165] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-30T19:17:32.892419] [DEBUG] [LOCAL ] HXL: Trimmed 66803 records to 46152 (keeping 200 days of data) [2025-10-30T19:17:33.163906] [DEBUG] [LOCAL ] HXL: Primary data saved (46152 records). [2025-10-30T19:17:33.164042] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-30T19:17:33.164827] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HXL took 36.2s. Estimated remaining: 2h 46m 16s. Rate: 7.8 symbols/min [2025-10-30T19:17:33.303028] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-30T19:17:33.335224] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:33.348571] [DEBUG] [LOCAL ] HYI: Loaded 9472 existing records from primary storage. [2025-10-30T19:17:33.348828] [INFO ] [MAIN ] HYI: Loaded 9472 existing records. [2025-10-30T19:17:33.527988] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:17:33.528202] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-30T19:17:33.528250] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-30T19:17:33.528398] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-30T19:17:33.528435] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-30T19:17:33.877990] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:34.097496] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-30T19:17:34.668894] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-30T19:17:34.904935] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-30T19:17:34.914923] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-30T19:17:35.148038] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-30T19:17:35.697523] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-30T19:17:36.497517] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-30T19:17:37.075549] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T19:17:37.113247] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-30T19:17:37.115865] [INFO ] [REMOTE ] HY: Full fetch complete (14645 records). [2025-10-30T19:17:37.115969] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-30T19:17:37.308200] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-30T19:17:37.499432] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-30T19:17:37.499515] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-30T19:17:37.499899] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-30T19:17:37.499960] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-30T19:17:37.500464] [DEBUG] [LOCAL ] HY: Trimmed 14645 records to 9580 (keeping 200 days of data) [2025-10-30T19:17:37.556478] [DEBUG] [LOCAL ] HY: Primary data saved (9580 records). [2025-10-30T19:17:37.556598] [INFO ] [MAIN ] HY: Full history saved. [2025-10-30T19:17:37.556700] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HY took 33.2s. Estimated remaining: 2h 46m 5s. Rate: 7.8 symbols/min [2025-10-30T19:17:37.720737] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:37.753786] [DEBUG] [LOCAL ] HYT: Loaded 32893 existing records from primary storage. [2025-10-30T19:17:37.754046] [INFO ] [MAIN ] HYT: Loaded 32893 existing records. [2025-10-30T19:17:37.917596] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T19:17:37.950791] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:17:37.951050] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-30T19:17:37.951123] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-30T19:17:37.951315] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-30T19:17:37.951362] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-30T19:17:38.104241] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-30T19:17:38.344865] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:38.897514] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-30T19:17:39.114784] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-30T19:17:39.697513] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-30T19:17:39.889036] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T19:17:39.900932] [INFO ] [REMOTE ] HWM: Full fetch complete (76588 records). [2025-10-30T19:17:39.901102] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-30T19:17:40.314227] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-30T19:17:40.314311] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-30T19:17:40.315314] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-30T19:17:40.315379] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-30T19:17:40.317069] [DEBUG] [LOCAL ] HWM: Trimmed 76588 records to 53014 (keeping 200 days of data) [2025-10-30T19:17:40.503924] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-30T19:17:40.662257] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-30T19:17:40.690395] [DEBUG] [LOCAL ] HWM: Primary data saved (53014 records). [2025-10-30T19:17:40.690505] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-30T19:17:40.690579] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HWM took 45.3s. Estimated remaining: 2h 45m 51s. Rate: 7.8 symbols/min [2025-10-30T19:17:40.857184] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:40.862450] [DEBUG] [LOCAL ] HYTR: Loaded 3083 existing records from primary storage. [2025-10-30T19:17:40.862614] [INFO ] [MAIN ] HYTR: Loaded 3083 existing records. [2025-10-30T19:17:41.037812] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:17:41.038015] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-30T19:17:41.038070] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-30T19:17:41.038213] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-30T19:17:41.038252] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-30T19:17:41.170700] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T19:17:41.302616] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-30T19:17:41.413194] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:41.551039] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-30T19:17:42.097507] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-30T19:17:42.316024] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-30T19:17:42.897515] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-30T19:17:43.213991] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-30T19:17:43.214708] [INFO ] [REMOTE ] HYBX: Full fetch complete (685 records). [2025-10-30T19:17:43.214775] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-30T19:17:43.403735] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-30T19:17:43.403926] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:17:43.403994] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:17:43.404046] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-30T19:17:43.404103] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-30T19:17:43.404139] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-30T19:17:43.404179] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-30T19:17:43.404233] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYBX took 20.9s. Estimated remaining: 2h 45m 38s. Rate: 7.8 symbols/min [2025-10-30T19:17:43.585464] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:43.610266] [DEBUG] [LOCAL ] HZO: Loaded 27982 existing records from primary storage. [2025-10-30T19:17:43.610524] [INFO ] [MAIN ] HZO: Loaded 27982 existing records. [2025-10-30T19:17:43.702731] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-30T19:17:43.794007] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:17:43.794254] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-30T19:17:43.794304] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-30T19:17:43.794582] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-30T19:17:43.794639] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-30T19:17:44.164098] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:44.497511] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-30T19:17:44.719768] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T19:17:45.016265] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T19:17:45.297509] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-30T19:17:46.097502] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-30T19:17:46.331270] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T19:17:46.716924] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T19:17:46.897502] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-30T19:17:47.345013] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T19:17:47.697502] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-30T19:17:48.497506] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-30T19:17:48.869988] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T19:17:49.297472] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-30T19:17:49.412198] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T19:17:49.770349] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-30T19:17:50.097501] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-30T19:17:50.897537] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-30T19:17:51.102347] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T19:17:51.555238] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T19:17:51.697537] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-30T19:17:52.267846] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-30T19:17:52.497473] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-30T19:17:52.995235] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-30T19:17:53.297488] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-30T19:17:54.097507] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-30T19:17:54.217867] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-30T19:17:54.589634] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T19:17:54.897489] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-30T19:17:55.697498] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-30T19:17:56.022202] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-30T19:17:56.497465] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-30T19:17:56.585196] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-30T19:17:57.026235] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-30T19:17:57.030765] [INFO ] [REMOTE ] HYI: Full fetch complete (14116 records). [2025-10-30T19:17:57.030874] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-30T19:17:57.302777] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-30T19:17:57.410576] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-30T19:17:57.410681] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-30T19:17:57.411006] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-30T19:17:57.411048] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-30T19:17:57.411504] [DEBUG] [LOCAL ] HYI: Trimmed 14116 records to 9543 (keeping 200 days of data) [2025-10-30T19:17:57.468400] [DEBUG] [LOCAL ] HYI: Primary data saved (9543 records). [2025-10-30T19:17:57.468531] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-30T19:17:57.468609] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. HYI took 24.3s. Estimated remaining: 2h 45m 38s. Rate: 7.8 symbols/min [2025-10-30T19:17:57.634021] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:17:57.642612] [DEBUG] [LOCAL ] IAE: Loaded 6480 existing records from primary storage. [2025-10-30T19:17:57.642861] [INFO ] [MAIN ] IAE: Loaded 6480 existing records. [2025-10-30T19:17:57.816712] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:17:57.816946] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-30T19:17:57.816994] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-30T19:17:57.817168] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-30T19:17:57.817225] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-30T19:17:58.103493] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-30T19:17:58.200200] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:17:58.381404] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T19:17:58.897476] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-30T19:17:58.980104] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T19:17:59.697505] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-30T19:17:59.968097] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:18:00.040336] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-30T19:18:00.497489] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-30T19:18:01.297508] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-30T19:18:01.538223] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:18:01.567098] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-30T19:18:02.097550] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-30T19:18:02.480293] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-30T19:18:02.897503] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-30T19:18:03.697514] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-30T19:18:03.976543] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T19:18:04.137711] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-30T19:18:04.497469] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-30T19:18:05.297498] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-30T19:18:05.792664] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T19:18:05.801286] [INFO ] [REMOTE ] HYT: Full fetch complete (47634 records). [2025-10-30T19:18:05.801423] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-30T19:18:06.099478] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-30T19:18:06.183534] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-30T19:18:06.183667] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-30T19:18:06.184482] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-30T19:18:06.184571] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-30T19:18:06.185801] [DEBUG] [LOCAL ] HYT: Trimmed 47634 records to 33105 (keeping 200 days of data) [2025-10-30T19:18:06.203925] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T19:18:06.400345] [DEBUG] [LOCAL ] HYT: Primary data saved (33105 records). [2025-10-30T19:18:06.400486] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-30T19:18:06.400567] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HYT took 28.8s. Estimated remaining: 2h 45m 31s. Rate: 7.8 symbols/min [2025-10-30T19:18:06.569063] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:18:06.618728] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-30T19:18:06.619011] [INFO ] [MAIN ] IAG: Loaded 53492 existing records. [2025-10-30T19:18:06.745903] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T19:18:06.817263] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:18:06.817459] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-30T19:18:06.817507] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-30T19:18:06.817902] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-30T19:18:06.817961] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-30T19:18:06.902704] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-30T19:18:07.167803] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:18:07.277664] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-30T19:18:07.697483] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-30T19:18:08.130689] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-30T19:18:08.497489] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-30T19:18:09.297505] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-30T19:18:09.634536] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-30T19:18:10.041956] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-30T19:18:10.097500] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-30T19:18:10.897504] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-30T19:18:11.414504] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T19:18:11.412910] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T19:18:11.697485] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-30T19:18:12.497495] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-30T19:18:12.881119] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T19:18:13.219234] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-30T19:18:13.297478] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-30T19:18:14.097536] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-30T19:18:14.484333] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-30T19:18:14.897479] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-30T19:18:14.950996] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-30T19:18:15.697472] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-30T19:18:15.765476] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T19:18:16.013893] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T19:18:16.497504] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-30T19:18:16.954304] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-30T19:18:17.297504] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-30T19:18:18.097485] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-30T19:18:18.142623] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T19:18:18.466841] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-30T19:18:18.897506] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-30T19:18:19.420895] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-30T19:18:19.697500] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-30T19:18:20.107897] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-30T19:18:20.497498] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-30T19:18:20.799862] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-30T19:18:21.297538] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-30T19:18:21.776515] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-30T19:18:21.777896] [INFO ] [REMOTE ] HYTR: Full fetch complete (4715 records). [2025-10-30T19:18:21.777971] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-30T19:18:22.102747] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-30T19:18:22.162934] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-30T19:18:22.163011] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-30T19:18:22.163153] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-30T19:18:22.163191] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-30T19:18:22.163579] [DEBUG] [LOCAL ] HYTR: Trimmed 4715 records to 3100 (keeping 200 days of data) [2025-10-30T19:18:22.184078] [DEBUG] [LOCAL ] HYTR: Primary data saved (3100 records). [2025-10-30T19:18:22.184215] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-30T19:18:22.184296] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. HYTR took 41.5s. Estimated remaining: 2h 45m 33s. Rate: 7.8 symbols/min [2025-10-30T19:18:22.897483] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-30T19:18:23.237134] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T19:18:23.243063] [INFO ] [REMOTE ] HZO: Full fetch complete (41429 records). [2025-10-30T19:18:23.243187] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-30T19:18:23.607717] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-30T19:18:23.607799] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-30T19:18:23.608433] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-30T19:18:23.608474] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-30T19:18:23.609284] [DEBUG] [LOCAL ] HZO: Trimmed 41429 records to 28202 (keeping 200 days of data) [2025-10-30T19:18:23.704821] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-30T19:18:23.766705] [DEBUG] [LOCAL ] HZO: Primary data saved (28202 records). [2025-10-30T19:18:23.766927] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-30T19:18:23.767015] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HZO took 40.4s. Estimated remaining: 2h 45m 18s. Rate: 7.8 symbols/min [2025-10-30T19:18:24.184317] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T19:18:24.458544] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-30T19:18:24.497521] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-30T19:18:25.297553] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-30T19:18:25.856918] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-30T19:18:25.888238] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-30T19:18:25.890596] [INFO ] [REMOTE ] IAE: Full fetch complete (9235 records). [2025-10-30T19:18:25.890721] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-30T19:18:26.104570] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-30T19:18:26.253977] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-30T19:18:26.254053] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-30T19:18:26.254298] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-30T19:18:26.254338] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-30T19:18:26.254780] [DEBUG] [LOCAL ] IAE: Trimmed 9235 records to 6551 (keeping 200 days of data) [2025-10-30T19:18:26.291192] [DEBUG] [LOCAL ] IAE: Primary data saved (6551 records). [2025-10-30T19:18:26.291285] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-30T19:18:26.291358] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAE took 28.8s. Estimated remaining: 2h 45m 5s. Rate: 7.8 symbols/min [2025-10-30T19:18:27.759631] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-30T19:18:27.778811] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-30T19:18:29.359772] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-30T19:18:29.371154] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-30T19:18:30.765226] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:18:30.776895] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-30T19:18:32.658294] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-30T19:18:32.670293] [INFO ] [REMOTE ] IAG: Full fetch complete (77537 records). [2025-10-30T19:18:32.670465] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-30T19:18:33.090991] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-30T19:18:33.091088] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-30T19:18:33.092140] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-30T19:18:33.092203] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-30T19:18:33.093660] [DEBUG] [LOCAL ] IAG: Trimmed 77537 records to 53882 (keeping 200 days of data) [2025-10-30T19:18:33.398160] [DEBUG] [LOCAL ] IAG: Primary data saved (53882 records). [2025-10-30T19:18:33.398307] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-30T19:18:33.399369] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. IAG took 27.0s. Estimated remaining: 2h 44m 56s. Rate: 7.8 symbols/min [2025-10-30T19:18:34.026729] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:18:34.047376] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:18:34.081280] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:18:34.107501] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:18:34.146218] [DEBUG] [LOCAL ] IBTA: Loaded 35293 existing records from primary storage. [2025-10-30T19:18:34.172292] [INFO ] [MAIN ] IBTA: Loaded 35293 existing records. [2025-10-30T19:18:34.236054] [DEBUG] [LOCAL ] IBP: Loaded 28038 existing records from primary storage. [2025-10-30T19:18:34.260738] [INFO ] [MAIN ] IBP: Loaded 28038 existing records. [2025-10-30T19:18:34.364888] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-30T19:18:34.380635] [DEBUG] [LOCAL ] IBN: Loaded 52787 existing records from primary storage. [2025-10-30T19:18:34.402729] [INFO ] [MAIN ] IBN: Loaded 52787 existing records. [2025-10-30T19:18:34.402835] [INFO ] [MAIN ] IBM: Loaded 53628 existing records. [2025-10-30T19:18:34.708125] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:18:34.765972] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-30T19:18:34.770086] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-30T19:18:34.828133] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-30T19:18:34.877709] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-30T19:18:34.863194] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:18:34.983471] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:18:34.910303] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-30T19:18:35.000936] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-30T19:18:35.000750] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-30T19:18:35.047564] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-30T19:18:35.047442] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:18:35.068732] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-30T19:18:35.052826] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-30T19:18:35.063471] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-30T19:18:35.078163] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-30T19:18:35.074794] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-30T19:18:35.088765] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-30T19:18:35.184166] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-30T19:18:35.247245] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-30T19:18:36.187694] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:18:36.261261] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-30T19:18:36.260996] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:18:36.309560] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-30T19:18:36.394729] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:18:36.406336] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-30T19:18:36.485754] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:18:36.486026] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-30T19:18:37.156296] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T19:18:37.161784] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-30T19:18:37.398191] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T19:18:37.403286] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-30T19:18:37.655585] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T19:18:37.666076] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-30T19:18:37.786048] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T19:18:37.791113] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-30T19:18:38.141892] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-30T19:18:38.152554] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-30T19:18:38.318611] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-30T19:18:38.324379] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-30T19:18:38.811389] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T19:18:38.821527] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-30T19:18:39.084491] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T19:18:39.094475] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-30T19:18:39.273288] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-30T19:18:39.279950] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-30T19:18:39.742514] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-30T19:18:39.752685] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-30T19:18:39.962673] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T19:18:40.074055] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T19:18:40.226508] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T19:18:40.497493] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-30T19:18:41.297489] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-30T19:18:41.336962] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-30T19:18:41.571091] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-30T19:18:42.097537] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-30T19:18:42.354445] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T19:18:42.897510] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-30T19:18:43.651881] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-30T19:18:43.682184] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T19:18:43.697454] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-30T19:18:44.497473] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-30T19:18:44.695781] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T19:18:45.297469] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-30T19:18:45.432938] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T19:18:46.097507] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-30T19:18:46.372236] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:18:46.897488] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-30T19:18:46.950947] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T19:18:47.697515] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-30T19:18:48.497476] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-30T19:18:48.556158] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-30T19:18:49.076145] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T19:18:49.297494] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-30T19:18:49.632509] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T19:18:50.097480] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-30T19:18:50.216998] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-30T19:18:50.897496] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-30T19:18:51.666915] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-30T19:18:51.697497] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-30T19:18:51.787540] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T19:18:51.793308] [INFO ] [REMOTE ] IBP: Full fetch complete (41079 records). [2025-10-30T19:18:51.793421] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-30T19:18:52.165492] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-30T19:18:52.165587] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-30T19:18:52.166268] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-30T19:18:52.166328] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-30T19:18:52.167209] [DEBUG] [LOCAL ] IBP: Trimmed 41079 records to 28199 (keeping 200 days of data) [2025-10-30T19:18:52.334866] [DEBUG] [LOCAL ] IBP: Primary data saved (28199 records). [2025-10-30T19:18:52.334989] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-30T19:18:52.335065] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. IBP took 18.9s. Estimated remaining: 2h 45m 2s. Rate: 7.8 symbols/min [2025-10-30T19:18:52.501326] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:18:52.500379] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-30T19:18:52.550032] [DEBUG] [LOCAL ] ICE: Loaded 53008 existing records from primary storage. [2025-10-30T19:18:52.550320] [INFO ] [MAIN ] ICE: Loaded 53008 existing records. [2025-10-30T19:18:52.727878] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:18:52.728131] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-30T19:18:52.728180] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-30T19:18:52.728927] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-30T19:18:52.729002] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-30T19:18:53.087534] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:18:53.302625] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-30T19:18:53.314914] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-30T19:18:53.707375] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T19:18:54.097494] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-30T19:18:54.543816] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T19:18:54.897482] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-30T19:18:55.205709] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-30T19:18:55.213165] [INFO ] [REMOTE ] IBTA: Full fetch complete (51221 records). [2025-10-30T19:18:55.213325] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-30T19:18:55.589607] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-30T19:18:55.589732] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-30T19:18:55.591014] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-30T19:18:55.591080] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-30T19:18:55.592200] [DEBUG] [LOCAL ] IBTA: Trimmed 51221 records to 35548 (keeping 200 days of data) [2025-10-30T19:18:55.703862] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-30T19:18:55.808842] [DEBUG] [LOCAL ] IBTA: Primary data saved (35548 records). [2025-10-30T19:18:55.808982] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-30T19:18:55.809062] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. IBTA took 22.4s. Estimated remaining: 2h 44m 49s. Rate: 7.8 symbols/min [2025-10-30T19:18:55.989095] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:18:56.024427] [DEBUG] [LOCAL ] ICL: Loaded 37515 existing records from primary storage. [2025-10-30T19:18:56.024729] [INFO ] [MAIN ] ICL: Loaded 37515 existing records. [2025-10-30T19:18:56.206287] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:18:56.206593] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-30T19:18:56.206706] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-30T19:18:56.207138] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-30T19:18:56.207219] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-30T19:18:56.343494] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T19:18:56.505668] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-30T19:18:56.611263] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:18:56.985429] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T19:18:57.297493] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-30T19:18:57.691764] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T19:18:58.097493] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-30T19:18:58.837375] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-30T19:18:58.897467] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-30T19:18:59.418073] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T19:18:59.697485] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-30T19:18:59.957883] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T19:19:00.497499] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-30T19:19:01.303901] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-30T19:19:01.324870] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-30T19:19:01.774390] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T19:19:02.097554] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-30T19:19:02.867607] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-30T19:19:02.897462] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-30T19:19:03.697461] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-30T19:19:03.842302] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-30T19:19:04.258774] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T19:19:04.497502] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-30T19:19:05.152769] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-30T19:19:05.164389] [INFO ] [REMOTE ] IBN: Full fetch complete (76658 records). [2025-10-30T19:19:05.164532] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-30T19:19:05.309211] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-30T19:19:05.566491] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-30T19:19:05.566591] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-30T19:19:05.567748] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-30T19:19:05.567814] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-30T19:19:05.569235] [DEBUG] [LOCAL ] IBN: Trimmed 76658 records to 53166 (keeping 200 days of data) [2025-10-30T19:19:05.881598] [DEBUG] [LOCAL ] IBN: Primary data saved (53166 records). [2025-10-30T19:19:05.881753] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-30T19:19:05.882623] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IBN took 32.5s. Estimated remaining: 2h 44m 44s. Rate: 7.8 symbols/min [2025-10-30T19:19:06.049395] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:19:06.081594] [DEBUG] [LOCAL ] IDA: Loaded 32552 existing records from primary storage. [2025-10-30T19:19:06.081876] [INFO ] [MAIN ] IDA: Loaded 32552 existing records. [2025-10-30T19:19:06.112920] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-30T19:19:06.262836] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:19:06.263066] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-30T19:19:06.263117] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-30T19:19:06.263532] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-30T19:19:06.263589] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-30T19:19:06.632821] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:19:06.678735] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T19:19:06.716259] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-30T19:19:06.897517] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-30T19:19:07.496561] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T19:19:07.697488] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-30T19:19:08.497554] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-30T19:19:08.839279] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-30T19:19:09.053590] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T19:19:09.297486] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-30T19:19:09.620909] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-30T19:19:10.097495] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-30T19:19:10.807603] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-30T19:19:10.897465] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-30T19:19:11.156823] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T19:19:11.697500] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-30T19:19:12.497575] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-30T19:19:13.090278] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:19:13.133638] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-30T19:19:13.145575] [INFO ] [REMOTE ] IBM: Full fetch complete (77746 records). [2025-10-30T19:19:13.145784] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-30T19:19:13.276331] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-30T19:19:13.302872] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-30T19:19:13.579635] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-30T19:19:13.579754] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-30T19:19:13.580727] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-30T19:19:13.580790] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-30T19:19:13.582253] [DEBUG] [LOCAL ] IBM: Trimmed 77746 records to 54018 (keeping 200 days of data) [2025-10-30T19:19:13.910699] [DEBUG] [LOCAL ] IBM: Primary data saved (54018 records). [2025-10-30T19:19:13.910797] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-30T19:19:13.910873] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBM took 40.5s. Estimated remaining: 2h 44m 37s. Rate: 7.8 symbols/min [2025-10-30T19:19:14.080954] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:19:14.091047] [DEBUG] [LOCAL ] IDE: Loaded 9139 existing records from primary storage. [2025-10-30T19:19:14.091250] [INFO ] [MAIN ] IDE: Loaded 9139 existing records. [2025-10-30T19:19:14.102613] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-30T19:19:14.284043] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:19:14.284399] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-30T19:19:14.284482] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-30T19:19:14.300716] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-30T19:19:14.301544] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-30T19:19:14.301364] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T19:19:14.846036] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:19:14.897571] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-30T19:19:15.099878] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T19:19:15.697519] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-30T19:19:15.910187] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-30T19:19:16.236262] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-30T19:19:16.497534] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-30T19:19:17.297534] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-30T19:19:18.097512] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-30T19:19:18.327472] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-30T19:19:18.388069] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-30T19:19:18.399732] [INFO ] [REMOTE ] ICE: Full fetch complete (77026 records). [2025-10-30T19:19:18.399858] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-30T19:19:18.568075] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T19:19:18.795563] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-30T19:19:18.795640] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-30T19:19:18.796588] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-30T19:19:18.796676] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-30T19:19:18.798029] [DEBUG] [LOCAL ] ICE: Trimmed 77026 records to 53397 (keeping 200 days of data) [2025-10-30T19:19:18.907695] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-30T19:19:19.126037] [DEBUG] [LOCAL ] ICE: Primary data saved (53397 records). [2025-10-30T19:19:19.126193] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-30T19:19:19.126987] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. ICE took 26.8s. Estimated remaining: 2h 44m 26s. Rate: 7.8 symbols/min [2025-10-30T19:19:19.293633] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:19:19.312471] [DEBUG] [LOCAL ] IDT: Loaded 18487 existing records from primary storage. [2025-10-30T19:19:19.312750] [INFO ] [MAIN ] IDT: Loaded 18487 existing records. [2025-10-30T19:19:19.486982] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:19:19.487185] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-30T19:19:19.487231] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-30T19:19:19.487411] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-30T19:19:19.487465] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-30T19:19:19.706421] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-30T19:19:19.876250] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:19:20.041008] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T19:19:20.497504] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-30T19:19:20.855810] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:19:21.297538] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-30T19:19:21.760794] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T19:19:21.770083] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-30T19:19:22.097522] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-30T19:19:22.897474] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-30T19:19:23.074481] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-30T19:19:23.345924] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T19:19:23.697523] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-30T19:19:24.218563] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-30T19:19:24.497544] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-30T19:19:24.977537] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-30T19:19:25.297691] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-30T19:19:26.097473] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-30T19:19:26.237847] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T19:19:26.897588] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-30T19:19:27.237705] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:19:27.419430] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T19:19:27.697518] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-30T19:19:28.236310] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T19:19:28.497546] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-30T19:19:29.297559] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-30T19:19:29.659793] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:19:29.667105] [INFO ] [REMOTE ] IDA: Full fetch complete (45313 records). [2025-10-30T19:19:29.667260] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-30T19:19:30.046305] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-30T19:19:30.046410] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-30T19:19:30.047205] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-30T19:19:30.047354] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-30T19:19:30.060520] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T19:19:30.064608] [DEBUG] [LOCAL ] IDA: Trimmed 45313 records to 32763 (keeping 200 days of data) [2025-10-30T19:19:30.118904] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-30T19:19:30.269245] [DEBUG] [LOCAL ] IDA: Primary data saved (32763 records). [2025-10-30T19:19:30.269418] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-30T19:19:30.270146] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. IDA took 24.4s. Estimated remaining: 2h 44m 23s. Rate: 7.8 symbols/min [2025-10-30T19:19:30.436807] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:19:30.476512] [DEBUG] [LOCAL ] IEX: Loaded 38044 existing records from primary storage. [2025-10-30T19:19:30.476874] [INFO ] [MAIN ] IEX: Loaded 38044 existing records. [2025-10-30T19:19:30.654804] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:19:30.655003] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-30T19:19:30.655050] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-30T19:19:30.655261] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-30T19:19:30.655320] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-30T19:19:30.774176] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-30T19:19:30.902682] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-30T19:19:31.039223] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:19:31.578095] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T19:19:31.697502] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-30T19:19:32.260040] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-30T19:19:32.497531] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-30T19:19:33.297521] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-30T19:19:33.564301] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:19:33.782980] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-30T19:19:34.097544] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-30T19:19:34.806731] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-30T19:19:34.897539] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-30T19:19:35.697535] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-30T19:19:35.972605] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T19:19:36.424177] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-30T19:19:36.426878] [INFO ] [REMOTE ] IDE: Full fetch complete (12753 records). [2025-10-30T19:19:36.426947] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-30T19:19:36.502699] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-30T19:19:36.794990] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-30T19:19:36.795083] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-30T19:19:36.795365] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-30T19:19:36.795402] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-30T19:19:36.795873] [DEBUG] [LOCAL ] IDE: Trimmed 12753 records to 9201 (keeping 200 days of data) [2025-10-30T19:19:36.851608] [DEBUG] [LOCAL ] IDE: Primary data saved (9201 records). [2025-10-30T19:19:36.851771] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-30T19:19:36.851857] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. IDE took 22.9s. Estimated remaining: 2h 44m 14s. Rate: 7.8 symbols/min [2025-10-30T19:19:37.016596] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:19:37.065790] [DEBUG] [LOCAL ] IFF: Loaded 51185 existing records from primary storage. [2025-10-30T19:19:37.066108] [INFO ] [MAIN ] IFF: Loaded 51185 existing records. [2025-10-30T19:19:37.243470] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:19:37.243750] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-30T19:19:37.243816] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-30T19:19:37.244038] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-30T19:19:37.244078] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-30T19:19:37.307594] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-30T19:19:37.591820] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:19:37.807319] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T19:19:37.814999] [INFO ] [REMOTE ] ICL: Full fetch complete (55547 records). [2025-10-30T19:19:37.815092] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-30T19:19:38.102617] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-30T19:19:38.186227] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-30T19:19:38.186299] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-30T19:19:38.187084] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-30T19:19:38.187145] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-30T19:19:38.188181] [DEBUG] [LOCAL ] ICL: Trimmed 55547 records to 37764 (keeping 200 days of data) [2025-10-30T19:19:38.393446] [DEBUG] [LOCAL ] ICL: Primary data saved (37764 records). [2025-10-30T19:19:38.393589] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-30T19:19:38.394559] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. ICL took 42.6s. Estimated remaining: 2h 43m 59s. Rate: 7.8 symbols/min [2025-10-30T19:19:38.580592] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:19:38.583801] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T19:19:38.607146] [DEBUG] [LOCAL ] IFN: Loaded 18079 existing records from primary storage. [2025-10-30T19:19:38.607364] [INFO ] [MAIN ] IFN: Loaded 18079 existing records. [2025-10-30T19:19:38.780368] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:19:38.780594] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-30T19:19:38.780687] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-30T19:19:38.780917] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-30T19:19:38.780970] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-30T19:19:38.901273] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-30T19:19:39.079414] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T19:19:39.161979] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:19:39.697505] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-30T19:19:40.011721] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T19:19:40.497491] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-30T19:19:40.671845] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T19:19:41.222449] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T19:19:41.297452] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-30T19:19:41.918560] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T19:19:42.097488] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-30T19:19:42.856457] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-30T19:19:42.897450] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-30T19:19:43.697479] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-30T19:19:43.801357] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-30T19:19:43.806384] [INFO ] [REMOTE ] IDT: Full fetch complete (24339 records). [2025-10-30T19:19:43.806485] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-30T19:19:44.163921] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-30T19:19:44.163986] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-30T19:19:44.164524] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-30T19:19:44.164606] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-30T19:19:44.165437] [DEBUG] [LOCAL ] IDT: Trimmed 24339 records to 18616 (keeping 200 days of data) [2025-10-30T19:19:44.291687] [DEBUG] [LOCAL ] IDT: Primary data saved (18616 records). [2025-10-30T19:19:44.291828] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-30T19:19:44.291908] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IDT took 25.2s. Estimated remaining: 2h 43m 49s. Rate: 7.8 symbols/min [2025-10-30T19:19:44.457176] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:19:44.477327] [DEBUG] [LOCAL ] IFS: Loaded 21652 existing records from primary storage. [2025-10-30T19:19:44.477561] [INFO ] [MAIN ] IFS: Loaded 21652 existing records. [2025-10-30T19:19:44.506171] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-30T19:19:44.660804] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:19:44.661170] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-30T19:19:44.661288] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-30T19:19:44.661536] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-30T19:19:44.661764] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-30T19:19:44.987574] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T19:19:45.098498] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:19:45.297476] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-30T19:19:45.379949] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T19:19:46.097498] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-30T19:19:46.486416] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T19:19:46.897495] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-30T19:19:47.213159] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T19:19:47.388220] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T19:19:47.697501] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-30T19:19:48.497511] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-30T19:19:48.891146] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T19:19:49.080324] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-30T19:19:49.297494] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-30T19:19:50.072520] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-30T19:19:50.097451] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-30T19:19:50.897468] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-30T19:19:50.961132] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T19:19:51.697485] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-30T19:19:52.224802] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-30T19:19:52.497468] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-30T19:19:52.563450] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T19:19:53.297474] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-30T19:19:53.819617] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T19:19:53.910962] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T19:19:54.097491] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-30T19:19:54.897526] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-30T19:19:55.184413] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T19:19:55.697502] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-30T19:19:56.334029] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-30T19:19:56.381245] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T19:19:56.497498] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-30T19:19:57.187052] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T19:19:57.297501] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-30T19:19:58.097472] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-30T19:19:58.318362] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T19:19:58.660281] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-30T19:19:58.897494] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-30T19:19:59.697513] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-30T19:20:00.025019] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T19:20:00.497554] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-30T19:20:00.807683] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T19:20:01.297527] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-30T19:20:02.097500] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-30T19:20:02.333288] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-30T19:20:02.811919] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T19:20:02.897501] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-30T19:20:02.953892] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-30T19:20:03.697534] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-30T19:20:04.222214] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T19:20:04.497505] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-30T19:20:05.220033] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-30T19:20:05.300131] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-30T19:20:05.303818] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-30T19:20:06.097512] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-30T19:20:06.762295] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T19:20:06.874929] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T19:20:06.897511] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-30T19:20:07.697468] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-30T19:20:07.763020] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-30T19:20:07.767483] [INFO ] [REMOTE ] IFS: Full fetch complete (32447 records). [2025-10-30T19:20:07.767559] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-30T19:20:08.138209] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-30T19:20:08.138302] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-30T19:20:08.139027] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-30T19:20:08.139092] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-30T19:20:08.140080] [DEBUG] [LOCAL ] IFS: Trimmed 32447 records to 21851 (keeping 200 days of data) [2025-10-30T19:20:08.262991] [DEBUG] [LOCAL ] IFS: Primary data saved (21851 records). [2025-10-30T19:20:08.263119] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-30T19:20:08.263250] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IFS took 24.0s. Estimated remaining: 2h 44m 0s. Rate: 7.8 symbols/min [2025-10-30T19:20:08.432204] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:08.442057] [DEBUG] [LOCAL ] IGA: Loaded 9699 existing records from primary storage. [2025-10-30T19:20:08.442291] [INFO ] [MAIN ] IGA: Loaded 9699 existing records. [2025-10-30T19:20:08.504379] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-30T19:20:08.621876] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:08.622063] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-30T19:20:08.622110] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-30T19:20:08.622277] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-30T19:20:08.622315] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-30T19:20:09.008167] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:09.037502] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T19:20:09.297506] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-30T19:20:09.811503] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-30T19:20:10.097486] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-30T19:20:10.657277] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T19:20:10.667795] [INFO ] [REMOTE ] IEX: Full fetch complete (54031 records). [2025-10-30T19:20:10.667976] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-30T19:20:10.902740] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-30T19:20:11.067937] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-30T19:20:11.068019] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-30T19:20:11.068873] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-30T19:20:11.068936] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-30T19:20:11.070151] [DEBUG] [LOCAL ] IEX: Trimmed 54031 records to 38321 (keeping 200 days of data) [2025-10-30T19:20:11.304952] [DEBUG] [LOCAL ] IEX: Primary data saved (38321 records). [2025-10-30T19:20:11.305082] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-30T19:20:11.305603] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IEX took 41.0s. Estimated remaining: 2h 43m 47s. Rate: 7.8 symbols/min [2025-10-30T19:20:11.476379] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:11.494547] [DEBUG] [LOCAL ] IGD: Loaded 19192 existing records from primary storage. [2025-10-30T19:20:11.494807] [INFO ] [MAIN ] IGD: Loaded 19192 existing records. [2025-10-30T19:20:11.683031] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:11.684093] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-30T19:20:11.684176] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-30T19:20:11.684485] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-30T19:20:11.684544] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-30T19:20:11.706763] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-30T19:20:11.821133] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-30T19:20:12.106338] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-30T19:20:12.126451] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:12.138341] [INFO ] [REMOTE ] IFF: Full fetch complete (73837 records). [2025-10-30T19:20:12.138480] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-30T19:20:12.453593] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-30T19:20:12.500824] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-30T19:20:12.577602] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-30T19:20:12.577714] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-30T19:20:12.578617] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-30T19:20:12.578697] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-30T19:20:12.580319] [DEBUG] [LOCAL ] IFF: Trimmed 73837 records to 51573 (keeping 200 days of data) [2025-10-30T19:20:12.883867] [DEBUG] [LOCAL ] IFF: Primary data saved (51573 records). [2025-10-30T19:20:12.883996] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-30T19:20:12.884072] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IFF took 36.0s. Estimated remaining: 2h 43m 32s. Rate: 7.8 symbols/min [2025-10-30T19:20:13.047723] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:13.054228] [DEBUG] [LOCAL ] IGI: Loaded 4072 existing records from primary storage. [2025-10-30T19:20:13.054413] [INFO ] [MAIN ] IGI: Loaded 4072 existing records. [2025-10-30T19:20:13.227069] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:13.227272] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-30T19:20:13.227319] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-30T19:20:13.227515] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-30T19:20:13.227571] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-30T19:20:13.303112] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-30T19:20:13.552525] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T19:20:13.607602] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:13.831213] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-30T19:20:14.097529] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-30T19:20:14.899350] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-30T19:20:14.902039] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-30T19:20:14.907177] [INFO ] [REMOTE ] IFN: Full fetch complete (27638 records). [2025-10-30T19:20:14.907290] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-30T19:20:15.286069] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-30T19:20:15.286148] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-30T19:20:15.286744] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-30T19:20:15.286805] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-30T19:20:15.287569] [DEBUG] [LOCAL ] IFN: Trimmed 27638 records to 18224 (keeping 200 days of data) [2025-10-30T19:20:15.394985] [DEBUG] [LOCAL ] IFN: Primary data saved (18224 records). [2025-10-30T19:20:15.395099] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-30T19:20:15.395172] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IFN took 37.0s. Estimated remaining: 2h 43m 18s. Rate: 7.8 symbols/min [2025-10-30T19:20:15.502053] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T19:20:15.570365] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:15.599342] [DEBUG] [LOCAL ] IGR: Loaded 29916 existing records from primary storage. [2025-10-30T19:20:15.599585] [INFO ] [MAIN ] IGR: Loaded 29916 existing records. [2025-10-30T19:20:15.702748] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-30T19:20:15.781863] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:15.782037] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-30T19:20:15.782083] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-30T19:20:15.782271] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-30T19:20:15.782327] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-30T19:20:16.111259] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T19:20:16.137613] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:16.497488] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-30T19:20:17.297471] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-30T19:20:17.437779] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T19:20:18.097539] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-30T19:20:18.209601] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T19:20:18.897513] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-30T19:20:19.039507] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T19:20:19.203406] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-30T19:20:19.697569] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-30T19:20:20.497495] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-30T19:20:20.516177] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-30T19:20:21.082365] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-30T19:20:21.297518] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-30T19:20:21.977246] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-30T19:20:22.097537] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-30T19:20:22.897529] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-30T19:20:23.066227] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-30T19:20:23.481844] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-30T19:20:23.697528] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-30T19:20:24.497551] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-30T19:20:24.597103] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T19:20:24.914800] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-30T19:20:25.297510] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-30T19:20:26.068396] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-30T19:20:26.097489] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-30T19:20:26.748824] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-30T19:20:26.897525] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-30T19:20:27.228301] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-30T19:20:27.697539] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-30T19:20:27.983916] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-30T19:20:28.497544] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-30T19:20:29.140692] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T19:20:29.297496] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-30T19:20:30.071081] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-30T19:20:30.097463] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-30T19:20:30.813192] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T19:20:30.897466] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-30T19:20:31.542979] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T19:20:31.697488] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-30T19:20:32.312932] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T19:20:32.497507] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-30T19:20:32.988334] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T19:20:33.297489] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-30T19:20:34.097482] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-30T19:20:34.388798] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T19:20:34.897472] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-30T19:20:34.918527] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T19:20:34.923877] [INFO ] [REMOTE ] IGD: Full fetch complete (29801 records). [2025-10-30T19:20:34.923961] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-30T19:20:35.319633] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-30T19:20:35.324170] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-30T19:20:35.325057] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-30T19:20:35.325144] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-30T19:20:35.326999] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-30T19:20:35.330472] [DEBUG] [LOCAL ] IGD: Trimmed 29801 records to 19361 (keeping 200 days of data) [2025-10-30T19:20:35.441697] [DEBUG] [LOCAL ] IGD: Primary data saved (19361 records). [2025-10-30T19:20:35.441862] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-30T19:20:35.441951] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IGD took 24.1s. Estimated remaining: 2h 43m 25s. Rate: 7.8 symbols/min [2025-10-30T19:20:35.609525] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:35.613408] [DEBUG] [LOCAL ] IH: Loaded 2662 existing records from primary storage. [2025-10-30T19:20:35.613543] [INFO ] [MAIN ] IH: Loaded 2662 existing records. [2025-10-30T19:20:35.702569] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-30T19:20:35.789449] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:35.789695] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-30T19:20:35.789759] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-30T19:20:35.790017] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-30T19:20:35.790076] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-30T19:20:36.148874] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:36.497497] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-30T19:20:36.645874] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T19:20:36.836631] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-30T19:20:37.297514] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-30T19:20:37.675550] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-30T19:20:38.097529] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-30T19:20:38.517758] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-30T19:20:38.897511] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-30T19:20:39.221298] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-30T19:20:39.697573] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-30T19:20:40.243699] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T19:20:40.497529] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-30T19:20:41.297461] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-30T19:20:41.332579] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-30T19:20:41.697603] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-30T19:20:42.097506] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-30T19:20:42.897487] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-30T19:20:43.061611] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-30T19:20:43.068270] [INFO ] [REMOTE ] IGR: Full fetch complete (44399 records). [2025-10-30T19:20:43.068384] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-30T19:20:43.433403] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-30T19:20:43.461021] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-30T19:20:43.461079] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-30T19:20:43.461841] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-30T19:20:43.461903] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-30T19:20:43.462868] [DEBUG] [LOCAL ] IGR: Trimmed 44399 records to 30144 (keeping 200 days of data) [2025-10-30T19:20:43.634273] [DEBUG] [LOCAL ] IGR: Primary data saved (30144 records). [2025-10-30T19:20:43.634393] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-30T19:20:43.634467] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IGR took 28.2s. Estimated remaining: 2h 43m 18s. Rate: 7.8 symbols/min [2025-10-30T19:20:43.702750] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-30T19:20:43.814046] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:43.823544] [DEBUG] [LOCAL ] IHD: Loaded 7340 existing records from primary storage. [2025-10-30T19:20:43.823793] [INFO ] [MAIN ] IHD: Loaded 7340 existing records. [2025-10-30T19:20:44.009586] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:44.009815] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-30T19:20:44.009862] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-30T19:20:44.010013] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-30T19:20:44.010076] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-30T19:20:44.119352] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-30T19:20:44.374390] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:44.497480] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-30T19:20:44.778555] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-30T19:20:45.297508] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-30T19:20:45.574571] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-30T19:20:46.097484] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-30T19:20:46.563683] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-30T19:20:46.897497] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-30T19:20:47.402079] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T19:20:47.697472] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-30T19:20:48.329494] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-30T19:20:48.332536] [INFO ] [REMOTE ] IGA: Full fetch complete (14277 records). [2025-10-30T19:20:48.332617] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-30T19:20:48.497910] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-30T19:20:48.706577] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-30T19:20:48.706681] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-30T19:20:48.707011] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-30T19:20:48.707052] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-30T19:20:48.707542] [DEBUG] [LOCAL ] IGA: Trimmed 14277 records to 9759 (keeping 200 days of data) [2025-10-30T19:20:48.764059] [DEBUG] [LOCAL ] IGA: Primary data saved (9759 records). [2025-10-30T19:20:48.764195] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-30T19:20:48.764275] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGA took 40.5s. Estimated remaining: 2h 43m 7s. Rate: 7.8 symbols/min [2025-10-30T19:20:48.937395] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:48.963465] [DEBUG] [LOCAL ] IHG: Loaded 23383 existing records from primary storage. [2025-10-30T19:20:48.963726] [INFO ] [MAIN ] IHG: Loaded 23383 existing records. [2025-10-30T19:20:49.084303] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T19:20:49.153839] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:49.154073] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-30T19:20:49.154121] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-30T19:20:49.154379] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-30T19:20:49.154420] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-30T19:20:49.302573] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-30T19:20:49.519843] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:49.778120] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T19:20:50.097516] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-30T19:20:50.492416] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T19:20:50.897503] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-30T19:20:51.372624] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-30T19:20:51.697526] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-30T19:20:52.194891] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T19:20:52.497497] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-30T19:20:52.961480] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-30T19:20:53.297494] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-30T19:20:53.976158] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T19:20:54.097493] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-30T19:20:54.563299] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-30T19:20:54.565059] [INFO ] [REMOTE ] IGI: Full fetch complete (5572 records). [2025-10-30T19:20:54.565127] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-30T19:20:54.906864] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-30T19:20:54.940055] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-30T19:20:54.940134] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-30T19:20:54.940296] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-30T19:20:54.940334] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-30T19:20:54.940786] [DEBUG] [LOCAL ] IGI: Trimmed 5572 records to 4083 (keeping 200 days of data) [2025-10-30T19:20:54.966252] [DEBUG] [LOCAL ] IGI: Primary data saved (4083 records). [2025-10-30T19:20:54.966358] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-30T19:20:54.969381] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IGI took 42.1s. Estimated remaining: 2h 42m 58s. Rate: 7.8 symbols/min [2025-10-30T19:20:55.141318] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:20:55.175253] [DEBUG] [LOCAL ] IHS: Loaded 36857 existing records from primary storage. [2025-10-30T19:20:55.175527] [INFO ] [MAIN ] IHS: Loaded 36857 existing records. [2025-10-30T19:20:55.330043] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-30T19:20:55.361734] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:20:55.361936] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-30T19:20:55.361985] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-30T19:20:55.362192] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-30T19:20:55.362248] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-30T19:20:55.699504] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-30T19:20:55.723604] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:20:56.117859] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-30T19:20:56.497500] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-30T19:20:57.302568] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-30T19:20:57.317188] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T19:20:57.810761] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T19:20:58.097553] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-30T19:20:58.509298] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-30T19:20:58.897511] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-30T19:20:59.604410] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-30T19:20:59.697458] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-30T19:21:00.153994] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-30T19:21:00.155116] [INFO ] [REMOTE ] IH: Full fetch complete (5061 records). [2025-10-30T19:21:00.155183] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-30T19:21:00.504461] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-30T19:21:00.511624] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-30T19:21:00.511714] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-30T19:21:00.511862] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-30T19:21:00.511901] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-30T19:21:00.512264] [DEBUG] [LOCAL ] IH: Trimmed 5061 records to 2665 (keeping 200 days of data) [2025-10-30T19:21:00.531415] [DEBUG] [LOCAL ] IH: Primary data saved (2665 records). [2025-10-30T19:21:00.531528] [INFO ] [MAIN ] IH: Full history saved. [2025-10-30T19:21:00.531604] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IH took 25.1s. Estimated remaining: 2h 42m 48s. Rate: 7.8 symbols/min [2025-10-30T19:21:00.697879] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:00.703732] [DEBUG] [LOCAL ] IIF: Loaded 4922 existing records from primary storage. [2025-10-30T19:21:00.703888] [INFO ] [MAIN ] IIF: Loaded 4922 existing records. [2025-10-30T19:21:00.890269] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:00.890553] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-30T19:21:00.890602] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-30T19:21:00.890758] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-30T19:21:00.890811] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-30T19:21:01.249176] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:21:01.297506] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-30T19:21:01.961931] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T19:21:02.097531] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-30T19:21:02.401047] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:21:02.657729] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T19:21:02.897514] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-30T19:21:03.697466] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-30T19:21:03.893035] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T19:21:04.108707] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T19:21:04.497508] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-30T19:21:04.935042] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-30T19:21:05.297520] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-30T19:21:05.728359] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-30T19:21:06.097545] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-30T19:21:06.493084] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T19:21:06.897499] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-30T19:21:07.376702] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T19:21:07.697523] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-30T19:21:08.497472] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-30T19:21:08.636182] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T19:21:08.997220] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-30T19:21:09.297518] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-30T19:21:10.097539] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-30T19:21:10.428855] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T19:21:10.897514] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-30T19:21:11.032683] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T19:21:11.697565] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-30T19:21:11.994631] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:21:12.259570] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-30T19:21:12.262085] [INFO ] [REMOTE ] IHD: Full fetch complete (11619 records). [2025-10-30T19:21:12.262162] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-30T19:21:12.507713] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-30T19:21:12.633095] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-30T19:21:12.633172] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-30T19:21:12.633437] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-30T19:21:12.633497] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-30T19:21:12.634032] [DEBUG] [LOCAL ] IHD: Trimmed 11619 records to 7374 (keeping 200 days of data) [2025-10-30T19:21:12.677801] [DEBUG] [LOCAL ] IHD: Primary data saved (7374 records). [2025-10-30T19:21:12.677934] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-30T19:21:12.678012] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IHD took 29.0s. Estimated remaining: 2h 42m 45s. Rate: 7.8 symbols/min [2025-10-30T19:21:12.851171] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:12.867438] [DEBUG] [LOCAL ] IIIN: Loaded 15873 existing records from primary storage. [2025-10-30T19:21:12.867681] [INFO ] [MAIN ] IIIN: Loaded 15873 existing records. [2025-10-30T19:21:13.042966] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:13.043199] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-30T19:21:13.043255] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-30T19:21:13.043412] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-30T19:21:13.043453] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-30T19:21:13.302782] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-30T19:21:13.412921] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:21:13.619822] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T19:21:13.761626] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-30T19:21:14.097538] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-30T19:21:14.897503] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-30T19:21:15.133530] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T19:21:15.297424] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-30T19:21:15.697710] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-30T19:21:16.150722] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-30T19:21:16.497497] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-30T19:21:16.883316] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T19:21:17.297519] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-30T19:21:18.097554] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-30T19:21:18.388498] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-30T19:21:18.897518] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-30T19:21:18.922509] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-30T19:21:19.314359] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-30T19:21:19.697551] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-30T19:21:20.503857] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-30T19:21:20.507778] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T19:21:21.289686] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T19:21:21.297447] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-30T19:21:22.097487] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-30T19:21:22.440346] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T19:21:22.447121] [INFO ] [REMOTE ] IHS: Full fetch complete (51507 records). [2025-10-30T19:21:22.447274] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-30T19:21:22.553874] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-30T19:21:22.566123] [INFO ] [REMOTE ] IIF: Full fetch complete (8359 records). [2025-10-30T19:21:22.571327] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-30T19:21:22.902572] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-30T19:21:23.107985] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-30T19:21:23.119689] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-30T19:21:23.144696] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-30T19:21:23.148067] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-30T19:21:23.202879] [DEBUG] [LOCAL ] IHS: Trimmed 51507 records to 37018 (keeping 200 days of data) [2025-10-30T19:21:23.236005] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-30T19:21:23.236096] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-30T19:21:23.236228] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-30T19:21:23.236840] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-30T19:21:23.237382] [DEBUG] [LOCAL ] IIF: Trimmed 8359 records to 4940 (keeping 200 days of data) [2025-10-30T19:21:23.351269] [DEBUG] [LOCAL ] IIF: Primary data saved (4940 records). [2025-10-30T19:21:23.363713] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-30T19:21:23.367147] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IIF took 22.8s. Estimated remaining: 2h 42m 41s. Rate: 7.8 symbols/min [2025-10-30T19:21:23.643328] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:23.659862] [DEBUG] [LOCAL ] IHS: Primary data saved (37018 records). [2025-10-30T19:21:23.660061] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-30T19:21:23.660189] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IHS took 28.7s. Estimated remaining: 2h 42m 24s. Rate: 7.8 symbols/min [2025-10-30T19:21:23.701554] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-30T19:21:23.774292] [DEBUG] [LOCAL ] IIM: Loaded 15257 existing records from primary storage. [2025-10-30T19:21:23.785739] [INFO ] [MAIN ] IIM: Loaded 15257 existing records. [2025-10-30T19:21:23.898203] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:24.087960] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:24.096132] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-30T19:21:24.115836] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-30T19:21:24.116264] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-30T19:21:24.116952] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-30T19:21:24.117795] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T19:21:24.217342] [DEBUG] [LOCAL ] IIPR: Loaded 28405 existing records from primary storage. [2025-10-30T19:21:24.252765] [INFO ] [MAIN ] IIPR: Loaded 28405 existing records. [2025-10-30T19:21:24.502583] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-30T19:21:24.652197] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:24.748536] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:21:24.718196] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T19:21:24.724266] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-30T19:21:24.748876] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-30T19:21:24.754528] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-30T19:21:24.754627] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-30T19:21:25.107274] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:21:25.297463] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-30T19:21:25.475238] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-30T19:21:26.097496] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-30T19:21:26.346404] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T19:21:26.882161] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T19:21:26.897460] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-30T19:21:27.588195] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T19:21:27.697502] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-30T19:21:28.497523] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-30T19:21:28.547958] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-30T19:21:29.207984] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-30T19:21:29.297483] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-30T19:21:30.057505] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-30T19:21:30.097503] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-30T19:21:30.897505] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-30T19:21:30.943198] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-30T19:21:31.589945] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T19:21:31.697526] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-30T19:21:32.453119] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T19:21:32.497476] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-30T19:21:33.296239] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-30T19:21:33.302001] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-30T19:21:34.097504] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-30T19:21:34.413373] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T19:21:34.897635] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-30T19:21:35.132421] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-30T19:21:35.137824] [INFO ] [REMOTE ] IHG: Full fetch complete (34733 records). [2025-10-30T19:21:35.137947] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-30T19:21:35.523377] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-30T19:21:35.523496] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-30T19:21:35.524315] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-30T19:21:35.524402] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-30T19:21:35.537556] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T19:21:35.537749] [DEBUG] [LOCAL ] IHG: Trimmed 34733 records to 23551 (keeping 200 days of data) [2025-10-30T19:21:35.695527] [DEBUG] [LOCAL ] IHG: Primary data saved (23551 records). [2025-10-30T19:21:35.695705] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-30T19:21:35.695807] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IHG took 46.9s. Estimated remaining: 2h 42m 22s. Rate: 7.8 symbols/min [2025-10-30T19:21:35.701387] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-30T19:21:35.913073] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:35.963737] [DEBUG] [LOCAL ] IMAX: Loaded 43349 existing records from primary storage. [2025-10-30T19:21:35.964019] [INFO ] [MAIN ] IMAX: Loaded 43349 existing records. [2025-10-30T19:21:36.193232] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:36.193437] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-30T19:21:36.193487] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-30T19:21:36.193856] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-30T19:21:36.193927] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-30T19:21:36.499783] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-30T19:21:36.614132] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T19:21:36.638738] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:21:37.251127] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T19:21:37.297508] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-30T19:21:38.097575] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-30T19:21:38.357909] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T19:21:38.671189] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T19:21:38.897515] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-30T19:21:39.697521] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-30T19:21:39.950124] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-30T19:21:40.371476] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T19:21:40.497525] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-30T19:21:41.111725] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-30T19:21:41.297498] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-30T19:21:42.097501] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-30T19:21:42.382365] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T19:21:42.543343] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T19:21:42.897504] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-30T19:21:43.697538] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-30T19:21:43.978184] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-30T19:21:44.497476] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-30T19:21:44.614693] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T19:21:45.297562] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-30T19:21:45.803434] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T19:21:46.097492] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-30T19:21:46.180177] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-30T19:21:46.184410] [INFO ] [REMOTE ] IIIN: Full fetch complete (24967 records). [2025-10-30T19:21:46.184524] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-30T19:21:46.552733] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-30T19:21:46.552811] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-30T19:21:46.553326] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-30T19:21:46.553396] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-30T19:21:46.554018] [DEBUG] [LOCAL ] IIIN: Trimmed 24967 records to 16032 (keeping 200 days of data) [2025-10-30T19:21:46.648233] [DEBUG] [LOCAL ] IIIN: Primary data saved (16032 records). [2025-10-30T19:21:46.648365] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-30T19:21:46.648442] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IIIN took 34.0s. Estimated remaining: 2h 42m 18s. Rate: 7.8 symbols/min [2025-10-30T19:21:46.827383] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:46.829343] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-30T19:21:46.877255] [DEBUG] [LOCAL ] INFA: Loaded 48192 existing records from primary storage. [2025-10-30T19:21:46.877553] [INFO ] [MAIN ] INFA: Loaded 48192 existing records. [2025-10-30T19:21:46.907051] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-30T19:21:47.060892] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:47.061139] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-30T19:21:47.061187] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-30T19:21:47.061465] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-30T19:21:47.061523] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-30T19:21:47.426512] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:21:47.643523] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T19:21:47.697569] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-30T19:21:48.437441] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-30T19:21:48.441247] [INFO ] [REMOTE ] IIM: Full fetch complete (24620 records). [2025-10-30T19:21:48.441321] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-30T19:21:48.505287] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-30T19:21:48.870751] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-30T19:21:48.870859] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-30T19:21:48.871720] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-30T19:21:48.871785] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-30T19:21:48.872570] [DEBUG] [LOCAL ] IIM: Trimmed 24620 records to 15379 (keeping 200 days of data) [2025-10-30T19:21:48.971184] [DEBUG] [LOCAL ] IIM: Primary data saved (15379 records). [2025-10-30T19:21:48.971385] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-30T19:21:48.971485] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IIM took 25.6s. Estimated remaining: 2h 42m 4s. Rate: 7.8 symbols/min [2025-10-30T19:21:49.151397] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:49.209164] [DEBUG] [LOCAL ] INFY: Loaded 53594 existing records from primary storage. [2025-10-30T19:21:49.209677] [INFO ] [MAIN ] INFY: Loaded 53594 existing records. [2025-10-30T19:21:49.303462] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-30T19:21:49.421234] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:49.421900] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-30T19:21:49.421988] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-30T19:21:49.422617] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-30T19:21:49.422728] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-30T19:21:49.652246] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:21:49.875223] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:21:50.097495] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-30T19:21:50.377200] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T19:21:50.897492] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-30T19:21:50.974217] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-30T19:21:51.697507] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-30T19:21:52.043145] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:21:52.497504] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-30T19:21:52.827624] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T19:21:53.297508] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-30T19:21:53.586223] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T19:21:54.097478] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-30T19:21:54.487327] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T19:21:54.897518] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-30T19:21:55.413386] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:21:55.697529] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-30T19:21:56.111202] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T19:21:56.505684] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-30T19:21:56.509968] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T19:21:57.297506] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-30T19:21:57.788875] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T19:21:58.097720] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-30T19:21:58.464952] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-30T19:21:58.471922] [INFO ] [REMOTE ] IIPR: Full fetch complete (43365 records). [2025-10-30T19:21:58.472039] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-30T19:21:58.856043] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-30T19:21:58.856134] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-30T19:21:58.856919] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-30T19:21:58.856984] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-30T19:21:58.858066] [DEBUG] [LOCAL ] IIPR: Trimmed 43365 records to 28586 (keeping 200 days of data) [2025-10-30T19:21:58.914998] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-30T19:21:59.049506] [DEBUG] [LOCAL ] IIPR: Primary data saved (28586 records). [2025-10-30T19:21:59.049708] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-30T19:21:59.049802] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. IIPR took 35.4s. Estimated remaining: 2h 41m 59s. Rate: 7.8 symbols/min [2025-10-30T19:21:59.239787] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:21:59.291560] [DEBUG] [LOCAL ] ING: Loaded 50591 existing records from primary storage. [2025-10-30T19:21:59.312607] [INFO ] [MAIN ] ING: Loaded 50591 existing records. [2025-10-30T19:21:59.398857] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:21:59.535020] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:21:59.535266] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-30T19:21:59.535315] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-30T19:21:59.536011] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-30T19:21:59.536069] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-30T19:21:59.707040] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-30T19:21:59.951295] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:00.154325] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T19:22:00.497553] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-30T19:22:01.094200] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:22:01.297554] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-30T19:22:02.097559] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-30T19:22:02.148857] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-30T19:22:02.897573] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-30T19:22:03.220316] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-30T19:22:03.510519] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-30T19:22:03.525070] [INFO ] [REMOTE ] IMAX: Full fetch complete (61538 records). [2025-10-30T19:22:03.525276] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-30T19:22:03.702838] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-30T19:22:04.090252] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-30T19:22:04.090430] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-30T19:22:04.091786] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-30T19:22:04.091998] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-30T19:22:04.093828] [DEBUG] [LOCAL ] IMAX: Trimmed 61538 records to 43693 (keeping 200 days of data) [2025-10-30T19:22:04.222571] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T19:22:04.420477] [DEBUG] [LOCAL ] IMAX: Primary data saved (43693 records). [2025-10-30T19:22:04.420600] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-30T19:22:04.421617] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. IMAX took 28.7s. Estimated remaining: 2h 41m 49s. Rate: 7.8 symbols/min [2025-10-30T19:22:04.502625] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-30T19:22:04.594532] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:22:04.622989] [DEBUG] [LOCAL ] INGM: Loaded 27590 existing records from primary storage. [2025-10-30T19:22:04.623259] [INFO ] [MAIN ] INGM: Loaded 27590 existing records. [2025-10-30T19:22:04.801847] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:22:04.802047] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-30T19:22:04.802095] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-30T19:22:04.802266] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-30T19:22:04.802304] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-30T19:22:05.161141] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:05.194975] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-30T19:22:05.297532] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-30T19:22:06.020059] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-30T19:22:06.097499] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-30T19:22:06.136925] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T19:22:06.897500] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-30T19:22:07.418164] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T19:22:07.697553] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-30T19:22:08.323109] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-30T19:22:08.497596] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-30T19:22:08.985904] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T19:22:09.297541] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-30T19:22:09.866768] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T19:22:10.097573] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-30T19:22:10.494125] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T19:22:10.897552] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-30T19:22:11.478636] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T19:22:11.697584] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-30T19:22:12.149342] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T19:22:12.431260] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:22:12.497522] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-30T19:22:13.297583] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-30T19:22:13.706436] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T19:22:14.097545] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-30T19:22:14.447213] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:22:14.897530] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-30T19:22:15.533250] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T19:22:15.697521] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-30T19:22:15.834969] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-30T19:22:16.497563] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-30T19:22:17.084283] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T19:22:17.297522] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-30T19:22:17.914756] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-30T19:22:18.097507] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-30T19:22:18.406367] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T19:22:18.897560] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-30T19:22:19.433549] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T19:22:19.697560] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-30T19:22:20.407299] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T19:22:20.497600] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-30T19:22:20.982563] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T19:22:21.297584] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-30T19:22:22.097478] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-30T19:22:22.138460] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T19:22:22.150264] [INFO ] [REMOTE ] INFY: Full fetch complete (77750 records). [2025-10-30T19:22:22.150399] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-30T19:22:22.552028] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-30T19:22:22.552144] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-30T19:22:22.553113] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-30T19:22:22.553176] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-30T19:22:22.554567] [DEBUG] [LOCAL ] INFY: Trimmed 77750 records to 53984 (keeping 200 days of data) [2025-10-30T19:22:22.908973] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-30T19:22:22.929010] [DEBUG] [LOCAL ] INFY: Primary data saved (53984 records). [2025-10-30T19:22:22.931229] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T19:22:22.942052] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-30T19:22:22.942796] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. INFY took 34.0s. Estimated remaining: 2h 41m 53s. Rate: 7.8 symbols/min [2025-10-30T19:22:22.989110] [INFO ] [REMOTE ] ING: Full fetch complete (73772 records). [2025-10-30T19:22:23.015558] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-30T19:22:23.184197] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T19:22:23.241451] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:22:23.559995] [DEBUG] [LOCAL ] INGR: Loaded 33579 existing records from primary storage. [2025-10-30T19:22:23.581759] [INFO ] [MAIN ] INGR: Loaded 33579 existing records. [2025-10-30T19:22:23.651181] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-30T19:22:23.670562] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-30T19:22:23.692792] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-30T19:22:23.695848] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-30T19:22:23.702055] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-30T19:22:23.779431] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:22:23.779802] [DEBUG] [LOCAL ] ING: Trimmed 73772 records to 50976 (keeping 200 days of data) [2025-10-30T19:22:23.780109] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-30T19:22:23.780531] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-30T19:22:23.781437] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-30T19:22:23.781510] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-30T19:22:24.475539] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:24.499051] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-30T19:22:24.501441] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-30T19:22:24.584981] [DEBUG] [LOCAL ] ING: Primary data saved (50976 records). [2025-10-30T19:22:24.585133] [INFO ] [MAIN ] ING: Full history saved. [2025-10-30T19:22:24.585218] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. ING took 25.5s. Estimated remaining: 2h 41m 39s. Rate: 7.8 symbols/min [2025-10-30T19:22:24.776204] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-30T19:22:24.777930] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:22:24.824049] [DEBUG] [LOCAL ] INN: Loaded 40908 existing records from primary storage. [2025-10-30T19:22:24.824430] [INFO ] [MAIN ] INN: Loaded 40908 existing records. [2025-10-30T19:22:25.000824] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:22:25.001004] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-30T19:22:25.001050] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-30T19:22:25.001246] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-30T19:22:25.001301] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-30T19:22:25.309058] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-30T19:22:25.348150] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:25.613958] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T19:22:26.097637] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-30T19:22:26.471639] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-30T19:22:26.897493] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-30T19:22:27.013939] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T19:22:27.697527] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-30T19:22:27.926557] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T19:22:28.497474] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-30T19:22:28.648017] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T19:22:29.280441] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T19:22:29.297465] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-30T19:22:30.102793] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-30T19:22:30.110944] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T19:22:30.897509] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-30T19:22:31.322686] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-30T19:22:31.331878] [INFO ] [REMOTE ] INFA: Full fetch complete (70462 records). [2025-10-30T19:22:31.332055] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-30T19:22:31.720028] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-30T19:22:31.742890] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-30T19:22:31.743852] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-30T19:22:31.744894] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-30T19:22:31.744960] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-30T19:22:31.746496] [DEBUG] [LOCAL ] INFA: Trimmed 70462 records to 48452 (keeping 200 days of data) [2025-10-30T19:22:32.028177] [DEBUG] [LOCAL ] INFA: Primary data saved (48452 records). [2025-10-30T19:22:32.028298] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-30T19:22:32.029087] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. INFA took 45.4s. Estimated remaining: 2h 41m 31s. Rate: 7.8 symbols/min [2025-10-30T19:22:32.202211] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:22:32.202470] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-30T19:22:32.202536] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-30T19:22:32.202853] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-30T19:22:32.202916] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-30T19:22:32.203011] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-30T19:22:32.203178] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-30T19:22:32.328357] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T19:22:32.503021] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-30T19:22:32.611998] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:32.790338] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T19:22:32.797194] [INFO ] [REMOTE ] INGM: Full fetch complete (41764 records). [2025-10-30T19:22:32.797333] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-30T19:22:33.165328] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-30T19:22:33.165401] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-30T19:22:33.166170] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-30T19:22:33.166245] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-30T19:22:33.167180] [DEBUG] [LOCAL ] INGM: Trimmed 41764 records to 27839 (keeping 200 days of data) [2025-10-30T19:22:33.303891] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-30T19:22:33.339922] [DEBUG] [LOCAL ] INGM: Primary data saved (27839 records). [2025-10-30T19:22:33.340210] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-30T19:22:33.340300] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. INGM took 28.9s. Estimated remaining: 2h 41m 16s. Rate: 7.8 symbols/min [2025-10-30T19:22:33.531222] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:22:33.534207] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-30T19:22:33.557815] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-30T19:22:33.592619] [DEBUG] [LOCAL ] INSP: Loaded 38712 existing records from primary storage. [2025-10-30T19:22:33.592909] [INFO ] [MAIN ] INSP: Loaded 38712 existing records. [2025-10-30T19:22:33.767112] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:22:33.767296] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-30T19:22:33.767371] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-30T19:22:33.768088] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-30T19:22:33.768148] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-30T19:22:34.102717] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-30T19:22:34.146348] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:34.897469] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-30T19:22:35.077300] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T19:22:35.697494] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-30T19:22:35.848091] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T19:22:36.497475] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-30T19:22:36.594227] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-30T19:22:37.297526] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-30T19:22:37.428856] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T19:22:38.105316] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-30T19:22:38.109507] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T19:22:38.897497] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-30T19:22:39.141327] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T19:22:39.691737] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-30T19:22:39.697618] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-30T19:22:40.444438] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-30T19:22:40.497512] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-30T19:22:41.297506] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-30T19:22:41.428103] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T19:22:42.097483] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-30T19:22:42.228511] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T19:22:42.824852] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T19:22:42.897494] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-30T19:22:43.696284] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T19:22:43.703070] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-30T19:22:44.497495] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-30T19:22:44.697291] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T19:22:45.297489] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-30T19:22:45.455453] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-30T19:22:46.097507] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-30T19:22:46.373700] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T19:22:46.897478] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-30T19:22:47.046916] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-30T19:22:47.697491] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-30T19:22:47.762869] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T19:22:48.497472] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-30T19:22:48.637558] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T19:22:49.297504] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-30T19:22:49.316515] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-30T19:22:50.097533] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-30T19:22:50.270974] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T19:22:50.897577] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-30T19:22:51.150768] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T19:22:51.697552] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-30T19:22:51.941397] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-30T19:22:51.947869] [INFO ] [REMOTE ] INR: Full fetch complete (38507 records). [2025-10-30T19:22:51.947978] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-30T19:22:52.133486] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-30T19:22:52.133985] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:22:52.134056] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:22:52.134128] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-30T19:22:52.134193] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-30T19:22:52.134228] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-30T19:22:52.134287] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-30T19:22:52.134344] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INR took 20.1s. Estimated remaining: 2h 41m 20s. Rate: 7.8 symbols/min [2025-10-30T19:22:52.306136] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:22:52.343048] [DEBUG] [LOCAL ] INSW: Loaded 38652 existing records from primary storage. [2025-10-30T19:22:52.343377] [INFO ] [MAIN ] INSW: Loaded 38652 existing records. [2025-10-30T19:22:52.503548] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-30T19:22:52.527260] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:22:52.527551] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-30T19:22:52.527606] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-30T19:22:52.528033] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-30T19:22:52.528092] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-30T19:22:52.907505] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:52.938388] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T19:22:53.297545] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-30T19:22:53.695190] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T19:22:53.703375] [INFO ] [REMOTE ] INGR: Full fetch complete (50761 records). [2025-10-30T19:22:53.703518] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-30T19:22:54.082869] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-30T19:22:54.082943] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-30T19:22:54.083750] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-30T19:22:54.083811] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-30T19:22:54.084848] [DEBUG] [LOCAL ] INGR: Trimmed 50761 records to 33885 (keeping 200 days of data) [2025-10-30T19:22:54.139354] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-30T19:22:54.295821] [DEBUG] [LOCAL ] INGR: Primary data saved (33885 records). [2025-10-30T19:22:54.295948] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-30T19:22:54.296023] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INGR took 31.4s. Estimated remaining: 2h 41m 6s. Rate: 7.8 symbols/min [2025-10-30T19:22:54.465665] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:22:54.520400] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T19:22:54.549276] [DEBUG] [LOCAL ] INVH: Loaded 53180 existing records from primary storage. [2025-10-30T19:22:54.549559] [INFO ] [MAIN ] INVH: Loaded 53180 existing records. [2025-10-30T19:22:54.724942] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:22:54.725150] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-30T19:22:54.725196] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-30T19:22:54.725522] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-30T19:22:54.725578] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-30T19:22:54.907846] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-30T19:22:55.087000] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:22:55.235188] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-30T19:22:55.697491] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-30T19:22:56.247780] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T19:22:56.497547] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-30T19:22:56.852357] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:22:57.297544] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-30T19:22:57.544267] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T19:22:58.097502] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-30T19:22:58.602721] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-30T19:22:58.897498] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-30T19:22:59.697520] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-30T19:23:00.497503] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-30T19:23:05.552779] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (7.46 seconds). [2025-10-30T19:23:05.566325] [INFO ] [REMOTE ] INSP: Full fetch complete (53900 records). [2025-10-30T19:23:05.566552] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-30T19:23:05.698619] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (6.80 seconds). [2025-10-30T19:23:05.775632] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-30T19:23:06.031821] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-30T19:23:06.032162] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-30T19:23:06.032970] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-30T19:23:06.041834] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-30T19:23:06.058381] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (5.56 seconds). [2025-10-30T19:23:06.069685] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-30T19:23:06.069334] [DEBUG] [LOCAL ] INSP: Trimmed 53900 records to 39065 (keeping 200 days of data) [2025-10-30T19:23:06.311958] [DEBUG] [LOCAL ] INSP: Primary data saved (39065 records). [2025-10-30T19:23:06.312271] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-30T19:23:06.312369] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INSP took 33.0s. Estimated remaining: 2h 41m 4s. Rate: 7.8 symbols/min [2025-10-30T19:23:06.529767] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:06.527268] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (6.83 seconds). [2025-10-30T19:23:06.539281] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-30T19:23:06.565614] [DEBUG] [LOCAL ] INVX: Loaded 28430 existing records from primary storage. [2025-10-30T19:23:06.565931] [INFO ] [MAIN ] INVX: Loaded 28430 existing records. [2025-10-30T19:23:06.745612] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:06.745847] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-30T19:23:06.745896] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-30T19:23:06.746200] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-30T19:23:06.746257] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-30T19:23:07.120404] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:07.120749] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-30T19:23:07.701247] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-30T19:23:07.714499] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-30T19:23:07.844727] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-30T19:23:07.854631] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-30T19:23:08.138955] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-30T19:23:08.148516] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-30T19:23:08.439513] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:23:08.446792] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-30T19:23:08.808902] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-30T19:23:08.818011] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-30T19:23:09.188165] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T19:23:09.197132] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-30T19:23:09.277968] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T19:23:09.297448] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-30T19:23:09.850767] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T19:23:10.097480] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-30T19:23:10.134729] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T19:23:10.218143] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-30T19:23:10.289397] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-30T19:23:10.897480] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-30T19:23:11.064930] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T19:23:11.697509] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-30T19:23:12.122966] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:23:12.497541] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-30T19:23:12.928851] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T19:23:13.297502] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-30T19:23:13.748147] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T19:23:13.756163] [INFO ] [REMOTE ] INN: Full fetch complete (57664 records). [2025-10-30T19:23:13.756263] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-30T19:23:14.102614] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-30T19:23:14.198087] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-30T19:23:14.198172] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-30T19:23:14.199073] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-30T19:23:14.199139] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-30T19:23:14.200395] [DEBUG] [LOCAL ] INN: Trimmed 57664 records to 41182 (keeping 200 days of data) [2025-10-30T19:23:14.447418] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-30T19:23:14.499423] [DEBUG] [LOCAL ] INN: Primary data saved (41182 records). [2025-10-30T19:23:14.499601] [INFO ] [MAIN ] INN: Full history saved. [2025-10-30T19:23:14.499730] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INN took 49.9s. Estimated remaining: 2h 40m 56s. Rate: 7.8 symbols/min [2025-10-30T19:23:14.698919] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:14.749152] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-30T19:23:14.749447] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-30T19:23:14.902702] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-30T19:23:14.949523] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:14.949793] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-30T19:23:14.949845] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-30T19:23:14.950835] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-30T19:23:14.950900] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-30T19:23:15.332284] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:15.624900] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-30T19:23:15.697483] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-30T19:23:15.962052] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T19:23:16.497544] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-30T19:23:16.545508] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T19:23:17.297489] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-30T19:23:18.097513] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-30T19:23:18.488458] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-30T19:23:18.625073] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-30T19:23:18.897483] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-30T19:23:18.929110] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T19:23:19.697527] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-30T19:23:20.497501] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-30T19:23:21.297533] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-30T19:23:21.333438] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-30T19:23:21.378788] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T19:23:21.510020] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-30T19:23:22.097490] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-30T19:23:22.897556] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-30T19:23:23.209190] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-30T19:23:23.331956] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T19:23:23.339619] [INFO ] [REMOTE ] INSW: Full fetch complete (58800 records). [2025-10-30T19:23:23.339765] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-30T19:23:23.711394] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-30T19:23:23.732665] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-30T19:23:23.732748] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-30T19:23:23.733694] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-30T19:23:23.733758] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-30T19:23:23.735066] [DEBUG] [LOCAL ] INSW: Trimmed 58800 records to 38900 (keeping 200 days of data) [2025-10-30T19:23:23.966550] [DEBUG] [LOCAL ] INSW: Primary data saved (38900 records). [2025-10-30T19:23:23.966754] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-30T19:23:23.967665] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INSW took 31.8s. Estimated remaining: 2h 40m 51s. Rate: 7.8 symbols/min [2025-10-30T19:23:24.135479] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:24.186603] [DEBUG] [LOCAL ] IOT: Loaded 53437 existing records from primary storage. [2025-10-30T19:23:24.186948] [INFO ] [MAIN ] IOT: Loaded 53437 existing records. [2025-10-30T19:23:24.374461] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:24.374909] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-30T19:23:24.375021] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-30T19:23:24.376017] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-30T19:23:24.376079] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-30T19:23:24.515054] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-30T19:23:24.529310] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-30T19:23:24.815602] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:24.831137] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T19:23:25.297494] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-30T19:23:26.097511] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-30T19:23:26.909536] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-30T19:23:26.916625] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-30T19:23:27.302639] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T19:23:27.423124] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-30T19:23:27.434906] [INFO ] [REMOTE ] INVH: Full fetch complete (77002 records). [2025-10-30T19:23:27.435038] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-30T19:23:27.703532] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-30T19:23:27.847870] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-30T19:23:27.853690] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-30T19:23:27.864046] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-30T19:23:27.864686] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-30T19:23:27.865188] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T19:23:27.872622] [DEBUG] [LOCAL ] INVH: Trimmed 77002 records to 53570 (keeping 200 days of data) [2025-10-30T19:23:28.220916] [DEBUG] [LOCAL ] INVH: Primary data saved (53570 records). [2025-10-30T19:23:28.221046] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-30T19:23:28.221575] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INVH took 33.9s. Estimated remaining: 2h 40m 39s. Rate: 7.8 symbols/min [2025-10-30T19:23:28.388678] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:28.450138] [DEBUG] [LOCAL ] IP: Loaded 53298 existing records from primary storage. [2025-10-30T19:23:28.450489] [INFO ] [MAIN ] IP: Loaded 53298 existing records. [2025-10-30T19:23:28.506939] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-30T19:23:28.636557] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:28.636816] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-30T19:23:28.636867] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-30T19:23:28.637809] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-30T19:23:28.637867] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-30T19:23:28.995393] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:29.027110] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-30T19:23:29.297501] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-30T19:23:30.097500] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-30T19:23:30.366016] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T19:23:30.372218] [INFO ] [REMOTE ] INVX: Full fetch complete (42327 records). [2025-10-30T19:23:30.372319] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-30T19:23:30.756280] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-30T19:23:30.756492] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-30T19:23:30.757351] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-30T19:23:30.757429] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-30T19:23:30.758441] [DEBUG] [LOCAL ] INVX: Trimmed 42327 records to 28601 (keeping 200 days of data) [2025-10-30T19:23:30.905684] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-30T19:23:30.938959] [DEBUG] [LOCAL ] INVX: Primary data saved (28601 records). [2025-10-30T19:23:30.939282] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-30T19:23:30.939391] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. INVX took 24.6s. Estimated remaining: 2h 40m 26s. Rate: 7.8 symbols/min [2025-10-30T19:23:30.974783] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-30T19:23:31.400754] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:23:31.697554] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-30T19:23:32.202207] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T19:23:32.497530] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-30T19:23:33.140589] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-30T19:23:33.297489] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-30T19:23:34.097546] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-30T19:23:34.723100] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-30T19:23:34.770331] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-30T19:23:34.897465] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-30T19:23:35.697547] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-30T19:23:36.469074] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-30T19:23:36.498602] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-30T19:23:36.511086] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-30T19:23:37.297495] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-30T19:23:37.767553] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-30T19:23:37.862037] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-30T19:23:38.097492] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-30T19:23:38.897502] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-30T19:23:39.418032] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-30T19:23:39.697494] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-30T19:23:40.343232] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T19:23:40.412122] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-30T19:23:40.497505] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-30T19:23:40.972623] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T19:23:41.297490] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-30T19:23:42.097502] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-30T19:23:42.586108] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-30T19:23:42.628748] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T19:23:42.897474] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-30T19:23:43.461529] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T19:23:43.697548] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-30T19:23:44.347838] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T19:23:44.359733] [INFO ] [REMOTE ] IOT: Full fetch complete (77512 records). [2025-10-30T19:23:44.359897] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-30T19:23:44.502684] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-30T19:23:44.760734] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-30T19:23:44.760824] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-30T19:23:44.761902] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-30T19:23:44.761967] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-30T19:23:44.763438] [DEBUG] [LOCAL ] IOT: Trimmed 77512 records to 53822 (keeping 200 days of data) [2025-10-30T19:23:45.066090] [DEBUG] [LOCAL ] IOT: Primary data saved (53822 records). [2025-10-30T19:23:45.066213] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-30T19:23:45.066289] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. IOT took 21.1s. Estimated remaining: 2h 40m 25s. Rate: 7.8 symbols/min [2025-10-30T19:23:45.719564] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-30T19:23:45.730914] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-30T19:23:45.772376] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T19:23:46.097484] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-30T19:23:47.489290] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T19:23:47.500918] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-30T19:23:48.185996] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-30T19:23:48.197720] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-30T19:23:48.197850] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-30T19:23:48.611172] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-30T19:23:48.611290] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-30T19:23:48.612275] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-30T19:23:48.612337] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-30T19:23:48.613825] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-30T19:23:48.940937] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-30T19:23:48.941070] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-30T19:23:48.941164] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IONQ took 34.4s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-10-30T19:23:48.985773] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-30T19:23:48.997130] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-30T19:23:50.290569] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-30T19:23:50.301884] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-30T19:23:51.985738] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T19:23:51.997462] [INFO ] [REMOTE ] IP: Full fetch complete (77430 records). [2025-10-30T19:23:51.997630] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-30T19:23:52.408495] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-30T19:23:52.408575] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-30T19:23:52.409526] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-30T19:23:52.409590] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-30T19:23:52.410978] [DEBUG] [LOCAL ] IP: Trimmed 77430 records to 53688 (keeping 200 days of data) [2025-10-30T19:23:52.723281] [DEBUG] [LOCAL ] IP: Primary data saved (53688 records). [2025-10-30T19:23:52.723408] [INFO ] [MAIN ] IP: Full history saved. [2025-10-30T19:23:52.724057] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IP took 24.5s. Estimated remaining: 2h 40m 1s. Rate: 7.8 symbols/min [2025-10-30T19:23:53.430230] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:53.442534] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:53.485755] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:53.490910] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:23:53.516437] [DEBUG] [LOCAL ] IPI: Loaded 21234 existing records from primary storage. [2025-10-30T19:23:53.516802] [INFO ] [MAIN ] IPI: Loaded 21234 existing records. [2025-10-30T19:23:53.624342] [DEBUG] [LOCAL ] IQI: Loaded 17397 existing records from primary storage. [2025-10-30T19:23:53.628176] [INFO ] [MAIN ] IQI: Loaded 17397 existing records. [2025-10-30T19:23:53.773714] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:53.780193] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-30T19:23:53.785595] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-30T19:23:53.796553] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-30T19:23:53.857600] [DEBUG] [LOCAL ] IPG: Loaded 53326 existing records from primary storage. [2025-10-30T19:23:53.863067] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-30T19:23:53.873964] [INFO ] [MAIN ] IPG: Loaded 53326 existing records. [2025-10-30T19:23:53.916110] [DEBUG] [LOCAL ] IQV: Loaded 49900 existing records from primary storage. [2025-10-30T19:23:54.016934] [INFO ] [MAIN ] IQV: Loaded 49900 existing records. [2025-10-30T19:23:54.270385] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:54.373075] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-30T19:23:54.397088] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-30T19:23:54.477966] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:54.451519] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-30T19:23:54.526797] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-30T19:23:54.605752] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-30T19:23:54.623527] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-30T19:23:54.618203] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:23:54.653969] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-30T19:23:54.669562] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-30T19:23:54.669631] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-30T19:23:54.710280] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-30T19:23:54.719344] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-30T19:23:54.724587] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-30T19:23:55.247776] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:55.326575] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-30T19:23:55.788842] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:55.846564] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:55.846893] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-30T19:23:55.840937] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-30T19:23:55.913601] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:23:55.914048] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-30T19:23:56.330475] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T19:23:56.334193] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-30T19:23:56.539719] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T19:23:56.543810] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-30T19:23:56.957685] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T19:23:56.961772] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-30T19:23:57.113583] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T19:23:57.123844] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-30T19:23:57.287057] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T19:23:57.298750] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T19:23:57.299611] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-30T19:23:57.305093] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-30T19:23:57.659436] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T19:23:57.664527] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-30T19:23:57.978621] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T19:23:58.097467] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-30T19:23:58.230803] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T19:23:58.287287] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-30T19:23:58.594975] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T19:23:58.804122] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-30T19:23:58.897481] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-30T19:23:59.697587] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-30T19:24:00.270286] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T19:24:00.497530] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-30T19:24:01.250271] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-30T19:24:01.297503] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-30T19:24:01.542535] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-30T19:24:02.097502] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-30T19:24:02.768069] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T19:24:02.794858] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-30T19:24:02.897517] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-30T19:24:03.558895] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-30T19:24:03.697545] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-30T19:24:04.430565] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T19:24:04.497486] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-30T19:24:05.292432] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T19:24:05.297443] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-30T19:24:05.863527] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-30T19:24:06.097531] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-30T19:24:06.897540] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-30T19:24:07.522377] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T19:24:07.653918] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T19:24:07.658870] [INFO ] [REMOTE ] IQI: Full fetch complete (25990 records). [2025-10-30T19:24:07.659037] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-30T19:24:07.702804] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-30T19:24:08.078777] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-30T19:24:08.078859] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-30T19:24:08.079425] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-30T19:24:08.079499] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-30T19:24:08.080153] [DEBUG] [LOCAL ] IQI: Trimmed 25990 records to 17528 (keeping 200 days of data) [2025-10-30T19:24:08.179466] [DEBUG] [LOCAL ] IQI: Primary data saved (17528 records). [2025-10-30T19:24:08.179599] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-30T19:24:08.179699] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 15.4s. Estimated remaining: 2h 40m 2s. Rate: 7.8 symbols/min [2025-10-30T19:24:08.346988] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:24:08.393853] [DEBUG] [LOCAL ] IR: Loaded 52718 existing records from primary storage. [2025-10-30T19:24:08.394145] [INFO ] [MAIN ] IR: Loaded 52718 existing records. [2025-10-30T19:24:08.502741] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-30T19:24:08.576186] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:24:08.576381] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-30T19:24:08.576427] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-30T19:24:08.577518] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-30T19:24:08.577575] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-30T19:24:08.931414] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:24:09.017466] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T19:24:09.297542] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-30T19:24:09.832671] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T19:24:10.097528] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-30T19:24:10.127199] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T19:24:10.897489] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-30T19:24:11.385466] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T19:24:11.697515] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-30T19:24:12.239494] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T19:24:12.430273] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-30T19:24:12.497494] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-30T19:24:13.297481] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-30T19:24:13.634948] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T19:24:14.017026] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-30T19:24:14.097469] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-30T19:24:14.839898] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T19:24:14.897457] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-30T19:24:15.697484] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-30T19:24:15.786435] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-30T19:24:15.791606] [INFO ] [REMOTE ] IPI: Full fetch complete (30301 records). [2025-10-30T19:24:15.791710] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-30T19:24:16.165550] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-30T19:24:16.165638] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-30T19:24:16.166368] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-30T19:24:16.166412] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-30T19:24:16.167256] [DEBUG] [LOCAL ] IPI: Trimmed 30301 records to 21353 (keeping 200 days of data) [2025-10-30T19:24:16.293213] [DEBUG] [LOCAL ] IPI: Primary data saved (21353 records). [2025-10-30T19:24:16.293304] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-30T19:24:16.293393] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 23.6s. Estimated remaining: 2h 39m 55s. Rate: 7.8 symbols/min [2025-10-30T19:24:16.460031] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:24:16.502873] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-30T19:24:16.507057] [DEBUG] [LOCAL ] IRM: Loaded 48530 existing records from primary storage. [2025-10-30T19:24:16.507522] [INFO ] [MAIN ] IRM: Loaded 48530 existing records. [2025-10-30T19:24:16.696475] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:24:16.696717] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-30T19:24:16.696774] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-30T19:24:16.697677] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-30T19:24:16.697735] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-30T19:24:17.061519] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:24:17.089268] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T19:24:17.297526] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-30T19:24:17.917200] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-30T19:24:18.097511] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-30T19:24:18.582415] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T19:24:18.897501] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-30T19:24:19.296704] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T19:24:19.697521] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-30T19:24:20.383374] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T19:24:20.497500] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-30T19:24:21.007607] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T19:24:21.297546] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-30T19:24:21.658225] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T19:24:22.097511] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-30T19:24:22.615027] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T19:24:22.897524] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-30T19:24:23.363402] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:24:23.697538] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-30T19:24:24.137375] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T19:24:24.497554] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-30T19:24:25.158766] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T19:24:25.297530] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-30T19:24:25.831479] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-30T19:24:26.097497] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-30T19:24:26.575063] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T19:24:26.897495] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-30T19:24:27.438804] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T19:24:27.697563] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-30T19:24:28.268209] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T19:24:28.497479] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-30T19:24:28.984267] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T19:24:29.297501] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-30T19:24:29.895875] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T19:24:29.908577] [INFO ] [REMOTE ] IPG: Full fetch complete (77441 records). [2025-10-30T19:24:29.908796] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-30T19:24:30.104531] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-30T19:24:30.298114] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-30T19:24:30.298190] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-30T19:24:30.299144] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-30T19:24:30.299205] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-30T19:24:30.300531] [DEBUG] [LOCAL ] IPG: Trimmed 77441 records to 53716 (keeping 200 days of data) [2025-10-30T19:24:30.622535] [DEBUG] [LOCAL ] IPG: Primary data saved (53716 records). [2025-10-30T19:24:30.622812] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-30T19:24:30.622901] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IPG took 37.9s. Estimated remaining: 2h 39m 54s. Rate: 7.8 symbols/min [2025-10-30T19:24:30.792348] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:24:30.833551] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T19:24:30.853972] [DEBUG] [LOCAL ] IRS: Loaded 23822 existing records from primary storage. [2025-10-30T19:24:30.854235] [INFO ] [MAIN ] IRS: Loaded 23822 existing records. [2025-10-30T19:24:30.907213] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-30T19:24:31.027886] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:24:31.028082] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-30T19:24:31.028129] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-30T19:24:31.028468] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-30T19:24:31.028526] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-30T19:24:31.374676] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:24:31.404189] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T19:24:31.697497] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-30T19:24:32.263368] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T19:24:32.497507] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-30T19:24:33.094307] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T19:24:33.105070] [INFO ] [REMOTE ] IQV: Full fetch complete (72631 records). [2025-10-30T19:24:33.105186] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-30T19:24:33.302695] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-30T19:24:33.515960] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-30T19:24:33.516036] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-30T19:24:33.516968] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-30T19:24:33.517031] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-30T19:24:33.518304] [DEBUG] [LOCAL ] IQV: Trimmed 72631 records to 50235 (keeping 200 days of data) [2025-10-30T19:24:33.817306] [DEBUG] [LOCAL ] IQV: Primary data saved (50235 records). [2025-10-30T19:24:33.817550] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-30T19:24:33.817782] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IQV took 41.1s. Estimated remaining: 2h 39m 42s. Rate: 7.8 symbols/min [2025-10-30T19:24:33.953113] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-30T19:24:34.033858] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:24:34.083118] [DEBUG] [LOCAL ] IRT: Loaded 50290 existing records from primary storage. [2025-10-30T19:24:34.083437] [INFO ] [MAIN ] IRT: Loaded 50290 existing records. [2025-10-30T19:24:34.103974] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-30T19:24:34.267486] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:24:34.267834] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-30T19:24:34.267978] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-30T19:24:34.273470] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-30T19:24:34.281935] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-30T19:24:34.348360] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-30T19:24:34.646472] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:24:34.897498] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-30T19:24:35.416395] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T19:24:35.557984] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T19:24:35.697491] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-30T19:24:36.497488] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-30T19:24:36.969928] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T19:24:37.297514] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-30T19:24:37.523786] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T19:24:37.953635] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-30T19:24:38.097498] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-30T19:24:38.897490] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-30T19:24:39.394834] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T19:24:39.611444] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-30T19:24:39.697451] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-30T19:24:40.469172] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-30T19:24:40.497461] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-30T19:24:41.297512] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-30T19:24:41.949933] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T19:24:41.962263] [INFO ] [REMOTE ] IR: Full fetch complete (76492 records). [2025-10-30T19:24:41.962484] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-30T19:24:42.118963] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T19:24:42.100597] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-30T19:24:42.409348] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-30T19:24:42.409435] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-30T19:24:42.410579] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-30T19:24:42.410666] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-30T19:24:42.412517] [DEBUG] [LOCAL ] IR: Trimmed 76492 records to 53108 (keeping 200 days of data) [2025-10-30T19:24:42.729784] [DEBUG] [LOCAL ] IR: Primary data saved (53108 records). [2025-10-30T19:24:42.729922] [INFO ] [MAIN ] IR: Full history saved. [2025-10-30T19:24:42.730001] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IR took 34.6s. Estimated remaining: 2h 39m 35s. Rate: 7.8 symbols/min [2025-10-30T19:24:42.896081] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:24:42.897510] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-30T19:24:42.911884] [DEBUG] [LOCAL ] ISD: Loaded 15280 existing records from primary storage. [2025-10-30T19:24:42.912166] [INFO ] [MAIN ] ISD: Loaded 15280 existing records. [2025-10-30T19:24:43.092800] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:24:43.093018] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-30T19:24:43.093064] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-30T19:24:43.093483] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-30T19:24:43.093539] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-30T19:24:43.483583] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:24:43.509294] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-30T19:24:43.697477] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-30T19:24:44.508705] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-30T19:24:44.510613] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T19:24:44.522315] [INFO ] [REMOTE ] IRM: Full fetch complete (71793 records). [2025-10-30T19:24:44.522448] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-30T19:24:44.919901] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-30T19:24:44.920050] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-30T19:24:44.921188] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-30T19:24:44.921292] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-30T19:24:44.922750] [DEBUG] [LOCAL ] IRM: Trimmed 71793 records to 48898 (keeping 200 days of data) [2025-10-30T19:24:45.172037] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-30T19:24:45.274482] [DEBUG] [LOCAL ] IRM: Primary data saved (48898 records). [2025-10-30T19:24:45.274620] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-30T19:24:45.275776] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IRM took 29.0s. Estimated remaining: 2h 39m 22s. Rate: 7.8 symbols/min [2025-10-30T19:24:45.305352] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-30T19:24:45.462938] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:24:45.476816] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T19:24:45.521385] [DEBUG] [LOCAL ] IT: Loaded 42118 existing records from primary storage. [2025-10-30T19:24:45.521687] [INFO ] [MAIN ] IT: Loaded 42118 existing records. [2025-10-30T19:24:45.696356] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:24:45.696626] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-30T19:24:45.696717] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-30T19:24:45.697784] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-30T19:24:45.697844] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-30T19:24:46.059556] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:24:46.097507] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-30T19:24:46.149906] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-30T19:24:46.808073] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T19:24:46.897531] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-30T19:24:47.697521] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-30T19:24:47.930830] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-30T19:24:48.327908] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-30T19:24:48.497574] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-30T19:24:49.297510] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-30T19:24:49.503442] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T19:24:50.097533] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-30T19:24:50.718863] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T19:24:50.897495] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-30T19:24:51.090575] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T19:24:51.697552] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-30T19:24:52.255504] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T19:24:52.497490] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-30T19:24:52.900509] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T19:24:53.162048] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-30T19:24:53.297522] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-30T19:24:54.097509] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-30T19:24:54.611502] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T19:24:54.897536] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-30T19:24:55.103986] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T19:24:55.697495] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-30T19:24:55.728883] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T19:24:56.497485] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-30T19:24:56.978161] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T19:24:57.182203] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T19:24:57.297509] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-30T19:24:57.970194] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T19:24:58.097510] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-30T19:24:58.770954] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T19:24:58.897524] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-30T19:24:59.524916] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T19:24:59.697516] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-30T19:25:00.184326] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-30T19:25:00.497470] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-30T19:25:01.297503] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-30T19:25:02.097480] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-30T19:25:02.133155] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T19:25:02.139934] [INFO ] [REMOTE ] IRS: Full fetch complete (32891 records). [2025-10-30T19:25:02.140043] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-30T19:25:02.528204] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-30T19:25:02.528281] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-30T19:25:02.528961] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-30T19:25:02.529024] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-30T19:25:02.529764] [DEBUG] [LOCAL ] IRS: Trimmed 32891 records to 24030 (keeping 200 days of data) [2025-10-30T19:25:02.668393] [DEBUG] [LOCAL ] IRS: Primary data saved (24030 records). [2025-10-30T19:25:02.668517] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-30T19:25:02.668599] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. IRS took 32.0s. Estimated remaining: 2h 39m 25s. Rate: 7.8 symbols/min [2025-10-30T19:25:02.801323] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-30T19:25:02.857815] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:02.891801] [DEBUG] [LOCAL ] ITGR: Loaded 31348 existing records from primary storage. [2025-10-30T19:25:02.892079] [INFO ] [MAIN ] ITGR: Loaded 31348 existing records. [2025-10-30T19:25:02.897670] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-30T19:25:03.078867] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:03.079148] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-30T19:25:03.079330] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-30T19:25:03.079757] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-30T19:25:03.079834] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-30T19:25:03.290543] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-30T19:25:03.478836] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:03.697495] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-30T19:25:04.180385] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T19:25:04.505921] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-30T19:25:04.507777] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-30T19:25:05.297488] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-30T19:25:05.412554] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T19:25:05.416736] [INFO ] [REMOTE ] ISD: Full fetch complete (23704 records). [2025-10-30T19:25:05.416819] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-30T19:25:05.797142] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-30T19:25:05.797218] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-30T19:25:05.797776] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-30T19:25:05.797839] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-30T19:25:05.798483] [DEBUG] [LOCAL ] ISD: Trimmed 23704 records to 15350 (keeping 200 days of data) [2025-10-30T19:25:05.890412] [DEBUG] [LOCAL ] ISD: Primary data saved (15350 records). [2025-10-30T19:25:05.890562] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-30T19:25:05.890674] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. ISD took 23.2s. Estimated remaining: 2h 39m 12s. Rate: 7.8 symbols/min [2025-10-30T19:25:06.077351] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:06.097491] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-30T19:25:06.113243] [DEBUG] [LOCAL ] ITT: Loaded 31925 existing records from primary storage. [2025-10-30T19:25:06.113552] [INFO ] [MAIN ] ITT: Loaded 31925 existing records. [2025-10-30T19:25:06.295563] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:06.295804] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-30T19:25:06.295851] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-30T19:25:06.296093] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-30T19:25:06.296150] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-30T19:25:06.665430] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:06.697503] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T19:25:06.897472] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-30T19:25:06.979876] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T19:25:07.697484] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-30T19:25:08.269072] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T19:25:08.279892] [INFO ] [REMOTE ] IRT: Full fetch complete (72864 records). [2025-10-30T19:25:08.280024] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-30T19:25:08.503607] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-30T19:25:08.676344] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-30T19:25:08.676474] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-30T19:25:08.677447] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-30T19:25:08.677582] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-30T19:25:08.679013] [DEBUG] [LOCAL ] IRT: Trimmed 72864 records to 50678 (keeping 200 days of data) [2025-10-30T19:25:08.783709] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T19:25:09.018325] [DEBUG] [LOCAL ] IRT: Primary data saved (50678 records). [2025-10-30T19:25:09.018499] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-30T19:25:09.018606] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. IRT took 35.2s. Estimated remaining: 2h 38m 59s. Rate: 7.8 symbols/min [2025-10-30T19:25:09.187781] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:09.236070] [DEBUG] [LOCAL ] ITUB: Loaded 53293 existing records from primary storage. [2025-10-30T19:25:09.236395] [INFO ] [MAIN ] ITUB: Loaded 53293 existing records. [2025-10-30T19:25:09.300753] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-30T19:25:09.427300] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:09.427679] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-30T19:25:09.427765] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-30T19:25:09.428133] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-30T19:25:09.428190] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-30T19:25:09.733245] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-30T19:25:09.830775] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:10.097507] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-30T19:25:10.538913] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-30T19:25:10.897601] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-30T19:25:11.315755] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T19:25:11.697507] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-30T19:25:12.101544] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-30T19:25:12.497526] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-30T19:25:12.682692] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T19:25:13.297528] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-30T19:25:13.731486] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T19:25:14.097501] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-30T19:25:14.744702] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-30T19:25:14.875675] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-30T19:25:14.897453] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-30T19:25:15.653501] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-30T19:25:15.697453] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-30T19:25:16.497529] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-30T19:25:16.727845] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T19:25:17.297498] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-30T19:25:17.507337] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-30T19:25:18.097504] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-30T19:25:18.386872] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T19:25:18.897469] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-30T19:25:18.962764] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T19:25:19.697505] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-30T19:25:20.259689] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T19:25:20.497485] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-30T19:25:21.053144] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T19:25:21.062957] [INFO ] [REMOTE ] IT: Full fetch complete (58336 records). [2025-10-30T19:25:21.063093] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-30T19:25:21.307583] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-30T19:25:21.445204] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-30T19:25:21.445328] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-30T19:25:21.446200] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-30T19:25:21.446344] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-30T19:25:21.447540] [DEBUG] [LOCAL ] IT: Trimmed 58336 records to 42409 (keeping 200 days of data) [2025-10-30T19:25:21.672546] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T19:25:21.727707] [DEBUG] [LOCAL ] IT: Primary data saved (42409 records). [2025-10-30T19:25:21.727833] [INFO ] [MAIN ] IT: Full history saved. [2025-10-30T19:25:21.728717] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. IT took 36.5s. Estimated remaining: 2h 38m 57s. Rate: 7.8 symbols/min [2025-10-30T19:25:21.897597] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:21.939691] [DEBUG] [LOCAL ] ITW: Loaded 45518 existing records from primary storage. [2025-10-30T19:25:21.940001] [INFO ] [MAIN ] ITW: Loaded 45518 existing records. [2025-10-30T19:25:22.104451] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-30T19:25:22.157532] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:22.158599] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-30T19:25:22.158712] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-30T19:25:22.159265] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-30T19:25:22.159434] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-30T19:25:22.512538] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:22.785076] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-30T19:25:22.897461] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-30T19:25:23.148581] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:25:23.697589] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-30T19:25:23.871388] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T19:25:24.502626] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-30T19:25:24.526937] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T19:25:25.297498] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-30T19:25:25.773854] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T19:25:26.097505] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-30T19:25:26.149591] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T19:25:26.897530] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-30T19:25:27.540494] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-30T19:25:27.697493] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-30T19:25:28.105245] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T19:25:28.113094] [INFO ] [REMOTE ] ITGR: Full fetch complete (44669 records). [2025-10-30T19:25:28.113189] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-30T19:25:28.480973] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-30T19:25:28.481049] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-30T19:25:28.481760] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-30T19:25:28.481820] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-30T19:25:28.482740] [DEBUG] [LOCAL ] ITGR: Trimmed 44669 records to 31710 (keeping 200 days of data) [2025-10-30T19:25:28.534243] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-30T19:25:28.673349] [DEBUG] [LOCAL ] ITGR: Primary data saved (31710 records). [2025-10-30T19:25:28.673488] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-30T19:25:28.673591] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. ITGR took 26.0s. Estimated remaining: 2h 38m 49s. Rate: 7.8 symbols/min [2025-10-30T19:25:28.840390] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:28.880725] [DEBUG] [LOCAL ] IVR: Loaded 47584 existing records from primary storage. [2025-10-30T19:25:28.881007] [INFO ] [MAIN ] IVR: Loaded 47584 existing records. [2025-10-30T19:25:29.058179] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:29.058493] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-30T19:25:29.058567] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-30T19:25:29.059086] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-30T19:25:29.059186] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-30T19:25:29.302924] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-30T19:25:29.374300] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-30T19:25:29.462606] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:29.498018] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T19:25:30.097525] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-30T19:25:30.749592] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-30T19:25:30.826087] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-30T19:25:30.897501] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-30T19:25:31.697559] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-30T19:25:31.987998] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T19:25:32.497493] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-30T19:25:32.741290] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T19:25:33.297494] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-30T19:25:33.665829] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T19:25:34.097492] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-30T19:25:34.412889] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-30T19:25:34.897504] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-30T19:25:35.364077] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T19:25:35.697507] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-30T19:25:36.144707] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T19:25:36.497552] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-30T19:25:36.869829] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-30T19:25:37.297501] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-30T19:25:37.607697] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-30T19:25:37.616804] [INFO ] [REMOTE ] ITT: Full fetch complete (47966 records). [2025-10-30T19:25:37.617031] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-30T19:25:38.044370] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-30T19:25:38.044459] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-30T19:25:38.045539] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-30T19:25:38.045613] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-30T19:25:38.046979] [DEBUG] [LOCAL ] ITT: Trimmed 47966 records to 32270 (keeping 200 days of data) [2025-10-30T19:25:38.102327] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-30T19:25:38.246285] [DEBUG] [LOCAL ] ITT: Primary data saved (32270 records). [2025-10-30T19:25:38.246415] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-30T19:25:38.246507] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITT took 32.4s. Estimated remaining: 2h 38m 43s. Rate: 7.8 symbols/min [2025-10-30T19:25:38.412241] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:38.441467] [DEBUG] [LOCAL ] IVT: Loaded 31179 existing records from primary storage. [2025-10-30T19:25:38.441747] [INFO ] [MAIN ] IVT: Loaded 31179 existing records. [2025-10-30T19:25:38.616701] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:38.616896] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-30T19:25:38.616944] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-30T19:25:38.617176] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-30T19:25:38.617216] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-30T19:25:38.900030] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-30T19:25:38.981233] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:39.012826] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-30T19:25:39.389288] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T19:25:39.697565] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-30T19:25:40.454157] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-30T19:25:40.497512] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-30T19:25:40.625098] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-30T19:25:41.297499] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-30T19:25:41.691027] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T19:25:42.097527] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-30T19:25:42.178596] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T19:25:42.897517] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-30T19:25:43.139035] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T19:25:43.697505] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-30T19:25:44.117524] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T19:25:44.479814] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-30T19:25:44.497480] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-30T19:25:45.297514] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-30T19:25:45.421834] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T19:25:46.097483] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-30T19:25:46.485906] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T19:25:46.897464] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-30T19:25:47.364737] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T19:25:47.697497] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-30T19:25:48.113028] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T19:25:48.497528] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-30T19:25:48.577854] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-30T19:25:49.297501] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-30T19:25:49.817492] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-30T19:25:49.828421] [INFO ] [REMOTE ] ITW: Full fetch complete (66998 records). [2025-10-30T19:25:49.828552] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-30T19:25:50.102930] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-30T19:25:50.227002] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-30T19:25:50.227079] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-30T19:25:50.228037] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-30T19:25:50.228100] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-30T19:25:50.229350] [DEBUG] [LOCAL ] ITW: Trimmed 66998 records to 45877 (keeping 200 days of data) [2025-10-30T19:25:50.515213] [DEBUG] [LOCAL ] ITW: Primary data saved (45877 records). [2025-10-30T19:25:50.515327] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-30T19:25:50.516034] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. ITW took 28.8s. Estimated remaining: 2h 38m 40s. Rate: 7.8 symbols/min [2025-10-30T19:25:50.693196] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:50.770740] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T19:25:50.783569] [DEBUG] [LOCAL ] IVZ: Loaded 53126 existing records from primary storage. [2025-10-30T19:25:50.783996] [INFO ] [MAIN ] IVZ: Loaded 53126 existing records. [2025-10-30T19:25:50.902679] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-30T19:25:50.970257] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:50.970437] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-30T19:25:50.970485] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-30T19:25:50.970774] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-30T19:25:50.970834] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-30T19:25:51.329719] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:51.697506] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-30T19:25:51.741920] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T19:25:51.754938] [INFO ] [REMOTE ] ITUB: Full fetch complete (77301 records). [2025-10-30T19:25:51.755340] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-30T19:25:51.882214] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T19:25:52.172917] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-30T19:25:52.173006] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-30T19:25:52.173966] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-30T19:25:52.174029] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-30T19:25:52.175412] [DEBUG] [LOCAL ] ITUB: Trimmed 77301 records to 53683 (keeping 200 days of data) [2025-10-30T19:25:52.478147] [DEBUG] [LOCAL ] ITUB: Primary data saved (53683 records). [2025-10-30T19:25:52.478272] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-30T19:25:52.479043] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. ITUB took 43.5s. Estimated remaining: 2h 38m 26s. Rate: 7.8 symbols/min [2025-10-30T19:25:52.509759] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-30T19:25:52.648179] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:52.669934] [DEBUG] [LOCAL ] IX: Loaded 21480 existing records from primary storage. [2025-10-30T19:25:52.670172] [INFO ] [MAIN ] IX: Loaded 21480 existing records. [2025-10-30T19:25:52.845599] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:52.845820] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-30T19:25:52.845865] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-30T19:25:52.846029] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-30T19:25:52.846065] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-30T19:25:53.199954] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:53.225269] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-30T19:25:53.297455] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-30T19:25:53.775116] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T19:25:54.097525] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-30T19:25:54.548517] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T19:25:54.865798] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T19:25:54.897459] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-30T19:25:55.697488] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-30T19:25:55.797417] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T19:25:56.497505] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-30T19:25:57.295867] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T19:25:57.305482] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-30T19:25:57.307466] [INFO ] [REMOTE ] IVR: Full fetch complete (68964 records). [2025-10-30T19:25:57.307552] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-30T19:25:57.625335] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-30T19:25:57.724890] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-30T19:25:57.725003] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-30T19:25:57.726222] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-30T19:25:57.726302] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-30T19:25:57.728104] [DEBUG] [LOCAL ] IVR: Trimmed 68964 records to 47926 (keeping 200 days of data) [2025-10-30T19:25:57.992855] [DEBUG] [LOCAL ] IVR: Primary data saved (47926 records). [2025-10-30T19:25:57.992977] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-30T19:25:57.993753] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. IVR took 29.3s. Estimated remaining: 2h 38m 16s. Rate: 7.8 symbols/min [2025-10-30T19:25:58.102726] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-30T19:25:58.165640] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:25:58.203296] [DEBUG] [LOCAL ] J: Loaded 40485 existing records from primary storage. [2025-10-30T19:25:58.203620] [INFO ] [MAIN ] J: Loaded 40485 existing records. [2025-10-30T19:25:58.376087] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:25:58.376265] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-30T19:25:58.376335] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-30T19:25:58.376927] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-30T19:25:58.376989] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-30T19:25:58.740095] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:25:58.773188] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-30T19:25:58.897484] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-30T19:25:59.324317] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-30T19:25:59.332487] [INFO ] [REMOTE ] IVT: Full fetch complete (45718 records). [2025-10-30T19:25:59.332694] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-30T19:25:59.704589] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-30T19:25:59.721263] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-30T19:25:59.721363] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-30T19:25:59.722164] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-30T19:25:59.722226] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-30T19:25:59.723218] [DEBUG] [LOCAL ] IVT: Trimmed 45718 records to 31435 (keeping 200 days of data) [2025-10-30T19:25:59.908342] [DEBUG] [LOCAL ] IVT: Primary data saved (31435 records). [2025-10-30T19:25:59.908481] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-30T19:25:59.908558] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. IVT took 21.7s. Estimated remaining: 2h 38m 2s. Rate: 7.8 symbols/min [2025-10-30T19:26:00.077236] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:00.115852] [DEBUG] [LOCAL ] JBGS: Loaded 41217 existing records from primary storage. [2025-10-30T19:26:00.116121] [INFO ] [MAIN ] JBGS: Loaded 41217 existing records. [2025-10-30T19:26:00.299250] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:00.299631] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-30T19:26:00.299845] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-30T19:26:00.300143] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-30T19:26:00.300202] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-30T19:26:00.503487] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-30T19:26:00.619686] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-30T19:26:00.707708] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:01.033283] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T19:26:01.061806] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T19:26:01.297546] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-30T19:26:01.859401] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T19:26:02.097501] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-30T19:26:02.897506] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-30T19:26:03.697675] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-30T19:26:03.700428] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-30T19:26:03.915383] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-30T19:26:04.497501] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-30T19:26:04.535215] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-30T19:26:05.297501] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-30T19:26:05.888235] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-30T19:26:06.097470] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-30T19:26:06.231327] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-30T19:26:06.897486] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-30T19:26:07.164723] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T19:26:07.697539] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-30T19:26:07.798693] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-30T19:26:08.497508] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-30T19:26:08.789621] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T19:26:09.297474] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-30T19:26:09.329802] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T19:26:10.097544] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-30T19:26:10.515277] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T19:26:10.897520] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-30T19:26:11.243556] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T19:26:11.697545] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-30T19:26:12.080324] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T19:26:12.497489] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-30T19:26:12.882074] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-30T19:26:13.297492] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-30T19:26:14.097478] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-30T19:26:14.171355] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-30T19:26:14.397509] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:26:14.737805] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-30T19:26:14.897485] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-30T19:26:15.697544] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-30T19:26:16.114804] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-30T19:26:16.322492] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T19:26:16.497491] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-30T19:26:17.297512] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-30T19:26:17.763737] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T19:26:17.964812] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-30T19:26:18.097553] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-30T19:26:18.897724] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-30T19:26:19.704036] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-30T19:26:19.732574] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T19:26:19.746386] [INFO ] [REMOTE ] IVZ: Full fetch complete (77082 records). [2025-10-30T19:26:19.746896] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-30T19:26:20.194253] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-30T19:26:20.194425] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-30T19:26:20.195831] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-30T19:26:20.195927] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-30T19:26:20.221673] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T19:26:20.220715] [DEBUG] [LOCAL ] IVZ: Trimmed 77082 records to 53516 (keeping 200 days of data) [2025-10-30T19:26:20.521821] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-30T19:26:20.572872] [DEBUG] [LOCAL ] IVZ: Primary data saved (53516 records). [2025-10-30T19:26:20.573097] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-30T19:26:20.574332] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IVZ took 30.1s. Estimated remaining: 2h 38m 8s. Rate: 7.8 symbols/min [2025-10-30T19:26:20.670359] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-30T19:26:20.703488] [INFO ] [REMOTE ] IX: Full fetch complete (29179 records). [2025-10-30T19:26:20.709444] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-30T19:26:20.883088] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:21.153176] [DEBUG] [LOCAL ] JBI: Loaded 41952 existing records from primary storage. [2025-10-30T19:26:21.159382] [INFO ] [MAIN ] JBI: Loaded 41952 existing records. [2025-10-30T19:26:21.303542] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-30T19:26:21.405784] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-30T19:26:21.411347] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-30T19:26:21.422595] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-30T19:26:21.440543] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-30T19:26:21.477997] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:21.478436] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-30T19:26:21.478504] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-30T19:26:21.478616] [DEBUG] [LOCAL ] IX: Trimmed 29179 records to 21627 (keeping 200 days of data) [2025-10-30T19:26:21.478980] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-30T19:26:21.479211] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-30T19:26:21.910681] [DEBUG] [LOCAL ] IX: Primary data saved (21627 records). [2025-10-30T19:26:21.928842] [INFO ] [MAIN ] IX: Full history saved. [2025-10-30T19:26:21.950681] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. IX took 29.5s. Estimated remaining: 2h 37m 54s. Rate: 7.8 symbols/min [2025-10-30T19:26:22.068467] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:22.108228] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-30T19:26:22.262210] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:22.258343] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-30T19:26:22.317717] [DEBUG] [LOCAL ] JBL: Loaded 48129 existing records from primary storage. [2025-10-30T19:26:22.318089] [INFO ] [MAIN ] JBL: Loaded 48129 existing records. [2025-10-30T19:26:22.538083] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:22.538425] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-30T19:26:22.538534] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-30T19:26:22.538913] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-30T19:26:22.538984] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-30T19:26:22.649820] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T19:26:22.905129] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-30T19:26:23.007014] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:23.221348] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T19:26:23.697502] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-30T19:26:23.860087] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T19:26:24.497498] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-30T19:26:24.833929] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:26:25.297521] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-30T19:26:25.560326] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T19:26:25.568435] [INFO ] [REMOTE ] JBGS: Full fetch complete (59193 records). [2025-10-30T19:26:25.568675] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-30T19:26:25.996095] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-30T19:26:25.996198] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-30T19:26:25.997080] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-30T19:26:25.997141] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-30T19:26:25.998286] [DEBUG] [LOCAL ] JBGS: Trimmed 59193 records to 41513 (keeping 200 days of data) [2025-10-30T19:26:26.102680] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-30T19:26:26.250939] [DEBUG] [LOCAL ] JBGS: Primary data saved (41513 records). [2025-10-30T19:26:26.251086] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-30T19:26:26.251222] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. JBGS took 26.3s. Estimated remaining: 2h 37m 42s. Rate: 7.8 symbols/min [2025-10-30T19:26:26.420692] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:26.455242] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T19:26:26.489670] [DEBUG] [LOCAL ] JBND: Loaded 27682 existing records from primary storage. [2025-10-30T19:26:26.489963] [INFO ] [MAIN ] JBND: Loaded 27682 existing records. [2025-10-30T19:26:26.693319] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:26.693559] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-30T19:26:26.693607] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-30T19:26:26.693872] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-30T19:26:26.693941] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-30T19:26:26.910351] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-30T19:26:27.186570] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:27.374142] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:26:27.697520] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-30T19:26:28.284565] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-30T19:26:28.497494] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-30T19:26:28.839965] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T19:26:29.297492] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-30T19:26:29.596282] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:26:30.097495] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-30T19:26:30.581055] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T19:26:30.751879] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-30T19:26:30.897507] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-30T19:26:31.546131] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-30T19:26:31.697568] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-30T19:26:32.497495] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-30T19:26:33.011326] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-30T19:26:33.297490] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-30T19:26:33.413693] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T19:26:34.097505] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-30T19:26:34.584973] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T19:26:34.902599] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-30T19:26:34.914503] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-30T19:26:35.697517] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-30T19:26:35.930063] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T19:26:36.497533] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-30T19:26:36.889755] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T19:26:37.245913] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-30T19:26:37.297545] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-30T19:26:38.097566] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-30T19:26:38.450483] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:26:38.897493] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-30T19:26:39.191950] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T19:26:39.697488] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-30T19:26:40.043076] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:26:40.497481] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-30T19:26:40.711059] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-30T19:26:41.297468] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-30T19:26:41.879583] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-30T19:26:42.097538] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-30T19:26:42.368416] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:26:42.891903] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-30T19:26:42.897873] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-30T19:26:43.697492] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-30T19:26:44.009676] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T19:26:44.497499] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-30T19:26:44.795460] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T19:26:45.297485] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-30T19:26:45.916344] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T19:26:45.926157] [INFO ] [REMOTE ] J: Full fetch complete (60052 records). [2025-10-30T19:26:45.926289] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-30T19:26:46.098065] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-30T19:26:46.325689] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-30T19:26:46.325834] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-30T19:26:46.326884] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-30T19:26:46.326965] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-30T19:26:46.328226] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T19:26:46.334783] [DEBUG] [LOCAL ] J: Trimmed 60052 records to 40817 (keeping 200 days of data) [2025-10-30T19:26:46.579611] [DEBUG] [LOCAL ] J: Primary data saved (40817 records). [2025-10-30T19:26:46.579752] [INFO ] [MAIN ] J: Full history saved. [2025-10-30T19:26:46.579845] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. J took 48.6s. Estimated remaining: 2h 37m 48s. Rate: 7.8 symbols/min [2025-10-30T19:26:46.756572] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:46.756782] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-30T19:26:46.756825] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-30T19:26:46.756932] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-30T19:26:46.756978] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-30T19:26:46.757028] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-30T19:26:46.757066] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-30T19:26:46.898192] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-30T19:26:47.126083] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:47.532790] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T19:26:47.697537] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-30T19:26:47.810154] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-30T19:26:47.832911] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T19:26:47.833235] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-30T19:26:47.833324] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:26:47.833375] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-30T19:26:47.833435] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:26:47.833505] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-30T19:26:47.833588] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-30T19:26:47.833623] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-30T19:26:47.833705] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-30T19:26:47.833763] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBS took 1.3s. Estimated remaining: 2h 37m 34s. Rate: 7.8 symbols/min [2025-10-30T19:26:48.001284] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:48.043910] [DEBUG] [LOCAL ] JBTM: Loaded 33010 existing records from primary storage. [2025-10-30T19:26:48.044205] [INFO ] [MAIN ] JBTM: Loaded 33010 existing records. [2025-10-30T19:26:48.233949] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:48.234191] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-30T19:26:48.234240] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-30T19:26:48.234614] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-30T19:26:48.234709] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-30T19:26:48.506360] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-30T19:26:48.588123] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:49.297487] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-30T19:26:49.366880] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-30T19:26:50.097508] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-30T19:26:50.347571] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T19:26:50.897507] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-30T19:26:51.397298] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T19:26:51.697497] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-30T19:26:52.206453] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T19:26:52.215271] [INFO ] [REMOTE ] JBI: Full fetch complete (63042 records). [2025-10-30T19:26:52.215396] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-30T19:26:52.504451] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-30T19:26:52.604400] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-30T19:26:52.604513] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-30T19:26:52.605588] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-30T19:26:52.605756] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-30T19:26:52.625206] [DEBUG] [LOCAL ] JBI: Trimmed 63042 records to 42232 (keeping 200 days of data) [2025-10-30T19:26:52.626317] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T19:26:52.872870] [DEBUG] [LOCAL ] JBI: Primary data saved (42232 records). [2025-10-30T19:26:52.872990] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-30T19:26:52.873067] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBI took 32.3s. Estimated remaining: 2h 37m 23s. Rate: 7.8 symbols/min [2025-10-30T19:26:53.045096] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:53.054535] [DEBUG] [LOCAL ] JCE: Loaded 7098 existing records from primary storage. [2025-10-30T19:26:53.054778] [INFO ] [MAIN ] JCE: Loaded 7098 existing records. [2025-10-30T19:26:53.233237] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:53.233462] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-30T19:26:53.233538] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-30T19:26:53.233745] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-30T19:26:53.233817] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-30T19:26:53.304432] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-30T19:26:53.606096] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:53.629975] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T19:26:54.097524] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-30T19:26:54.465208] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:26:54.473557] [INFO ] [REMOTE ] JBND: Full fetch complete (36981 records). [2025-10-30T19:26:54.473745] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-30T19:26:54.592082] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T19:26:54.850576] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-30T19:26:54.850676] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-30T19:26:54.851436] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-30T19:26:54.851514] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-30T19:26:54.852402] [DEBUG] [LOCAL ] JBND: Trimmed 36981 records to 27948 (keeping 200 days of data) [2025-10-30T19:26:54.903071] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-30T19:26:55.021225] [DEBUG] [LOCAL ] JBND: Primary data saved (27948 records). [2025-10-30T19:26:55.021345] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-30T19:26:55.021419] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBND took 28.8s. Estimated remaining: 2h 37m 9s. Rate: 7.8 symbols/min [2025-10-30T19:26:55.193564] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:55.241467] [DEBUG] [LOCAL ] JCI: Loaded 53504 existing records from primary storage. [2025-10-30T19:26:55.241777] [INFO ] [MAIN ] JCI: Loaded 53504 existing records. [2025-10-30T19:26:55.420818] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:55.421036] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-30T19:26:55.421083] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-30T19:26:55.421393] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-30T19:26:55.421448] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-30T19:26:55.700885] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-30T19:26:55.781099] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:56.504943] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-30T19:26:56.511684] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-30T19:26:56.523637] [INFO ] [REMOTE ] JBL: Full fetch complete (70496 records). [2025-10-30T19:26:56.523918] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-30T19:26:56.585122] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T19:26:56.944278] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-30T19:26:56.944397] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-30T19:26:56.945700] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-30T19:26:56.945808] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-30T19:26:56.947545] [DEBUG] [LOCAL ] JBL: Trimmed 70496 records to 48440 (keeping 200 days of data) [2025-10-30T19:26:57.246812] [DEBUG] [LOCAL ] JBL: Primary data saved (48440 records). [2025-10-30T19:26:57.246941] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-30T19:26:57.247528] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBL took 35.3s. Estimated remaining: 2h 36m 56s. Rate: 7.8 symbols/min [2025-10-30T19:26:57.303135] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-30T19:26:57.421984] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:26:57.466823] [DEBUG] [LOCAL ] JEF: Loaded 50135 existing records from primary storage. [2025-10-30T19:26:57.467134] [INFO ] [MAIN ] JEF: Loaded 50135 existing records. [2025-10-30T19:26:57.643062] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:26:57.643319] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-30T19:26:57.643397] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-30T19:26:57.643747] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-30T19:26:57.643803] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-30T19:26:57.755072] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T19:26:58.014776] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:26:58.057018] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-30T19:26:58.097508] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-30T19:26:58.897530] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-30T19:26:59.296906] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-30T19:26:59.390710] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T19:26:59.697502] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-30T19:27:00.497510] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-30T19:27:01.297484] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-30T19:27:01.419996] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-30T19:27:01.589277] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T19:27:02.097518] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-30T19:27:02.431815] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T19:27:02.897542] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-30T19:27:03.187113] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T19:27:03.697512] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-30T19:27:04.186897] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T19:27:04.497511] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-30T19:27:05.300435] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-30T19:27:05.309259] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-30T19:27:05.813537] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T19:27:06.097512] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-30T19:27:06.425232] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T19:27:06.897558] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-30T19:27:07.389325] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-30T19:27:07.697491] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-30T19:27:07.764460] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T19:27:08.149825] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T19:27:08.497523] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-30T19:27:09.297522] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-30T19:27:09.718844] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T19:27:10.097512] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-30T19:27:10.658833] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T19:27:10.897498] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-30T19:27:11.448133] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T19:27:11.697486] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-30T19:27:11.877841] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T19:27:12.497540] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-30T19:27:12.848423] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-30T19:27:13.048906] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T19:27:13.297490] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-30T19:27:13.767102] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-30T19:27:14.097534] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-30T19:27:14.897483] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-30T19:27:15.280672] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T19:27:15.697501] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-30T19:27:16.217936] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T19:27:16.497497] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-30T19:27:17.007393] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-30T19:27:17.297477] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-30T19:27:17.742767] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T19:27:18.097556] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-30T19:27:18.821677] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T19:27:18.833232] [INFO ] [REMOTE ] JEF: Full fetch complete (73288 records). [2025-10-30T19:27:18.833344] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-30T19:27:18.902776] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-30T19:27:19.234755] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-30T19:27:19.234913] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-30T19:27:19.235881] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-30T19:27:19.235942] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-30T19:27:19.237265] [DEBUG] [LOCAL ] JEF: Trimmed 73288 records to 50513 (keeping 200 days of data) [2025-10-30T19:27:19.572259] [DEBUG] [LOCAL ] JEF: Primary data saved (50513 records). [2025-10-30T19:27:19.573580] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-30T19:27:19.574666] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JEF took 22.3s. Estimated remaining: 2h 37m 4s. Rate: 7.8 symbols/min [2025-10-30T19:27:19.576571] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-30T19:27:19.698674] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-30T19:27:19.771967] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:27:19.795607] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T19:27:19.841034] [DEBUG] [LOCAL ] JELD: Loaded 45472 existing records from primary storage. [2025-10-30T19:27:19.841362] [INFO ] [MAIN ] JELD: Loaded 45472 existing records. [2025-10-30T19:27:20.019026] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:27:20.019256] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-30T19:27:20.019305] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-30T19:27:20.019677] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-30T19:27:20.019737] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-30T19:27:20.383933] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:27:20.497481] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-30T19:27:21.086925] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:27:21.297474] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-30T19:27:21.414422] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T19:27:22.097467] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-30T19:27:22.290136] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-30T19:27:22.668192] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-30T19:27:22.897489] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-30T19:27:23.305779] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-30T19:27:23.697522] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-30T19:27:24.497517] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-30T19:27:25.038027] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-30T19:27:25.275510] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-30T19:27:25.288037] [INFO ] [REMOTE ] JCI: Full fetch complete (77652 records). [2025-10-30T19:27:25.288284] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-30T19:27:25.302670] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-30T19:27:25.696516] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-30T19:27:25.696604] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-30T19:27:25.697744] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-30T19:27:25.697808] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-30T19:27:25.699360] [DEBUG] [LOCAL ] JCI: Trimmed 77652 records to 53894 (keeping 200 days of data) [2025-10-30T19:27:26.039188] [DEBUG] [LOCAL ] JCI: Primary data saved (53894 records). [2025-10-30T19:27:26.039363] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-30T19:27:26.039457] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCI took 31.0s. Estimated remaining: 2h 36m 55s. Rate: 7.8 symbols/min [2025-10-30T19:27:26.105340] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-30T19:27:26.216101] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:27:26.244827] [DEBUG] [LOCAL ] JFR: Loaded 30688 existing records from primary storage. [2025-10-30T19:27:26.245077] [INFO ] [MAIN ] JFR: Loaded 30688 existing records. [2025-10-30T19:27:26.423570] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:27:26.423923] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-30T19:27:26.423994] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-30T19:27:26.424203] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-30T19:27:26.424305] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-30T19:27:26.633527] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T19:27:26.837788] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:27:26.838335] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-30T19:27:26.841408] [INFO ] [REMOTE ] JCE: Full fetch complete (9604 records). [2025-10-30T19:27:26.841487] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-30T19:27:26.902662] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-30T19:27:27.200358] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-30T19:27:27.200438] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-30T19:27:27.200704] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-30T19:27:27.200766] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-30T19:27:27.201247] [DEBUG] [LOCAL ] JCE: Trimmed 9604 records to 7127 (keeping 200 days of data) [2025-10-30T19:27:27.244820] [DEBUG] [LOCAL ] JCE: Primary data saved (7127 records). [2025-10-30T19:27:27.244957] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-30T19:27:27.245091] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JCE took 34.4s. Estimated remaining: 2h 36m 40s. Rate: 7.8 symbols/min [2025-10-30T19:27:27.420755] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:27:27.433770] [DEBUG] [LOCAL ] JGH: Loaded 12292 existing records from primary storage. [2025-10-30T19:27:27.433998] [INFO ] [MAIN ] JGH: Loaded 12292 existing records. [2025-10-30T19:27:27.617879] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:27:27.618073] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-30T19:27:27.618121] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-30T19:27:27.618315] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-30T19:27:27.618372] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-30T19:27:27.702730] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-30T19:27:27.973031] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:27:28.171483] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T19:27:28.179680] [INFO ] [REMOTE ] JBTM: Full fetch complete (46942 records). [2025-10-30T19:27:28.179788] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-30T19:27:28.502745] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-30T19:27:28.552194] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-30T19:27:28.552340] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-30T19:27:28.553156] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-30T19:27:28.553218] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-30T19:27:28.554242] [DEBUG] [LOCAL ] JBTM: Trimmed 46942 records to 33249 (keeping 200 days of data) [2025-10-30T19:27:28.771095] [DEBUG] [LOCAL ] JBTM: Primary data saved (33249 records). [2025-10-30T19:27:28.783089] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-30T19:27:28.785771] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JBTM took 41.0s. Estimated remaining: 2h 36m 26s. Rate: 7.8 symbols/min [2025-10-30T19:27:28.830511] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T19:27:28.967454] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:27:29.011917] [DEBUG] [LOCAL ] JHG: Loaded 47439 existing records from primary storage. [2025-10-30T19:27:29.017569] [INFO ] [MAIN ] JHG: Loaded 47439 existing records. [2025-10-30T19:27:29.061400] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T19:27:29.195566] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:27:29.195762] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-30T19:27:29.195836] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-30T19:27:29.196247] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-30T19:27:29.196306] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-30T19:27:29.302597] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-30T19:27:29.556234] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:27:30.097505] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-30T19:27:30.310710] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-30T19:27:30.897497] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-30T19:27:31.187393] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T19:27:31.697502] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-30T19:27:31.835446] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T19:27:32.497493] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-30T19:27:32.926463] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T19:27:33.004155] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T19:27:33.297495] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-30T19:27:34.097498] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-30T19:27:34.373229] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T19:27:34.626297] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T19:27:34.897502] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-30T19:27:35.449434] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-30T19:27:35.697528] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-30T19:27:36.497477] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-30T19:27:36.673344] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T19:27:37.297496] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-30T19:27:37.685769] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T19:27:38.097471] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-30T19:27:38.166835] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T19:27:38.897486] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-30T19:27:39.145344] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T19:27:39.697491] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-30T19:27:40.090752] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T19:27:40.497462] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-30T19:27:40.529476] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-30T19:27:41.297492] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-30T19:27:41.521501] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T19:27:42.097495] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-30T19:27:42.597355] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T19:27:42.897496] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-30T19:27:43.384264] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T19:27:43.692763] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-30T19:27:43.699146] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-30T19:27:44.497488] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-30T19:27:44.898911] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-30T19:27:45.297570] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-30T19:27:45.715557] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T19:27:46.097555] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-30T19:27:46.431521] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T19:27:46.441268] [INFO ] [REMOTE ] JELD: Full fetch complete (64457 records). [2025-10-30T19:27:46.441418] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-30T19:27:46.842629] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-30T19:27:46.842777] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-30T19:27:46.843948] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-30T19:27:46.844027] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-30T19:27:46.845316] [DEBUG] [LOCAL ] JELD: Trimmed 64457 records to 45741 (keeping 200 days of data) [2025-10-30T19:27:46.898774] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-30T19:27:46.957980] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-30T19:27:47.122420] [DEBUG] [LOCAL ] JELD: Primary data saved (45741 records). [2025-10-30T19:27:47.122542] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-30T19:27:47.123048] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JELD took 27.5s. Estimated remaining: 2h 36m 29s. Rate: 7.8 symbols/min [2025-10-30T19:27:47.292024] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:27:47.299057] [DEBUG] [LOCAL ] JHI: Loaded 4059 existing records from primary storage. [2025-10-30T19:27:47.299258] [INFO ] [MAIN ] JHI: Loaded 4059 existing records. [2025-10-30T19:27:47.481692] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:27:47.482002] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-30T19:27:47.482196] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-30T19:27:47.489930] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-30T19:27:47.489877] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-30T19:27:47.492593] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-30T19:27:47.702562] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-30T19:27:47.849368] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:27:48.497487] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-30T19:27:48.805384] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:27:49.048129] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T19:27:49.297493] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-30T19:27:49.672694] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T19:27:50.097496] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-30T19:27:50.419337] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-30T19:27:50.897512] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-30T19:27:51.327090] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T19:27:51.697515] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-30T19:27:52.206882] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-30T19:27:52.497519] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-30T19:27:53.084338] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-30T19:27:53.297535] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-30T19:27:54.097499] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-30T19:27:54.410074] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T19:27:54.663242] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-30T19:27:54.897491] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-30T19:27:55.697511] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-30T19:27:56.017127] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-30T19:27:56.051376] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T19:27:56.497479] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-30T19:27:57.297553] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-30T19:27:57.613862] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T19:27:58.097475] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-30T19:27:58.170264] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T19:27:58.897506] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-30T19:27:59.234846] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-30T19:27:59.395425] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T19:27:59.405954] [INFO ] [REMOTE ] JHG: Full fetch complete (68862 records). [2025-10-30T19:27:59.406069] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-30T19:27:59.705488] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-30T19:27:59.803987] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-30T19:27:59.804059] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-30T19:27:59.804953] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-30T19:27:59.805014] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-30T19:27:59.806274] [DEBUG] [LOCAL ] JHG: Trimmed 68862 records to 47816 (keeping 200 days of data) [2025-10-30T19:28:00.081660] [DEBUG] [LOCAL ] JHG: Primary data saved (47816 records). [2025-10-30T19:28:00.081788] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-30T19:28:00.082505] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JHG took 31.3s. Estimated remaining: 2h 36m 27s. Rate: 7.8 symbols/min [2025-10-30T19:28:00.254621] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:28:00.259391] [DEBUG] [LOCAL ] JHS: Loaded 2949 existing records from primary storage. [2025-10-30T19:28:00.259555] [INFO ] [MAIN ] JHS: Loaded 2949 existing records. [2025-10-30T19:28:00.443184] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:28:00.443411] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-30T19:28:00.443460] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-30T19:28:00.443602] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-30T19:28:00.443667] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-30T19:28:00.502620] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-30T19:28:00.802264] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:28:01.017439] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T19:28:01.022263] [INFO ] [REMOTE ] JGH: Full fetch complete (16514 records). [2025-10-30T19:28:01.022344] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-30T19:28:01.298223] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-30T19:28:01.286383] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T19:28:01.406142] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-30T19:28:01.406227] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-30T19:28:01.406694] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-30T19:28:01.406756] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-30T19:28:01.407300] [DEBUG] [LOCAL ] JGH: Trimmed 16514 records to 12346 (keeping 200 days of data) [2025-10-30T19:28:01.485148] [DEBUG] [LOCAL ] JGH: Primary data saved (12346 records). [2025-10-30T19:28:01.485294] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-30T19:28:01.485378] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JGH took 34.2s. Estimated remaining: 2h 36m 13s. Rate: 7.8 symbols/min [2025-10-30T19:28:01.656433] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:28:01.704281] [DEBUG] [LOCAL ] JHX: Loaded 53185 existing records from primary storage. [2025-10-30T19:28:01.704589] [INFO ] [MAIN ] JHX: Loaded 53185 existing records. [2025-10-30T19:28:01.883834] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:28:01.884029] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-30T19:28:01.884076] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-30T19:28:01.884537] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-30T19:28:01.884576] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-30T19:28:01.998315] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-30T19:28:02.102694] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-30T19:28:02.254039] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:28:02.897512] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-30T19:28:03.112317] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-30T19:28:03.505479] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-30T19:28:03.697525] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-30T19:28:04.497537] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-30T19:28:04.840969] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-30T19:28:04.971781] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T19:28:04.980258] [INFO ] [REMOTE ] JFR: Full fetch complete (48447 records). [2025-10-30T19:28:04.980411] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-30T19:28:05.302626] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-30T19:28:05.373212] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-30T19:28:05.373320] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-30T19:28:05.374085] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-30T19:28:05.374148] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-30T19:28:05.375246] [DEBUG] [LOCAL ] JFR: Trimmed 48447 records to 30957 (keeping 200 days of data) [2025-10-30T19:28:05.553201] [DEBUG] [LOCAL ] JFR: Primary data saved (30957 records). [2025-10-30T19:28:05.553329] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-30T19:28:05.553404] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JFR took 39.5s. Estimated remaining: 2h 36m 1s. Rate: 7.8 symbols/min [2025-10-30T19:28:05.746576] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:28:05.764513] [DEBUG] [LOCAL ] JILL: Loaded 14935 existing records from primary storage. [2025-10-30T19:28:05.764780] [INFO ] [MAIN ] JILL: Loaded 14935 existing records. [2025-10-30T19:28:05.945194] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:28:05.945515] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-30T19:28:05.945578] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-30T19:28:05.945892] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-30T19:28:05.945950] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-30T19:28:06.099738] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-30T19:28:06.107475] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T19:28:06.323226] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:28:06.529510] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-30T19:28:06.897509] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-30T19:28:07.423069] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T19:28:07.697509] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-30T19:28:08.230769] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-30T19:28:08.497478] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-30T19:28:09.221266] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T19:28:09.297459] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-30T19:28:09.946277] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-30T19:28:10.097490] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-30T19:28:10.723347] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-30T19:28:10.897495] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-30T19:28:11.654537] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-30T19:28:11.697479] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-30T19:28:12.234786] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-30T19:28:12.497509] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-30T19:28:13.297466] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-30T19:28:13.356260] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T19:28:13.841949] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T19:28:14.097491] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-30T19:28:14.723619] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T19:28:14.897489] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-30T19:28:15.697484] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-30T19:28:16.101554] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T19:28:16.131344] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T19:28:16.497473] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-30T19:28:17.297461] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-30T19:28:17.367665] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-30T19:28:17.370604] [INFO ] [REMOTE ] JILL: Full fetch complete (22121 records). [2025-10-30T19:28:17.370700] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-30T19:28:17.731426] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-30T19:28:17.731503] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-30T19:28:17.731994] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-30T19:28:17.732056] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-30T19:28:17.732608] [DEBUG] [LOCAL ] JILL: Trimmed 22121 records to 14990 (keeping 200 days of data) [2025-10-30T19:28:17.821279] [DEBUG] [LOCAL ] JILL: Primary data saved (14990 records). [2025-10-30T19:28:17.821401] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-30T19:28:17.821478] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JILL took 12.3s. Estimated remaining: 2h 35m 58s. Rate: 7.8 symbols/min [2025-10-30T19:28:17.945688] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T19:28:17.970866] [INFO ] [REMOTE ] JHI: Full fetch complete (5813 records). [2025-10-30T19:28:17.983794] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-30T19:28:18.002101] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:28:18.102568] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-30T19:28:18.326040] [DEBUG] [LOCAL ] JKS: Loaded 38685 existing records from primary storage. [2025-10-30T19:28:18.341812] [INFO ] [MAIN ] JKS: Loaded 38685 existing records. [2025-10-30T19:28:18.496238] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-30T19:28:18.496394] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-30T19:28:18.496966] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-30T19:28:18.502537] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-30T19:28:18.535502] [DEBUG] [LOCAL ] JHI: Trimmed 5813 records to 4077 (keeping 200 days of data) [2025-10-30T19:28:18.597776] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:28:18.601140] [DEBUG] [LOCAL ] JHI: Primary data saved (4077 records). [2025-10-30T19:28:18.601430] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-30T19:28:18.601521] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-30T19:28:18.601605] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-30T19:28:18.601790] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JHI took 31.5s. Estimated remaining: 2h 35m 43s. Rate: 7.8 symbols/min [2025-10-30T19:28:18.601936] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-30T19:28:18.633574] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-30T19:28:18.924452] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:28:18.901959] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-30T19:28:19.155865] [DEBUG] [LOCAL ] JLL: Loaded 30857 existing records from primary storage. [2025-10-30T19:28:19.155203] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:28:19.156322] [INFO ] [MAIN ] JLL: Loaded 30857 existing records. [2025-10-30T19:28:19.333593] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:28:19.334251] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-30T19:28:19.334456] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-30T19:28:19.334865] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-30T19:28:19.334921] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-30T19:28:19.424074] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T19:28:19.701888] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-30T19:28:19.731809] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:28:19.734845] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-30T19:28:20.087581] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-30T19:28:20.497459] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-30T19:28:21.297481] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-30T19:28:21.703353] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T19:28:22.097469] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-30T19:28:22.149967] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T19:28:22.449250] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-30T19:28:22.897548] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-30T19:28:23.697577] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-30T19:28:23.736079] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T19:28:24.497513] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-30T19:28:24.791480] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-30T19:28:24.793460] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T19:28:25.297488] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-30T19:28:25.639702] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-30T19:28:26.097498] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-30T19:28:26.452775] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-30T19:28:26.897507] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-30T19:28:27.196395] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T19:28:27.697523] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-30T19:28:28.497505] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-30T19:28:29.081918] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T19:28:29.297495] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-30T19:28:29.491848] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-30T19:28:29.653255] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T19:28:30.097514] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-30T19:28:30.897511] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-30T19:28:31.142615] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T19:28:31.346292] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-30T19:28:31.347961] [INFO ] [REMOTE ] JHS: Full fetch complete (4603 records). [2025-10-30T19:28:31.348032] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-30T19:28:31.710831] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-30T19:28:31.766697] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-30T19:28:31.766820] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-30T19:28:31.767071] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-30T19:28:31.767119] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-30T19:28:31.767469] [DEBUG] [LOCAL ] JHS: Trimmed 4603 records to 2990 (keeping 200 days of data) [2025-10-30T19:28:31.785938] [DEBUG] [LOCAL ] JHS: Primary data saved (2990 records). [2025-10-30T19:28:31.786034] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-30T19:28:31.786113] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JHS took 31.7s. Estimated remaining: 2h 35m 41s. Rate: 7.8 symbols/min [2025-10-30T19:28:31.953658] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:28:31.960257] [DEBUG] [LOCAL ] JLS: Loaded 3884 existing records from primary storage. [2025-10-30T19:28:31.960478] [INFO ] [MAIN ] JLS: Loaded 3884 existing records. [2025-10-30T19:28:32.132633] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:28:32.132860] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-30T19:28:32.132909] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-30T19:28:32.133075] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-30T19:28:32.133131] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-30T19:28:32.487811] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:28:32.497464] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-30T19:28:32.849348] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T19:28:32.865718] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-30T19:28:33.297545] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-30T19:28:34.097535] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-30T19:28:34.503294] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T19:28:34.897550] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-30T19:28:35.240997] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T19:28:35.377192] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-30T19:28:35.697531] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-30T19:28:36.045340] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-30T19:28:36.497515] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-30T19:28:37.297505] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-30T19:28:37.521218] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T19:28:38.097520] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-30T19:28:38.854845] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-30T19:28:38.866637] [INFO ] [REMOTE ] JHX: Full fetch complete (64150 records). [2025-10-30T19:28:38.866828] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-30T19:28:38.899704] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-30T19:28:39.261900] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-30T19:28:39.262043] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-30T19:28:39.263048] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-30T19:28:39.263130] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-30T19:28:39.287959] [DEBUG] [LOCAL ] JHX: Trimmed 64150 records to 53572 (keeping 200 days of data) [2025-10-30T19:28:39.287830] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T19:28:39.607799] [DEBUG] [LOCAL ] JHX: Primary data saved (53572 records). [2025-10-30T19:28:39.607933] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-30T19:28:39.608961] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JHX took 38.1s. Estimated remaining: 2h 35m 34s. Rate: 7.8 symbols/min [2025-10-30T19:28:39.705151] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-30T19:28:39.778410] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:28:39.832234] [DEBUG] [LOCAL ] JMIA: Loaded 51201 existing records from primary storage. [2025-10-30T19:28:39.832551] [INFO ] [MAIN ] JMIA: Loaded 51201 existing records. [2025-10-30T19:28:40.010812] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:28:40.011138] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-30T19:28:40.011205] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-30T19:28:40.011623] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-30T19:28:40.011766] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-30T19:28:40.131016] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T19:28:40.389437] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:28:40.497484] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-30T19:28:40.755444] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-30T19:28:41.297494] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-30T19:28:41.702997] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T19:28:41.719636] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-30T19:28:42.097473] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-30T19:28:42.897505] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-30T19:28:43.044478] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T19:28:43.697496] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-30T19:28:44.096047] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T19:28:44.497488] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-30T19:28:44.692703] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T19:28:45.297506] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-30T19:28:45.717505] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T19:28:46.097512] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-30T19:28:46.589725] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T19:28:46.599174] [INFO ] [REMOTE ] JKS: Full fetch complete (58448 records). [2025-10-30T19:28:46.599332] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-30T19:28:46.901740] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-30T19:28:47.023475] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-30T19:28:47.023577] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-30T19:28:47.024504] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-30T19:28:47.024679] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-30T19:28:47.025871] [DEBUG] [LOCAL ] JKS: Trimmed 58448 records to 38990 (keeping 200 days of data) [2025-10-30T19:28:47.156956] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-30T19:28:47.278500] [DEBUG] [LOCAL ] JKS: Primary data saved (38990 records). [2025-10-30T19:28:47.278625] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-30T19:28:47.278746] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JKS took 29.5s. Estimated remaining: 2h 35m 26s. Rate: 7.8 symbols/min [2025-10-30T19:28:47.377941] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T19:28:47.697506] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-30T19:28:48.497471] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-30T19:28:48.613361] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T19:28:49.297499] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-30T19:28:49.653765] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-30T19:28:49.753745] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T19:28:50.097492] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-30T19:28:50.897498] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-30T19:28:51.177917] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-30T19:28:51.401075] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T19:28:51.697501] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-30T19:28:52.497481] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-30T19:28:52.564911] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T19:28:52.853197] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-30T19:28:53.297478] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-30T19:28:54.097482] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-30T19:28:54.198447] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-30T19:28:54.457792] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-30T19:28:54.897489] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-30T19:28:55.321471] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-30T19:28:55.322838] [INFO ] [REMOTE ] JLS: Full fetch complete (5744 records). [2025-10-30T19:28:55.322904] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-30T19:28:55.690682] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-30T19:28:55.690771] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-30T19:28:55.690943] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-30T19:28:55.690983] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-30T19:28:55.691495] [DEBUG] [LOCAL ] JLS: Trimmed 5744 records to 3891 (keeping 200 days of data) [2025-10-30T19:28:55.704497] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-30T19:28:55.722312] [DEBUG] [LOCAL ] JLS: Primary data saved (3891 records). [2025-10-30T19:28:55.722430] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-30T19:28:55.722513] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JLS took 23.9s. Estimated remaining: 2h 35m 19s. Rate: 7.8 symbols/min [2025-10-30T19:28:56.497538] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-30T19:28:56.921899] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T19:28:57.297477] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-30T19:28:57.328726] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-30T19:28:58.097512] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-30T19:28:58.668386] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-30T19:28:58.897493] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-30T19:28:58.965351] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T19:28:59.697495] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-30T19:29:00.317482] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T19:29:00.497457] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-30T19:29:00.922783] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T19:29:00.928738] [INFO ] [REMOTE ] JLL: Full fetch complete (44923 records). [2025-10-30T19:29:00.928827] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-30T19:29:01.304014] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-30T19:29:01.304089] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-30T19:29:01.304828] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-30T19:29:01.304898] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-30T19:29:01.305837] [DEBUG] [LOCAL ] JLL: Trimmed 44923 records to 30997 (keeping 200 days of data) [2025-10-30T19:29:01.486143] [DEBUG] [LOCAL ] JLL: Primary data saved (30997 records). [2025-10-30T19:29:01.486263] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-30T19:29:01.486336] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JLL took 42.9s. Estimated remaining: 2h 35m 9s. Rate: 7.8 symbols/min [2025-10-30T19:29:02.239478] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-30T19:29:02.250978] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-30T19:29:04.031215] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T19:29:04.042826] [INFO ] [REMOTE ] JMIA: Full fetch complete (73520 records). [2025-10-30T19:29:04.042966] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-30T19:29:04.439472] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-30T19:29:04.439548] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-30T19:29:04.440527] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-30T19:29:04.440589] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-30T19:29:04.441944] [DEBUG] [LOCAL ] JMIA: Trimmed 73520 records to 51567 (keeping 200 days of data) [2025-10-30T19:29:04.734602] [DEBUG] [LOCAL ] JMIA: Primary data saved (51567 records). [2025-10-30T19:29:04.734756] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-30T19:29:04.735851] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JMIA took 25.1s. Estimated remaining: 2h 34m 57s. Rate: 7.8 symbols/min [2025-10-30T19:29:05.377336] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:05.392477] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:05.430295] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-30T19:29:05.432821] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:05.432952] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-30T19:29:05.452203] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-30T19:29:05.452310] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-30T19:29:05.451843] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:05.452490] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-30T19:29:05.452585] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-30T19:29:05.601355] [DEBUG] [LOCAL ] JOE: Loaded 23055 existing records from primary storage. [2025-10-30T19:29:05.649933] [INFO ] [MAIN ] JOE: Loaded 23055 existing records. [2025-10-30T19:29:05.961536] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-30T19:29:05.955084] [DEBUG] [LOCAL ] JOBY: Loaded 53810 existing records from primary storage. [2025-10-30T19:29:06.022128] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-30T19:29:06.021944] [INFO ] [MAIN ] JOBY: Loaded 53810 existing records. [2025-10-30T19:29:06.106261] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:06.178532] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-30T19:29:06.216574] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:06.253779] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-30T19:29:06.281569] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-30T19:29:06.292193] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-30T19:29:06.322617] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-30T19:29:06.575853] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:06.592729] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-30T19:29:06.592829] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-30T19:29:06.607472] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-30T19:29:06.607972] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-30T19:29:06.611186] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:06.622204] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-30T19:29:06.643840] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-30T19:29:06.674371] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-30T19:29:06.669130] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T19:29:06.688199] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-30T19:29:06.694216] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-30T19:29:07.309180] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T19:29:07.394446] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-30T19:29:07.407630] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:07.474379] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-30T19:29:07.644386] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:07.673417] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-30T19:29:07.673134] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:07.674523] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-30T19:29:07.726024] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T19:29:07.727002] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-30T19:29:08.048687] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-30T19:29:08.049749] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-30T19:29:08.387140] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T19:29:08.414353] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-30T19:29:08.497508] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-30T19:29:09.297477] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-30T19:29:09.331193] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-30T19:29:09.389487] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-30T19:29:09.482869] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-30T19:29:09.607211] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-30T19:29:10.097523] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-30T19:29:10.897507] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-30T19:29:11.207961] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-30T19:29:11.673284] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-30T19:29:11.697472] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-30T19:29:12.497506] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-30T19:29:13.297504] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-30T19:29:13.374631] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-30T19:29:14.097506] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-30T19:29:14.125426] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T19:29:14.393554] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-30T19:29:14.493089] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-30T19:29:14.897546] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-30T19:29:15.697568] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-30T19:29:15.733776] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-30T19:29:15.999610] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-30T19:29:16.497503] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-30T19:29:16.891896] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-30T19:29:16.892748] [INFO ] [REMOTE ] JMM: Full fetch complete (2328 records). [2025-10-30T19:29:16.892816] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-30T19:29:17.072483] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-30T19:29:17.072713] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:29:17.072782] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:29:17.072851] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-30T19:29:17.072918] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-30T19:29:17.072955] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-30T19:29:17.072995] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-30T19:29:17.073049] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JMM took 12.3s. Estimated remaining: 2h 34m 54s. Rate: 7.8 symbols/min [2025-10-30T19:29:17.242584] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:17.250803] [DEBUG] [LOCAL ] JOF: Loaded 6892 existing records from primary storage. [2025-10-30T19:29:17.251093] [INFO ] [MAIN ] JOF: Loaded 6892 existing records. [2025-10-30T19:29:17.304441] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-30T19:29:17.430139] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:17.430346] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-30T19:29:17.430392] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-30T19:29:17.430563] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-30T19:29:17.430617] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-30T19:29:17.783306] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:18.097488] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-30T19:29:18.302963] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T19:29:18.897535] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-30T19:29:19.697505] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-30T19:29:19.742343] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T19:29:19.998806] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-30T19:29:20.076742] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-30T19:29:20.497539] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-30T19:29:21.297535] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-30T19:29:22.097538] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-30T19:29:22.326131] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-30T19:29:22.464776] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-30T19:29:22.897499] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-30T19:29:22.996839] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-30T19:29:23.417391] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T19:29:23.697488] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-30T19:29:24.171701] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T19:29:24.497487] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-30T19:29:24.967929] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T19:29:25.297504] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-30T19:29:25.714327] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-30T19:29:26.097500] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-30T19:29:26.871469] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T19:29:26.897450] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-30T19:29:27.594900] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-30T19:29:27.697483] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-30T19:29:28.497543] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-30T19:29:28.902735] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T19:29:29.297502] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-30T19:29:29.415726] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-30T19:29:30.054803] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-30T19:29:30.097487] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-30T19:29:30.897488] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-30T19:29:30.971376] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-30T19:29:30.977155] [INFO ] [REMOTE ] JOE: Full fetch complete (35081 records). [2025-10-30T19:29:30.977302] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-30T19:29:31.388072] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-30T19:29:31.388184] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-30T19:29:31.389076] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-30T19:29:31.389142] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-30T19:29:31.390334] [DEBUG] [LOCAL ] JOE: Trimmed 35081 records to 23343 (keeping 200 days of data) [2025-10-30T19:29:31.538942] [DEBUG] [LOCAL ] JOE: Primary data saved (23343 records). [2025-10-30T19:29:31.539073] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-30T19:29:31.539153] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JOE took 26.8s. Estimated remaining: 2h 34m 53s. Rate: 7.8 symbols/min [2025-10-30T19:29:31.711220] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:31.706133] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-30T19:29:31.753434] [DEBUG] [LOCAL ] JPC: Loaded 36593 existing records from primary storage. [2025-10-30T19:29:31.753870] [INFO ] [MAIN ] JPC: Loaded 36593 existing records. [2025-10-30T19:29:31.935047] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:31.935344] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-30T19:29:31.935395] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-30T19:29:31.935612] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-30T19:29:31.935688] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-30T19:29:32.323412] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:32.331494] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-30T19:29:32.429916] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-30T19:29:32.497473] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-30T19:29:33.297499] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-30T19:29:34.097472] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-30T19:29:34.242094] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-30T19:29:34.582011] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T19:29:34.897524] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-30T19:29:35.184384] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-30T19:29:35.550109] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T19:29:35.553365] [INFO ] [REMOTE ] JOF: Full fetch complete (9669 records). [2025-10-30T19:29:35.553477] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-30T19:29:35.704703] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-30T19:29:35.932375] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-30T19:29:35.932455] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-30T19:29:35.932726] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-30T19:29:35.932820] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-30T19:29:35.933238] [DEBUG] [LOCAL ] JOF: Trimmed 9669 records to 6959 (keeping 200 days of data) [2025-10-30T19:29:35.974174] [DEBUG] [LOCAL ] JOF: Primary data saved (6959 records). [2025-10-30T19:29:35.974298] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-30T19:29:35.974374] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JOF took 18.9s. Estimated remaining: 2h 34m 42s. Rate: 7.8 symbols/min [2025-10-30T19:29:36.140957] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:36.188569] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-30T19:29:36.188932] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-30T19:29:36.363724] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:36.363913] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-30T19:29:36.363959] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-30T19:29:36.364743] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-30T19:29:36.364800] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-30T19:29:36.502707] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-30T19:29:36.729626] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:36.779712] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T19:29:37.297503] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-30T19:29:38.097516] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-30T19:29:38.440128] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-30T19:29:38.897520] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-30T19:29:39.011082] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T19:29:39.244168] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-30T19:29:39.697488] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-30T19:29:40.497512] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-30T19:29:40.905417] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-30T19:29:41.297495] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-30T19:29:41.562168] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-30T19:29:41.600886] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T19:29:42.097537] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-30T19:29:42.897523] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-30T19:29:43.277702] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T19:29:43.346238] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-30T19:29:43.697509] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-30T19:29:44.497479] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-30T19:29:44.588852] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-30T19:29:45.297496] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-30T19:29:45.769892] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-30T19:29:46.097469] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-30T19:29:46.536200] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-30T19:29:46.903077] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-30T19:29:46.908599] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-30T19:29:47.090994] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-30T19:29:47.697509] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-30T19:29:48.497464] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-30T19:29:48.635956] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T19:29:49.103607] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-30T19:29:49.116001] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-30T19:29:49.116131] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-30T19:29:49.304309] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-30T19:29:49.525736] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-30T19:29:49.525858] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-30T19:29:49.526948] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-30T19:29:49.527037] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-30T19:29:49.564274] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54143 (keeping 200 days of data) [2025-10-30T19:29:49.566018] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-30T19:29:49.579864] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-30T19:29:49.580084] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-30T19:29:50.098589] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-30T19:29:50.322161] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-30T19:29:50.325193] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-30T19:29:50.336512] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-30T19:29:50.336598] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-30T19:29:50.351957] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-30T19:29:50.352306] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-30T19:29:50.352497] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JNJ took 45.6s. Estimated remaining: 2h 34m 41s. Rate: 7.8 symbols/min [2025-10-30T19:29:50.389219] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54200 (keeping 200 days of data) [2025-10-30T19:29:50.641551] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:50.752375] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-30T19:29:50.860779] [DEBUG] [LOCAL ] JQC: Loaded 33356 existing records from primary storage. [2025-10-30T19:29:50.879950] [INFO ] [MAIN ] JQC: Loaded 33356 existing records. [2025-10-30T19:29:50.902971] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-30T19:29:51.095222] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:51.096933] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-30T19:29:51.100496] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-30T19:29:51.100597] [DEBUG] [LOCAL ] JOBY: Primary data saved (54200 records). [2025-10-30T19:29:51.100798] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-30T19:29:51.100989] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JOBY took 46.4s. Estimated remaining: 2h 34m 26s. Rate: 7.8 symbols/min [2025-10-30T19:29:51.101172] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-30T19:29:51.124769] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-30T19:29:51.479249] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:51.678016] [DEBUG] [LOCAL ] JRI: Loaded 15034 existing records from primary storage. [2025-10-30T19:29:51.705950] [INFO ] [MAIN ] JRI: Loaded 15034 existing records. [2025-10-30T19:29:51.705753] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:51.711603] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-30T19:29:51.907420] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:51.908204] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-30T19:29:51.908455] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-30T19:29:51.908885] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-30T19:29:51.909110] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-30T19:29:52.244380] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-30T19:29:52.358169] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:29:52.400116] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-30T19:29:52.497511] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-30T19:29:52.677163] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T19:29:53.134162] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-30T19:29:53.297533] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-30T19:29:54.097566] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-30T19:29:54.897497] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-30T19:29:54.954085] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-30T19:29:55.093836] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T19:29:55.420291] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T19:29:55.697497] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-30T19:29:56.504763] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-30T19:29:56.507094] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T19:29:57.297530] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-30T19:29:58.097521] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-30T19:29:58.401188] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-30T19:29:58.439087] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-30T19:29:58.447801] [INFO ] [REMOTE ] JPC: Full fetch complete (54813 records). [2025-10-30T19:29:58.447940] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-30T19:29:58.819514] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-30T19:29:58.865040] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-30T19:29:58.865123] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-30T19:29:58.865979] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-30T19:29:58.866041] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-30T19:29:58.867184] [DEBUG] [LOCAL ] JPC: Trimmed 54813 records to 36844 (keeping 200 days of data) [2025-10-30T19:29:58.913471] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-30T19:29:59.080726] [DEBUG] [LOCAL ] JPC: Primary data saved (36844 records). [2025-10-30T19:29:59.080895] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-30T19:29:59.082101] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JPC took 27.5s. Estimated remaining: 2h 34m 19s. Rate: 7.8 symbols/min [2025-10-30T19:29:59.247729] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:29:59.260371] [DEBUG] [LOCAL ] JRS: Loaded 11429 existing records from primary storage. [2025-10-30T19:29:59.260689] [INFO ] [MAIN ] JRS: Loaded 11429 existing records. [2025-10-30T19:29:59.435952] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:29:59.436209] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-30T19:29:59.436258] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-30T19:29:59.436468] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-30T19:29:59.436545] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-30T19:29:59.623372] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-30T19:29:59.700166] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-30T19:29:59.819273] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:00.497491] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-30T19:30:00.738790] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T19:30:01.055878] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T19:30:01.297552] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-30T19:30:01.921317] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-30T19:30:02.097595] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-30T19:30:02.897523] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-30T19:30:03.535734] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T19:30:03.697581] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-30T19:30:03.975555] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-30T19:30:04.497485] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-30T19:30:04.790507] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T19:30:05.097474] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-30T19:30:05.297495] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-30T19:30:06.097516] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-30T19:30:06.273973] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-30T19:30:06.563623] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T19:30:06.897496] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-30T19:30:07.697565] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-30T19:30:08.506293] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-30T19:30:08.508568] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T19:30:08.619574] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-30T19:30:09.139544] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T19:30:09.297486] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-30T19:30:09.854382] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T19:30:10.097492] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-30T19:30:10.897514] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-30T19:30:11.251942] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T19:30:11.697560] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-30T19:30:12.497514] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-30T19:30:12.647911] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-30T19:30:12.753274] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T19:30:13.193104] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T19:30:13.297492] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-30T19:30:14.097531] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-30T19:30:14.186408] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-30T19:30:14.813926] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T19:30:14.897492] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-30T19:30:15.697468] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-30T19:30:16.497490] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-30T19:30:16.935738] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T19:30:16.943917] [INFO ] [REMOTE ] JQC: Full fetch complete (49703 records). [2025-10-30T19:30:16.944073] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-30T19:30:17.194602] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-30T19:30:17.302715] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-30T19:30:17.354258] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-30T19:30:17.354371] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-30T19:30:17.355284] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-30T19:30:17.355465] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-30T19:30:17.357130] [DEBUG] [LOCAL ] JQC: Trimmed 49703 records to 33527 (keeping 200 days of data) [2025-10-30T19:30:17.573750] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-30T19:30:17.588795] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-30T19:30:17.589772] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-30T19:30:17.594175] [DEBUG] [LOCAL ] JQC: Primary data saved (33527 records). [2025-10-30T19:30:17.594303] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-30T19:30:17.594444] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JQC took 27.2s. Estimated remaining: 2h 34m 22s. Rate: 7.8 symbols/min [2025-10-30T19:30:17.954121] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:30:18.100096] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-30T19:30:18.124161] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T19:30:18.199376] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-30T19:30:18.199861] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-30T19:30:18.201007] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-30T19:30:18.210938] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-30T19:30:18.212928] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54184 (keeping 200 days of data) [2025-10-30T19:30:18.325027] [DEBUG] [LOCAL ] JXN: Loaded 43637 existing records from primary storage. [2025-10-30T19:30:18.336266] [INFO ] [MAIN ] JXN: Loaded 43637 existing records. [2025-10-30T19:30:18.644620] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:30:18.646778] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-30T19:30:18.662827] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-30T19:30:18.669363] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-30T19:30:18.669890] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-30T19:30:18.914521] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-30T19:30:19.057166] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-30T19:30:19.117593] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-30T19:30:19.117787] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-30T19:30:19.123542] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JPM took 43.1s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-30T19:30:19.300523] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:19.369179] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:30:19.410770] [DEBUG] [LOCAL ] K: Loaded 50248 existing records from primary storage. [2025-10-30T19:30:19.411060] [INFO ] [MAIN ] K: Loaded 50248 existing records. [2025-10-30T19:30:19.549534] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-30T19:30:19.603706] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:30:19.603902] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-30T19:30:19.603950] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-30T19:30:19.604205] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-30T19:30:19.604242] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-30T19:30:19.702728] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-30T19:30:19.957926] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:20.497513] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-30T19:30:20.871389] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-30T19:30:21.297500] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-30T19:30:21.798980] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T19:30:22.097546] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-30T19:30:22.474961] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T19:30:22.897507] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-30T19:30:23.337975] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T19:30:23.697523] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-30T19:30:23.755542] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-30T19:30:23.760251] [INFO ] [REMOTE ] JRI: Full fetch complete (22602 records). [2025-10-30T19:30:23.760449] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-30T19:30:24.270194] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-30T19:30:24.270336] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-30T19:30:24.270862] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-30T19:30:24.270925] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-30T19:30:24.271756] [DEBUG] [LOCAL ] JRI: Trimmed 22602 records to 15128 (keeping 200 days of data) [2025-10-30T19:30:24.366089] [DEBUG] [LOCAL ] JRI: Primary data saved (15128 records). [2025-10-30T19:30:24.366239] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-30T19:30:24.366322] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JRI took 33.3s. Estimated remaining: 2h 33m 58s. Rate: 7.8 symbols/min [2025-10-30T19:30:24.502711] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-30T19:30:24.549814] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:30:24.564785] [DEBUG] [LOCAL ] KAI: Loaded 13231 existing records from primary storage. [2025-10-30T19:30:24.565071] [INFO ] [MAIN ] KAI: Loaded 13231 existing records. [2025-10-30T19:30:24.751843] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:30:24.752189] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-30T19:30:24.752313] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-30T19:30:24.752505] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-30T19:30:24.752543] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-30T19:30:25.119300] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:25.128200] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T19:30:25.158961] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T19:30:25.297493] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-30T19:30:26.097497] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-30T19:30:26.492058] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T19:30:26.773176] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T19:30:26.776388] [INFO ] [REMOTE ] JRS: Full fetch complete (16133 records). [2025-10-30T19:30:26.776456] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-30T19:30:26.911726] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-30T19:30:27.142445] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-30T19:30:27.142524] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-30T19:30:27.142939] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-30T19:30:27.143005] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-30T19:30:27.143585] [DEBUG] [LOCAL ] JRS: Trimmed 16133 records to 11528 (keeping 200 days of data) [2025-10-30T19:30:27.216895] [DEBUG] [LOCAL ] JRS: Primary data saved (11528 records). [2025-10-30T19:30:27.217034] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-30T19:30:27.217155] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JRS took 28.1s. Estimated remaining: 2h 33m 45s. Rate: 7.8 symbols/min [2025-10-30T19:30:27.416152] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:30:27.457456] [DEBUG] [LOCAL ] KAR: Loaded 39528 existing records from primary storage. [2025-10-30T19:30:27.457802] [INFO ] [MAIN ] KAR: Loaded 39528 existing records. [2025-10-30T19:30:27.634676] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:30:27.634967] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-30T19:30:27.635027] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-30T19:30:27.635234] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-30T19:30:27.635274] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-30T19:30:27.702711] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-30T19:30:27.999964] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:28.318401] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T19:30:28.497508] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-30T19:30:29.026326] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T19:30:29.297499] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-30T19:30:29.611158] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T19:30:30.097506] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-30T19:30:30.550936] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T19:30:30.627486] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T19:30:30.897475] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-30T19:30:31.697470] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-30T19:30:31.895439] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T19:30:32.368757] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-30T19:30:32.497497] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-30T19:30:33.297470] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-30T19:30:33.500855] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-30T19:30:34.097499] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-30T19:30:34.602915] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T19:30:34.897497] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-30T19:30:35.199145] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-30T19:30:35.697485] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-30T19:30:36.098887] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T19:30:36.357928] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-30T19:30:36.497476] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-30T19:30:37.297496] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-30T19:30:37.658339] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T19:30:38.097501] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-30T19:30:38.564703] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T19:30:38.897493] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-30T19:30:39.236783] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-30T19:30:39.660072] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-30T19:30:39.697488] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-30T19:30:40.497471] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-30T19:30:40.687282] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-30T19:30:41.297507] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-30T19:30:41.942311] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-30T19:30:42.097519] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-30T19:30:42.277499] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T19:30:42.729396] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-30T19:30:42.897479] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-30T19:30:43.697580] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-30T19:30:44.289629] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:30:44.497538] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-30T19:30:45.012399] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T19:30:45.297516] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-30T19:30:45.754494] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T19:30:45.876459] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-30T19:30:46.097511] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-30T19:30:46.897526] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-30T19:30:47.588052] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T19:30:47.598957] [INFO ] [REMOTE ] K: Full fetch complete (72301 records). [2025-10-30T19:30:47.599069] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-30T19:30:47.698972] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-30T19:30:47.997818] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-30T19:30:47.998035] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-30T19:30:47.999020] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-30T19:30:47.999133] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-30T19:30:48.023350] [DEBUG] [LOCAL ] K: Trimmed 72301 records to 50625 (keeping 200 days of data) [2025-10-30T19:30:48.024594] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T19:30:48.339009] [DEBUG] [LOCAL ] K: Primary data saved (50625 records). [2025-10-30T19:30:48.339148] [INFO ] [MAIN ] K: Full history saved. [2025-10-30T19:30:48.339230] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. K took 29.2s. Estimated remaining: 2h 33m 51s. Rate: 7.8 symbols/min [2025-10-30T19:30:48.503817] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:30:48.503924] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-30T19:30:48.525915] [DEBUG] [LOCAL ] KB: Loaded 22563 existing records from primary storage. [2025-10-30T19:30:48.526165] [INFO ] [MAIN ] KB: Loaded 22563 existing records. [2025-10-30T19:30:48.711042] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:30:48.712103] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-30T19:30:48.712165] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-30T19:30:48.712916] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-30T19:30:48.712974] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-30T19:30:49.089853] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:30:49.112160] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:49.297483] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-30T19:30:49.527519] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T19:30:50.007627] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-30T19:30:50.097492] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-30T19:30:50.897499] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-30T19:30:51.407050] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T19:30:51.415703] [INFO ] [REMOTE ] KAR: Full fetch complete (57172 records). [2025-10-30T19:30:51.415816] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-30T19:30:51.702798] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-30T19:30:51.824881] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-30T19:30:51.825083] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-30T19:30:51.826790] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-30T19:30:51.827507] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T19:30:51.833017] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-30T19:30:51.834314] [DEBUG] [LOCAL ] KAR: Trimmed 57172 records to 39836 (keeping 200 days of data) [2025-10-30T19:30:52.065725] [DEBUG] [LOCAL ] KAR: Primary data saved (39836 records). [2025-10-30T19:30:52.065885] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-30T19:30:52.066983] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. KAR took 24.8s. Estimated remaining: 2h 33m 39s. Rate: 7.8 symbols/min [2025-10-30T19:30:52.268639] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:30:52.297906] [DEBUG] [LOCAL ] KBDC: Loaded 22648 existing records from primary storage. [2025-10-30T19:30:52.298363] [INFO ] [MAIN ] KBDC: Loaded 22648 existing records. [2025-10-30T19:30:52.402434] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-30T19:30:52.501242] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-30T19:30:52.557425] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:30:52.557774] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-30T19:30:52.557836] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-30T19:30:52.558291] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-30T19:30:52.558354] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-30T19:30:52.932450] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:53.297513] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-30T19:30:53.447025] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-30T19:30:54.097523] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-30T19:30:54.423545] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T19:30:54.432412] [INFO ] [REMOTE ] JXN: Full fetch complete (64988 records). [2025-10-30T19:30:54.432576] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-30T19:30:54.834282] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-30T19:30:54.834408] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-30T19:30:54.835725] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-30T19:30:54.841137] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-30T19:30:54.846223] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-30T19:30:54.851312] [DEBUG] [LOCAL ] JXN: Trimmed 64988 records to 43882 (keeping 200 days of data) [2025-10-30T19:30:54.906035] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-30T19:30:55.125363] [DEBUG] [LOCAL ] JXN: Primary data saved (43882 records). [2025-10-30T19:30:55.125515] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-30T19:30:55.126222] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. JXN took 37.5s. Estimated remaining: 2h 33m 27s. Rate: 7.8 symbols/min [2025-10-30T19:30:55.301366] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:30:55.346546] [DEBUG] [LOCAL ] KBH: Loaded 48494 existing records from primary storage. [2025-10-30T19:30:55.346894] [INFO ] [MAIN ] KBH: Loaded 48494 existing records. [2025-10-30T19:30:55.529178] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:30:55.529391] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-30T19:30:55.529446] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-30T19:30:55.530414] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-30T19:30:55.530470] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-30T19:30:55.697742] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-30T19:30:55.768303] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T19:30:55.923974] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:30:56.497474] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-30T19:30:56.674570] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T19:30:57.109414] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T19:30:57.297496] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-30T19:30:58.097492] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-30T19:30:58.656819] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T19:30:58.895593] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T19:30:58.900986] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-30T19:30:59.523384] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-30T19:30:59.697492] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-30T19:31:00.497498] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-30T19:31:01.182989] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T19:31:01.297602] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-30T19:31:01.634015] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T19:31:02.097549] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-30T19:31:02.249510] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-30T19:31:02.253493] [INFO ] [REMOTE ] KAI: Full fetch complete (19637 records). [2025-10-30T19:31:02.253574] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-30T19:31:02.622860] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-30T19:31:02.622942] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-30T19:31:02.623357] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-30T19:31:02.623396] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-30T19:31:02.624045] [DEBUG] [LOCAL ] KAI: Trimmed 19637 records to 13407 (keeping 200 days of data) [2025-10-30T19:31:02.705979] [DEBUG] [LOCAL ] KAI: Primary data saved (13407 records). [2025-10-30T19:31:02.706108] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-30T19:31:02.706185] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. KAI took 38.3s. Estimated remaining: 2h 33m 19s. Rate: 7.8 symbols/min [2025-10-30T19:31:02.876912] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:31:02.891204] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-30T19:31:02.897457] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-30T19:31:02.935264] [DEBUG] [LOCAL ] KBR: Loaded 47946 existing records from primary storage. [2025-10-30T19:31:02.935557] [INFO ] [MAIN ] KBR: Loaded 47946 existing records. [2025-10-30T19:31:03.122674] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:31:03.122898] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-30T19:31:03.122946] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-30T19:31:03.123231] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-30T19:31:03.123288] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-30T19:31:03.479267] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:31:03.541545] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-30T19:31:03.697474] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-30T19:31:04.497505] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-30T19:31:04.803144] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T19:31:05.297499] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-30T19:31:05.893982] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T19:31:06.097493] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-30T19:31:06.445924] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T19:31:06.830534] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T19:31:06.897465] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-30T19:31:07.535208] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-30T19:31:07.697527] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-30T19:31:08.497519] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-30T19:31:08.844043] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T19:31:09.297476] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-30T19:31:09.485000] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T19:31:10.097518] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-30T19:31:10.511271] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T19:31:10.820512] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T19:31:10.897545] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-30T19:31:11.697570] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-30T19:31:12.242198] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T19:31:12.448768] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T19:31:12.497573] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-30T19:31:13.297516] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-30T19:31:13.802713] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T19:31:14.097526] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-30T19:31:14.525854] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T19:31:14.782912] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-30T19:31:14.897497] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-30T19:31:15.697464] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-30T19:31:15.845587] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-30T19:31:16.497516] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-30T19:31:16.903077] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T19:31:17.018187] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-30T19:31:17.297496] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-30T19:31:18.097527] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-30T19:31:18.511395] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T19:31:18.897496] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-30T19:31:19.343851] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-30T19:31:19.697534] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-30T19:31:20.067806] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-30T19:31:20.497496] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-30T19:31:20.933861] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T19:31:20.941634] [INFO ] [REMOTE ] KBDC: Full fetch complete (31558 records). [2025-10-30T19:31:20.941852] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-30T19:31:21.307602] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-30T19:31:21.353773] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-30T19:31:21.353871] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-30T19:31:21.354620] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-30T19:31:21.354885] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-30T19:31:21.368093] [DEBUG] [LOCAL ] KBDC: Trimmed 31558 records to 22864 (keeping 200 days of data) [2025-10-30T19:31:21.368578] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-30T19:31:21.373947] [INFO ] [REMOTE ] KB: Full fetch complete (33134 records). [2025-10-30T19:31:21.374051] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-30T19:31:21.838014] [DEBUG] [LOCAL ] KBDC: Primary data saved (22864 records). [2025-10-30T19:31:21.853685] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-30T19:31:21.859044] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. KBDC took 29.8s. Estimated remaining: 2h 33m 23s. Rate: 7.8 symbols/min [2025-10-30T19:31:22.021732] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-30T19:31:22.024283] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-30T19:31:22.025060] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-30T19:31:22.025141] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-30T19:31:22.065634] [DEBUG] [LOCAL ] KB: Trimmed 33134 records to 22655 (keeping 200 days of data) [2025-10-30T19:31:22.096389] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:31:22.146449] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-30T19:31:22.232843] [DEBUG] [LOCAL ] KB: Primary data saved (22655 records). [2025-10-30T19:31:22.246729] [INFO ] [MAIN ] KB: Full history saved. [2025-10-30T19:31:22.246855] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KB took 33.9s. Estimated remaining: 2h 33m 8s. Rate: 7.8 symbols/min [2025-10-30T19:31:22.380790] [DEBUG] [LOCAL ] KD: Loaded 52283 existing records from primary storage. [2025-10-30T19:31:22.414695] [INFO ] [MAIN ] KD: Loaded 52283 existing records. [2025-10-30T19:31:22.478059] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:31:22.582790] [DEBUG] [LOCAL ] KEN: Loaded 4157 existing records from primary storage. [2025-10-30T19:31:22.656584] [INFO ] [MAIN ] KEN: Loaded 4157 existing records. [2025-10-30T19:31:22.662717] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:31:22.707548] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-30T19:31:22.728793] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-30T19:31:22.740751] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-30T19:31:22.751279] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-30T19:31:22.950790] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:31:22.992635] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-30T19:31:22.994957] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-30T19:31:22.993373] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-30T19:31:23.025373] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-30T19:31:23.025922] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-30T19:31:23.044585] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-30T19:31:23.440968] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:31:23.661889] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:31:23.691065] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T19:31:23.701222] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-30T19:31:24.108628] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T19:31:24.497478] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-30T19:31:24.905189] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-30T19:31:24.917582] [INFO ] [REMOTE ] KBR: Full fetch complete (70177 records). [2025-10-30T19:31:24.917864] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-30T19:31:25.302857] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-30T19:31:25.326574] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-30T19:31:25.326735] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-30T19:31:25.328391] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-30T19:31:25.328462] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-30T19:31:25.330503] [DEBUG] [LOCAL ] KBR: Trimmed 70177 records to 48323 (keeping 200 days of data) [2025-10-30T19:31:25.583198] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-30T19:31:25.668478] [DEBUG] [LOCAL ] KBR: Primary data saved (48323 records). [2025-10-30T19:31:25.669022] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-30T19:31:25.669830] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KBR took 23.0s. Estimated remaining: 2h 32m 56s. Rate: 7.8 symbols/min [2025-10-30T19:31:25.880251] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:31:25.926380] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-30T19:31:25.973701] [DEBUG] [LOCAL ] KEP: Loaded 32621 existing records from primary storage. [2025-10-30T19:31:25.974178] [INFO ] [MAIN ] KEP: Loaded 32621 existing records. [2025-10-30T19:31:26.102738] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-30T19:31:26.209923] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:31:26.210296] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-30T19:31:26.210371] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-30T19:31:26.211091] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-30T19:31:26.211152] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-30T19:31:26.581987] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-30T19:31:26.625987] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:31:26.897531] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-30T19:31:27.392031] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T19:31:27.697509] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-30T19:31:28.497522] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-30T19:31:29.107614] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T19:31:29.297503] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-30T19:31:29.741936] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T19:31:29.988223] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T19:31:30.097509] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-30T19:31:30.736503] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-30T19:31:30.897503] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-30T19:31:31.697555] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-30T19:31:32.107536] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T19:31:32.497505] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-30T19:31:33.064388] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T19:31:33.075097] [INFO ] [REMOTE ] KBH: Full fetch complete (70896 records). [2025-10-30T19:31:33.075218] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-30T19:31:33.295061] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-30T19:31:33.303785] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-30T19:31:33.514712] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-30T19:31:33.514803] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-30T19:31:33.515755] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-30T19:31:33.515817] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-30T19:31:33.517127] [DEBUG] [LOCAL ] KBH: Trimmed 70896 records to 48840 (keeping 200 days of data) [2025-10-30T19:31:33.802202] [DEBUG] [LOCAL ] KBH: Primary data saved (48840 records). [2025-10-30T19:31:33.802326] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-30T19:31:33.802965] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KBH took 38.7s. Estimated remaining: 2h 32m 48s. Rate: 7.8 symbols/min [2025-10-30T19:31:33.974133] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:31:34.011451] [DEBUG] [LOCAL ] KEX: Loaded 38736 existing records from primary storage. [2025-10-30T19:31:34.011778] [INFO ] [MAIN ] KEX: Loaded 38736 existing records. [2025-10-30T19:31:34.102681] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-30T19:31:34.203374] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:31:34.203571] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-30T19:31:34.203617] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-30T19:31:34.204249] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-30T19:31:34.204305] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-30T19:31:34.589238] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:31:34.693380] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T19:31:34.785062] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T19:31:34.897488] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-30T19:31:35.697514] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-30T19:31:35.829192] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T19:31:36.497528] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-30T19:31:36.972694] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T19:31:37.297500] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-30T19:31:37.632019] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-30T19:31:38.097519] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-30T19:31:38.361203] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:31:38.897465] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-30T19:31:39.074712] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T19:31:39.697494] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-30T19:31:39.963597] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-30T19:31:40.497518] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-30T19:31:40.691487] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T19:31:41.297460] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-30T19:31:41.422321] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-30T19:31:42.097507] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-30T19:31:42.378884] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T19:31:42.521746] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-30T19:31:42.897530] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-30T19:31:43.697531] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-30T19:31:44.120544] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T19:31:44.497485] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-30T19:31:44.665236] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T19:31:44.888857] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-30T19:31:45.297497] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-30T19:31:46.097476] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-30T19:31:46.132511] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-30T19:31:46.825443] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T19:31:46.897493] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-30T19:31:47.350911] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-30T19:31:47.697551] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-30T19:31:48.497500] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-30T19:31:48.628393] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T19:31:49.297494] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-30T19:31:49.700726] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-30T19:31:49.729449] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-30T19:31:50.097487] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-30T19:31:50.897533] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-30T19:31:51.262855] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-30T19:31:51.415045] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-30T19:31:51.697495] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-30T19:31:52.190720] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-30T19:31:52.191800] [INFO ] [REMOTE ] KEN: Full fetch complete (5814 records). [2025-10-30T19:31:52.191869] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-30T19:31:52.512831] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-30T19:31:52.552912] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-30T19:31:52.553005] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-30T19:31:52.553161] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-30T19:31:52.553201] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-30T19:31:52.553956] [DEBUG] [LOCAL ] KEN: Trimmed 5814 records to 4169 (keeping 200 days of data) [2025-10-30T19:31:52.577750] [DEBUG] [LOCAL ] KEN: Primary data saved (4169 records). [2025-10-30T19:31:52.577842] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-30T19:31:52.577916] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEN took 30.3s. Estimated remaining: 2h 32m 52s. Rate: 7.8 symbols/min [2025-10-30T19:31:52.745096] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:31:52.745274] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-30T19:31:52.745309] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-30T19:31:52.745417] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-30T19:31:52.745457] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-30T19:31:52.745497] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-30T19:31:52.745530] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-30T19:31:53.128148] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:31:53.297481] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-30T19:31:53.922483] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T19:31:54.097483] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-30T19:31:54.584761] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T19:31:54.897512] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-30T19:31:55.510270] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T19:31:55.697478] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-30T19:31:56.120134] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T19:31:56.497468] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-30T19:31:56.724420] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T19:31:57.297486] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-30T19:31:57.699122] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T19:31:57.706804] [INFO ] [REMOTE ] KEP: Full fetch complete (42839 records). [2025-10-30T19:31:57.706905] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-30T19:31:58.071471] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-30T19:31:58.071546] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-30T19:31:58.072250] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-30T19:31:58.072311] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-30T19:31:58.073194] [DEBUG] [LOCAL ] KEP: Trimmed 42839 records to 32930 (keeping 200 days of data) [2025-10-30T19:31:58.120526] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-30T19:31:58.262577] [DEBUG] [LOCAL ] KEP: Primary data saved (32930 records). [2025-10-30T19:31:58.262724] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-30T19:31:58.263392] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KEP took 32.6s. Estimated remaining: 2h 32m 42s. Rate: 7.8 symbols/min [2025-10-30T19:31:58.432168] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:31:58.480903] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T19:31:58.503709] [DEBUG] [LOCAL ] KEYS: Loaded 42851 existing records from primary storage. [2025-10-30T19:31:58.503971] [INFO ] [MAIN ] KEYS: Loaded 42851 existing records. [2025-10-30T19:31:58.676934] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:31:58.677115] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-30T19:31:58.677160] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-30T19:31:58.677870] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-30T19:31:58.677929] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-30T19:31:58.907225] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-30T19:31:59.034342] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:31:59.697533] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-30T19:31:59.761049] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-30T19:32:00.497505] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-30T19:32:00.567890] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-30T19:32:00.580623] [INFO ] [REMOTE ] KD: Full fetch complete (76057 records). [2025-10-30T19:32:00.580828] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-30T19:32:01.004666] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-30T19:32:01.004758] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-30T19:32:01.005729] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-30T19:32:01.005792] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-30T19:32:01.007246] [DEBUG] [LOCAL ] KD: Trimmed 76057 records to 52662 (keeping 200 days of data) [2025-10-30T19:32:01.304508] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-30T19:32:01.314262] [DEBUG] [LOCAL ] KD: Primary data saved (52662 records). [2025-10-30T19:32:01.314544] [INFO ] [MAIN ] KD: Full history saved. [2025-10-30T19:32:01.314776] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KD took 39.4s. Estimated remaining: 2h 32m 30s. Rate: 7.8 symbols/min [2025-10-30T19:32:01.464107] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-30T19:32:01.506005] [INFO ] [REMOTE ] KEX: Full fetch complete (56343 records). [2025-10-30T19:32:01.525203] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-30T19:32:01.601621] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:01.716084] [DEBUG] [LOCAL ] KF: Loaded 2298 existing records from primary storage. [2025-10-30T19:32:01.757337] [INFO ] [MAIN ] KF: Loaded 2298 existing records. [2025-10-30T19:32:02.153182] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-30T19:32:02.174781] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-30T19:32:02.199505] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-30T19:32:02.195808] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:02.199840] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-30T19:32:02.200126] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-30T19:32:02.200231] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-30T19:32:02.200967] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-30T19:32:02.201223] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-30T19:32:02.242109] [DEBUG] [LOCAL ] KEX: Trimmed 56343 records to 39084 (keeping 200 days of data) [2025-10-30T19:32:02.581295] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-30T19:32:02.743060] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-30T19:32:02.830054] [DEBUG] [LOCAL ] KEX: Primary data saved (39084 records). [2025-10-30T19:32:02.835475] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-30T19:32:02.835607] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KEX took 29.0s. Estimated remaining: 2h 32m 16s. Rate: 7.8 symbols/min [2025-10-30T19:32:02.979522] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:02.999337] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-30T19:32:03.071711] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:03.091060] [DEBUG] [LOCAL ] KFRC: Loaded 21047 existing records from primary storage. [2025-10-30T19:32:03.091363] [INFO ] [MAIN ] KFRC: Loaded 21047 existing records. [2025-10-30T19:32:03.266419] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:03.266637] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-30T19:32:03.266719] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-30T19:32:03.267186] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-30T19:32:03.267242] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-30T19:32:03.533320] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-30T19:32:03.636132] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:03.666528] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-30T19:32:03.697481] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-30T19:32:04.084820] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T19:32:04.258956] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T19:32:04.497481] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-30T19:32:05.053668] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T19:32:05.297526] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-30T19:32:06.001726] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-30T19:32:06.097478] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-30T19:32:06.854020] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-30T19:32:06.897559] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-30T19:32:07.540092] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-30T19:32:07.697560] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-30T19:32:08.317285] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-30T19:32:08.497509] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-30T19:32:08.846780] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-30T19:32:09.297489] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-30T19:32:10.097500] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-30T19:32:10.578259] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T19:32:10.897520] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-30T19:32:11.270850] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T19:32:11.697588] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-30T19:32:12.248471] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T19:32:12.497546] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-30T19:32:12.891248] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T19:32:13.297549] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-30T19:32:13.722831] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T19:32:13.967081] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-30T19:32:14.097530] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-30T19:32:14.853343] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-30T19:32:14.897677] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-30T19:32:15.223216] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-30T19:32:15.697529] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-30T19:32:16.025447] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-30T19:32:16.497544] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-30T19:32:17.297504] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-30T19:32:17.759250] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-30T19:32:18.097483] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-30T19:32:18.126383] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-30T19:32:18.897497] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-30T19:32:19.275071] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-30T19:32:19.386389] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T19:32:19.697530] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-30T19:32:20.497518] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-30T19:32:20.819454] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T19:32:21.297519] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-30T19:32:21.433224] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T19:32:21.439600] [INFO ] [REMOTE ] KFRC: Full fetch complete (27612 records). [2025-10-30T19:32:21.439758] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-30T19:32:21.837910] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-30T19:32:21.837990] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-30T19:32:21.838600] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-30T19:32:21.838669] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-30T19:32:21.839408] [DEBUG] [LOCAL ] KFRC: Trimmed 27612 records to 21214 (keeping 200 days of data) [2025-10-30T19:32:21.973136] [DEBUG] [LOCAL ] KFRC: Primary data saved (21214 records). [2025-10-30T19:32:21.973258] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-30T19:32:21.973334] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KFRC took 19.1s. Estimated remaining: 2h 32m 19s. Rate: 7.8 symbols/min [2025-10-30T19:32:22.102750] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-30T19:32:22.151491] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:22.162067] [DEBUG] [LOCAL ] KFS: Loaded 8705 existing records from primary storage. [2025-10-30T19:32:22.162835] [INFO ] [MAIN ] KFS: Loaded 8705 existing records. [2025-10-30T19:32:22.349310] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:22.349823] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-30T19:32:22.349985] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-30T19:32:22.350275] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-30T19:32:22.350345] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-30T19:32:22.664747] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T19:32:22.752014] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:22.897495] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-30T19:32:23.697480] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-30T19:32:23.751181] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-30T19:32:23.763868] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-30T19:32:23.764006] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-30T19:32:23.963968] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T19:32:23.964857] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:32:23.964975] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:32:23.965129] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-30T19:32:23.965236] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-30T19:32:23.965303] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-30T19:32:23.965449] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-30T19:32:23.965609] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KEY took 31.4s. Estimated remaining: 2h 32m 6s. Rate: 7.8 symbols/min [2025-10-30T19:32:24.136799] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:24.144535] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-30T19:32:24.174662] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T19:32:24.207345] [DEBUG] [LOCAL ] KFY: Loaded 29008 existing records from primary storage. [2025-10-30T19:32:24.207609] [INFO ] [MAIN ] KFY: Loaded 29008 existing records. [2025-10-30T19:32:24.402925] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:24.403143] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-30T19:32:24.403191] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-30T19:32:24.403509] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-30T19:32:24.403567] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-30T19:32:24.502738] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-30T19:32:24.789408] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:24.908515] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-30T19:32:25.297506] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-30T19:32:26.097490] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-30T19:32:26.146092] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T19:32:26.398003] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-30T19:32:26.897507] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-30T19:32:27.697547] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-30T19:32:28.032908] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T19:32:28.497494] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-30T19:32:28.565549] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-30T19:32:28.780958] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-30T19:32:29.297498] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-30T19:32:29.651048] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-30T19:32:30.097503] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-30T19:32:30.897476] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-30T19:32:31.106866] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T19:32:31.697491] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-30T19:32:31.870148] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T19:32:32.497488] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-30T19:32:32.608397] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T19:32:33.297531] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-30T19:32:33.581689] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-30T19:32:33.792935] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-30T19:32:33.802847] [INFO ] [REMOTE ] KEYS: Full fetch complete (63265 records). [2025-10-30T19:32:33.803011] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-30T19:32:34.101264] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-30T19:32:34.195995] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-30T19:32:34.196067] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-30T19:32:34.196943] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-30T19:32:34.197002] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-30T19:32:34.198151] [DEBUG] [LOCAL ] KEYS: Trimmed 63265 records to 43224 (keeping 200 days of data) [2025-10-30T19:32:34.450445] [DEBUG] [LOCAL ] KEYS: Primary data saved (43224 records). [2025-10-30T19:32:34.450563] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-30T19:32:34.451063] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KEYS took 36.2s. Estimated remaining: 2h 32m 1s. Rate: 7.8 symbols/min [2025-10-30T19:32:34.614229] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:34.662860] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-30T19:32:34.663185] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-30T19:32:34.839151] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:34.839534] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-30T19:32:34.839666] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-30T19:32:34.839990] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-30T19:32:34.840067] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-30T19:32:34.902764] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-30T19:32:35.060054] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-30T19:32:35.239552] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:35.397699] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-30T19:32:35.697496] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-30T19:32:36.177926] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T19:32:36.497530] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-30T19:32:37.008639] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T19:32:37.297536] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-30T19:32:38.097472] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-30T19:32:38.226179] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T19:32:38.473719] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-30T19:32:38.475151] [INFO ] [REMOTE ] KF: Full fetch complete (3388 records). [2025-10-30T19:32:38.475338] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-30T19:32:38.849400] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-30T19:32:38.849479] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-30T19:32:38.849601] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-30T19:32:38.849639] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-30T19:32:38.850012] [DEBUG] [LOCAL ] KF: Trimmed 3388 records to 2310 (keeping 200 days of data) [2025-10-30T19:32:38.863905] [DEBUG] [LOCAL ] KF: Primary data saved (2310 records). [2025-10-30T19:32:38.864001] [INFO ] [MAIN ] KF: Full history saved. [2025-10-30T19:32:38.864074] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KF took 37.5s. Estimated remaining: 2h 31m 50s. Rate: 7.8 symbols/min [2025-10-30T19:32:38.903570] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-30T19:32:39.037109] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:39.082599] [DEBUG] [LOCAL ] KGS: Loaded 45851 existing records from primary storage. [2025-10-30T19:32:39.082915] [INFO ] [MAIN ] KGS: Loaded 45851 existing records. [2025-10-30T19:32:39.268061] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:39.268471] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-30T19:32:39.268528] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-30T19:32:39.269041] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-30T19:32:39.269098] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-30T19:32:39.635206] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:39.697480] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-30T19:32:40.249994] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T19:32:40.250882] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-30T19:32:40.497508] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-30T19:32:41.297500] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-30T19:32:41.939984] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T19:32:42.097473] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-30T19:32:42.146461] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T19:32:42.897499] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-30T19:32:43.156780] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T19:32:43.448732] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T19:32:43.697539] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-30T19:32:44.497497] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-30T19:32:44.920071] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T19:32:45.297546] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-30T19:32:45.827856] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-30T19:32:46.072700] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-30T19:32:46.097463] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-30T19:32:46.897509] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-30T19:32:47.704708] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-30T19:32:47.727027] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-30T19:32:48.088084] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-30T19:32:48.497505] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-30T19:32:48.590634] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T19:32:49.297513] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-30T19:32:50.026454] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-30T19:32:50.097486] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-30T19:32:50.229724] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T19:32:50.897509] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-30T19:32:51.392829] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T19:32:51.545553] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T19:32:51.697565] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-30T19:32:52.342696] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T19:32:52.346950] [INFO ] [REMOTE ] KFS: Full fetch complete (11384 records). [2025-10-30T19:32:52.347090] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-30T19:32:52.502628] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-30T19:32:52.789180] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-30T19:32:52.789274] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-30T19:32:52.789630] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-30T19:32:52.789727] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-30T19:32:52.790431] [DEBUG] [LOCAL ] KFS: Trimmed 11384 records to 8755 (keeping 200 days of data) [2025-10-30T19:32:52.849862] [DEBUG] [LOCAL ] KFS: Primary data saved (8755 records). [2025-10-30T19:32:52.850011] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-30T19:32:52.850095] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KFS took 30.9s. Estimated remaining: 2h 31m 49s. Rate: 7.8 symbols/min [2025-10-30T19:32:53.031389] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:53.081520] [DEBUG] [LOCAL ] KIM: Loaded 52988 existing records from primary storage. [2025-10-30T19:32:53.081884] [INFO ] [MAIN ] KIM: Loaded 52988 existing records. [2025-10-30T19:32:53.266472] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:53.266778] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-30T19:32:53.266832] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-30T19:32:53.267376] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-30T19:32:53.267436] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-30T19:32:53.304892] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-30T19:32:53.650670] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:54.068715] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-30T19:32:54.097453] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-30T19:32:54.401585] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T19:32:54.410433] [INFO ] [REMOTE ] KFY: Full fetch complete (43366 records). [2025-10-30T19:32:54.410591] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-30T19:32:54.788518] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-30T19:32:54.788601] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-30T19:32:54.789323] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-30T19:32:54.789386] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-30T19:32:54.790431] [DEBUG] [LOCAL ] KFY: Trimmed 43366 records to 29305 (keeping 200 days of data) [2025-10-30T19:32:54.900405] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-30T19:32:54.975428] [DEBUG] [LOCAL ] KFY: Primary data saved (29305 records). [2025-10-30T19:32:54.975545] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-30T19:32:54.975622] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KFY took 31.0s. Estimated remaining: 2h 31m 35s. Rate: 7.8 symbols/min [2025-10-30T19:32:55.147320] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:32:55.168213] [DEBUG] [LOCAL ] KIO: Loaded 21640 existing records from primary storage. [2025-10-30T19:32:55.168449] [INFO ] [MAIN ] KIO: Loaded 21640 existing records. [2025-10-30T19:32:55.349565] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:32:55.349905] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-30T19:32:55.349965] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-30T19:32:55.350720] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-30T19:32:55.350785] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-30T19:32:55.724157] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-30T19:32:55.727929] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:32:55.760899] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-30T19:32:56.139202] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T19:32:56.497507] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-30T19:32:57.049878] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T19:32:57.256695] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-30T19:32:57.297514] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-30T19:32:57.955048] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-30T19:32:58.097498] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-30T19:32:58.897485] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-30T19:32:59.228869] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-30T19:32:59.697514] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-30T19:33:00.497522] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-30T19:33:01.228534] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-30T19:33:01.297457] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-30T19:33:01.384264] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-30T19:33:01.679816] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T19:33:02.097506] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-30T19:33:02.897548] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-30T19:33:03.311902] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-30T19:33:03.326928] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-30T19:33:03.327114] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-30T19:33:03.706750] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-30T19:33:03.732072] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-30T19:33:03.732188] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-30T19:33:03.733316] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-30T19:33:03.733457] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-30T19:33:03.734959] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 54089 (keeping 200 days of data) [2025-10-30T19:33:04.117919] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-10-30T19:33:04.118561] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-30T19:33:04.120215] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KGC took 29.7s. Estimated remaining: 2h 31m 29s. Rate: 7.8 symbols/min [2025-10-30T19:33:04.122087] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-30T19:33:04.326414] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:04.344549] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T19:33:04.394043] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-30T19:33:04.421183] [DEBUG] [LOCAL ] KKR: Loaded 53492 existing records from primary storage. [2025-10-30T19:33:04.421507] [INFO ] [MAIN ] KKR: Loaded 53492 existing records. [2025-10-30T19:33:04.502618] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-30T19:33:04.610313] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:33:04.610558] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-30T19:33:04.610607] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-30T19:33:04.611187] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-30T19:33:04.611244] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-30T19:33:05.007200] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:05.297523] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-30T19:33:05.760461] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T19:33:06.097520] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-30T19:33:06.572870] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-30T19:33:06.897584] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-30T19:33:07.455802] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-30T19:33:07.697522] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-30T19:33:08.020512] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T19:33:08.497488] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-30T19:33:08.906896] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T19:33:09.206893] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-30T19:33:09.297528] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-30T19:33:10.097501] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-30T19:33:10.586555] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T19:33:10.897497] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-30T19:33:11.487746] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-30T19:33:11.697587] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-30T19:33:11.959057] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T19:33:12.497633] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-30T19:33:13.088450] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-30T19:33:13.175805] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T19:33:13.297540] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-30T19:33:14.097495] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-30T19:33:14.765595] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T19:33:14.897530] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-30T19:33:15.274784] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T19:33:15.697579] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-30T19:33:16.425063] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-30T19:33:16.497536] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-30T19:33:17.084894] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:33:17.269935] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-30T19:33:17.297452] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-30T19:33:18.097470] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-30T19:33:18.129403] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-30T19:33:18.897529] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-30T19:33:19.415293] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T19:33:19.697502] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-30T19:33:20.118000] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T19:33:20.497525] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-30T19:33:21.297525] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-30T19:33:21.386888] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-30T19:33:21.399386] [INFO ] [REMOTE ] KIM: Full fetch complete (76976 records). [2025-10-30T19:33:21.399577] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-30T19:33:21.823244] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-30T19:33:21.823572] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-30T19:33:21.825092] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-30T19:33:21.825275] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-30T19:33:21.827181] [DEBUG] [LOCAL ] KIM: Trimmed 76976 records to 53378 (keeping 200 days of data) [2025-10-30T19:33:22.115857] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-30T19:33:22.164266] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T19:33:22.186307] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-30T19:33:22.213032] [DEBUG] [LOCAL ] KIM: Primary data saved (53378 records). [2025-10-30T19:33:22.224746] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-30T19:33:22.225622] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KIM took 29.4s. Estimated remaining: 2h 31m 32s. Rate: 7.8 symbols/min [2025-10-30T19:33:22.393390] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:22.402049] [DEBUG] [LOCAL ] KKRS: Loaded 5405 existing records from primary storage. [2025-10-30T19:33:22.402268] [INFO ] [MAIN ] KKRS: Loaded 5405 existing records. [2025-10-30T19:33:22.586182] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:33:22.586423] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-30T19:33:22.586472] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-30T19:33:22.586706] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-30T19:33:22.586771] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-30T19:33:22.902697] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-30T19:33:22.964764] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:23.470481] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T19:33:23.481002] [INFO ] [REMOTE ] KGS: Full fetch complete (66605 records). [2025-10-30T19:33:23.481159] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-30T19:33:23.704422] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-30T19:33:23.900226] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-30T19:33:23.900314] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-30T19:33:23.901743] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-30T19:33:23.901811] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-30T19:33:23.903174] [DEBUG] [LOCAL ] KGS: Trimmed 66605 records to 46195 (keeping 200 days of data) [2025-10-30T19:33:24.194681] [DEBUG] [LOCAL ] KGS: Primary data saved (46195 records). [2025-10-30T19:33:24.195095] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-30T19:33:24.196020] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KGS took 45.3s. Estimated remaining: 2h 31m 18s. Rate: 7.8 symbols/min [2025-10-30T19:33:24.286987] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-30T19:33:24.382866] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:24.383138] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-30T19:33:24.383207] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-30T19:33:24.383431] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-30T19:33:24.383487] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-30T19:33:24.383721] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-30T19:33:24.383775] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-30T19:33:24.503188] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-30T19:33:24.522462] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-30T19:33:24.796988] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:25.297505] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-30T19:33:25.440503] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T19:33:25.440864] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-30T19:33:25.440952] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:33:25.440998] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-30T19:33:25.441031] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:33:25.441114] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-30T19:33:25.441175] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-30T19:33:25.441211] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-30T19:33:25.441250] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-30T19:33:25.441295] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KKRT took 1.2s. Estimated remaining: 2h 31m 4s. Rate: 7.8 symbols/min [2025-10-30T19:33:25.629156] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T19:33:25.631573] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:25.638236] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-30T19:33:25.638291] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-30T19:33:25.638434] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-30T19:33:25.638616] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-30T19:33:25.638749] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-30T19:33:25.638803] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-30T19:33:25.638549] [INFO ] [REMOTE ] KIO: Full fetch complete (32696 records). [2025-10-30T19:33:25.702367] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-30T19:33:26.099205] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-30T19:33:26.374862] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:26.462825] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-30T19:33:26.462904] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-30T19:33:26.463544] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-30T19:33:26.463583] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-30T19:33:26.464304] [DEBUG] [LOCAL ] KIO: Trimmed 32696 records to 21821 (keeping 200 days of data) [2025-10-30T19:33:26.570182] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T19:33:26.603482] [DEBUG] [LOCAL ] KIO: Primary data saved (21821 records). [2025-10-30T19:33:26.603637] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-30T19:33:26.603776] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KIO took 31.6s. Estimated remaining: 2h 30m 50s. Rate: 7.8 symbols/min [2025-10-30T19:33:26.791764] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:26.824794] [DEBUG] [LOCAL ] KLC: Loaded 35762 existing records from primary storage. [2025-10-30T19:33:26.825064] [INFO ] [MAIN ] KLC: Loaded 35762 existing records. [2025-10-30T19:33:26.902613] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-30T19:33:27.004864] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:33:27.005083] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-30T19:33:27.005135] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-30T19:33:27.005506] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-30T19:33:27.005565] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-30T19:33:27.102052] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T19:33:27.104953] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-30T19:33:27.105071] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:33:27.120786] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-30T19:33:27.131154] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:33:27.153274] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-30T19:33:27.177513] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-30T19:33:27.249386] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-30T19:33:27.270747] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-30T19:33:27.280872] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KLAR took 1.8s. Estimated remaining: 2h 30m 35s. Rate: 7.8 symbols/min [2025-10-30T19:33:27.463497] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:27.532897] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:27.582763] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-30T19:33:27.583141] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-30T19:33:27.702812] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-30T19:33:27.762935] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:33:27.763095] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-30T19:33:27.763140] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-30T19:33:27.763578] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-30T19:33:27.763616] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-30T19:33:28.125444] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:28.161108] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-30T19:33:28.497523] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-30T19:33:29.297486] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-30T19:33:29.324615] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T19:33:30.097497] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-30T19:33:30.571881] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-30T19:33:30.882572] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-30T19:33:30.897449] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-30T19:33:31.348033] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-30T19:33:31.697518] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-30T19:33:32.497506] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-30T19:33:32.822474] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-30T19:33:33.076625] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T19:33:33.297495] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-30T19:33:34.097496] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-30T19:33:34.881429] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-30T19:33:34.897509] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-30T19:33:35.018684] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-30T19:33:35.031423] [INFO ] [REMOTE ] KKR: Full fetch complete (77655 records). [2025-10-30T19:33:35.031663] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-30T19:33:35.437978] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-30T19:33:35.438057] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-30T19:33:35.439160] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-30T19:33:35.439232] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-30T19:33:35.440690] [DEBUG] [LOCAL ] KKR: Trimmed 77655 records to 53882 (keeping 200 days of data) [2025-10-30T19:33:35.722858] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-30T19:33:35.774534] [DEBUG] [LOCAL ] KKR: Primary data saved (53882 records). [2025-10-30T19:33:35.774721] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-30T19:33:35.775378] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KKR took 31.7s. Estimated remaining: 2h 30m 28s. Rate: 7.8 symbols/min [2025-10-30T19:33:35.969082] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:35.970979] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T19:33:35.982960] [DEBUG] [LOCAL ] KMPB: Loaded 3398 existing records from primary storage. [2025-10-30T19:33:35.983149] [INFO ] [MAIN ] KMPB: Loaded 3398 existing records. [2025-10-30T19:33:36.157207] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:33:36.157407] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-30T19:33:36.157454] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-30T19:33:36.157593] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-30T19:33:36.157637] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-30T19:33:36.503093] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-30T19:33:36.507822] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:37.199461] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-30T19:33:37.297500] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-30T19:33:37.451735] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-30T19:33:38.097529] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-30T19:33:38.459548] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-30T19:33:38.699191] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T19:33:38.897593] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-30T19:33:39.697504] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-30T19:33:39.840397] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T19:33:40.497578] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-30T19:33:41.175996] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-30T19:33:41.297514] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-30T19:33:41.429294] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T19:33:42.097493] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-30T19:33:42.692148] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-30T19:33:42.898429] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-30T19:33:42.901844] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-30T19:33:43.280063] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-30T19:33:43.697513] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-30T19:33:44.074390] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T19:33:44.497474] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-30T19:33:45.297502] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-30T19:33:45.620257] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T19:33:45.897853] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-30T19:33:45.899093] [INFO ] [REMOTE ] KKRS: Full fetch complete (7488 records). [2025-10-30T19:33:45.899161] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-30T19:33:46.106045] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-30T19:33:46.275087] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-30T19:33:46.275162] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-30T19:33:46.275402] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-30T19:33:46.275448] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-30T19:33:46.275866] [DEBUG] [LOCAL ] KKRS: Trimmed 7488 records to 5447 (keeping 200 days of data) [2025-10-30T19:33:46.307975] [DEBUG] [LOCAL ] KKRS: Primary data saved (5447 records). [2025-10-30T19:33:46.308090] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-30T19:33:46.308168] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KKRS took 24.1s. Estimated remaining: 2h 30m 23s. Rate: 7.8 symbols/min [2025-10-30T19:33:46.497157] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:33:46.535075] [DEBUG] [LOCAL ] KMPR: Loaded 40558 existing records from primary storage. [2025-10-30T19:33:46.535357] [INFO ] [MAIN ] KMPR: Loaded 40558 existing records. [2025-10-30T19:33:46.708136] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:33:46.708363] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-30T19:33:46.708411] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-30T19:33:46.708672] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-30T19:33:46.708732] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-30T19:33:46.902700] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-30T19:33:47.063994] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:33:47.171964] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-30T19:33:47.364942] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-30T19:33:47.697539] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-30T19:33:48.497511] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-30T19:33:48.759211] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T19:33:48.767662] [INFO ] [REMOTE ] KLC: Full fetch complete (50898 records). [2025-10-30T19:33:48.767792] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-30T19:33:48.862204] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-30T19:33:49.146543] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-30T19:33:49.146669] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-30T19:33:49.147502] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-30T19:33:49.147547] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-30T19:33:49.148698] [DEBUG] [LOCAL ] KLC: Trimmed 50898 records to 36054 (keeping 200 days of data) [2025-10-30T19:33:49.301353] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-30T19:33:49.354190] [DEBUG] [LOCAL ] KLC: Primary data saved (36054 records). [2025-10-30T19:33:49.354372] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-30T19:33:49.354468] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KLC took 22.8s. Estimated remaining: 2h 30m 11s. Rate: 7.8 symbols/min [2025-10-30T19:33:49.674713] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-30T19:33:50.097508] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-30T19:33:50.445838] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-30T19:33:50.897502] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-30T19:33:51.697524] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-30T19:33:52.013277] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-30T19:33:52.032928] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T19:33:52.497511] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-30T19:33:53.297592] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-30T19:33:53.706029] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-30T19:33:54.097489] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-30T19:33:54.136609] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-30T19:33:54.897500] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-30T19:33:54.954739] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T19:33:55.697532] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-30T19:33:56.382840] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T19:33:56.497528] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-30T19:33:56.569973] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-30T19:33:57.297570] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-30T19:33:57.845953] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-30T19:33:58.097518] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-30T19:33:58.122981] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-30T19:33:58.897505] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-30T19:33:59.206722] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-30T19:33:59.537106] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T19:33:59.697502] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-30T19:34:00.306467] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-30T19:34:00.319825] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-30T19:34:00.320064] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-30T19:34:00.502413] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-30T19:34:00.722942] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-30T19:34:00.723055] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-30T19:34:00.724099] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-30T19:34:00.724160] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-30T19:34:00.725571] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54083 (keeping 200 days of data) [2025-10-30T19:34:01.046767] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-30T19:34:01.046909] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-30T19:34:01.047006] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KMI took 33.8s. Estimated remaining: 2h 30m 7s. Rate: 7.8 symbols/min [2025-10-30T19:34:01.153395] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-30T19:34:01.297516] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-30T19:34:01.825992] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-30T19:34:02.097515] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-30T19:34:02.897550] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-30T19:34:03.071269] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T19:34:03.272467] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-30T19:34:03.273777] [INFO ] [REMOTE ] KMPB: Full fetch complete (4893 records). [2025-10-30T19:34:03.273849] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-30T19:34:03.623015] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-30T19:34:03.623115] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-30T19:34:03.623267] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-30T19:34:03.623306] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-30T19:34:03.623688] [DEBUG] [LOCAL ] KMPB: Trimmed 4893 records to 3403 (keeping 200 days of data) [2025-10-30T19:34:03.643827] [DEBUG] [LOCAL ] KMPB: Primary data saved (3403 records). [2025-10-30T19:34:03.643903] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-30T19:34:03.643972] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KMPB took 27.9s. Estimated remaining: 2h 29m 55s. Rate: 7.8 symbols/min [2025-10-30T19:34:03.697475] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-30T19:34:04.638025] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T19:34:04.646268] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-30T19:34:05.778572] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T19:34:05.787477] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-30T19:34:07.029511] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T19:34:07.039391] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-30T19:34:08.208091] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T19:34:08.218176] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-30T19:34:09.479634] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T19:34:09.489594] [INFO ] [REMOTE ] KMPR: Full fetch complete (54216 records). [2025-10-30T19:34:09.489772] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-30T19:34:09.863115] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-30T19:34:09.863190] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-30T19:34:09.864028] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-30T19:34:09.864091] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-30T19:34:09.865301] [DEBUG] [LOCAL ] KMPR: Trimmed 54216 records to 40881 (keeping 200 days of data) [2025-10-30T19:34:10.100567] [DEBUG] [LOCAL ] KMPR: Primary data saved (40881 records). [2025-10-30T19:34:10.100707] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-30T19:34:10.100792] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMPR took 23.8s. Estimated remaining: 2h 29m 46s. Rate: 7.8 symbols/min [2025-10-30T19:34:10.655047] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:10.726047] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:10.792256] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:10.788739] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:10.838998] [DEBUG] [LOCAL ] KN: Loaded 38099 existing records from primary storage. [2025-10-30T19:34:10.857382] [INFO ] [MAIN ] KN: Loaded 38099 existing records. [2025-10-30T19:34:10.895343] [DEBUG] [LOCAL ] KNF: Loaded 36648 existing records from primary storage. [2025-10-30T19:34:10.919054] [INFO ] [MAIN ] KNF: Loaded 36648 existing records. [2025-10-30T19:34:11.052949] [DEBUG] [LOCAL ] KMT: Loaded 42323 existing records from primary storage. [2025-10-30T19:34:11.141255] [DEBUG] [LOCAL ] KMX: Loaded 53283 existing records from primary storage. [2025-10-30T19:34:11.116741] [INFO ] [MAIN ] KMT: Loaded 42323 existing records. [2025-10-30T19:34:11.157639] [INFO ] [MAIN ] KMX: Loaded 53283 existing records. [2025-10-30T19:34:11.384288] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:11.369955] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:11.411570] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-30T19:34:11.429298] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-30T19:34:11.453674] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-30T19:34:11.474502] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-30T19:34:11.503027] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-30T19:34:11.508254] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-30T19:34:11.550908] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-30T19:34:11.556520] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-30T19:34:11.814497] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:11.872263] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-30T19:34:11.879340] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-30T19:34:11.887634] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:11.888211] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-30T19:34:11.919388] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-30T19:34:11.935879] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-30T19:34:11.898507] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-30T19:34:11.968501] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-30T19:34:11.968621] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-30T19:34:12.983569] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:13.035445] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:13.035835] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-30T19:34:13.036081] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-30T19:34:13.195887] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:13.191992] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:13.196220] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-30T19:34:13.196488] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-30T19:34:14.177736] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T19:34:14.185350] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-30T19:34:14.187205] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T19:34:14.193851] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-30T19:34:14.547815] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T19:34:14.557821] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-30T19:34:14.732887] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-30T19:34:14.740845] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-30T19:34:14.995489] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T19:34:15.002015] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-30T19:34:15.168400] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T19:34:15.177315] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-30T19:34:15.747130] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T19:34:15.756986] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-30T19:34:15.809181] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T19:34:15.935466] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-30T19:34:16.092191] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-30T19:34:16.497552] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-30T19:34:17.041414] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T19:34:17.297538] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-30T19:34:17.578778] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T19:34:18.097506] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-30T19:34:18.416202] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T19:34:18.897469] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-30T19:34:19.082772] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T19:34:19.697517] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-30T19:34:20.360193] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T19:34:20.497488] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-30T19:34:20.812366] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-30T19:34:21.297523] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-30T19:34:21.612861] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T19:34:22.097516] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-30T19:34:22.220418] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T19:34:22.897522] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-30T19:34:23.162978] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T19:34:23.697477] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-30T19:34:23.765941] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-30T19:34:24.497532] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-30T19:34:24.645462] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-30T19:34:25.297520] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-30T19:34:25.712160] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T19:34:26.097468] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-30T19:34:26.216837] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T19:34:26.897487] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-30T19:34:27.077986] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-30T19:34:27.682146] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T19:34:27.697446] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-30T19:34:28.497463] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-30T19:34:28.679502] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-30T19:34:29.297575] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-30T19:34:29.519109] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T19:34:30.097513] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-30T19:34:30.625356] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T19:34:30.897470] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-30T19:34:31.043496] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T19:34:31.697529] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-30T19:34:32.126367] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-30T19:34:32.135689] [INFO ] [REMOTE ] KNF: Full fetch complete (51686 records). [2025-10-30T19:34:32.135817] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-30T19:34:32.501209] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-30T19:34:32.517454] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-30T19:34:32.517534] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-30T19:34:32.519062] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-30T19:34:32.519180] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-30T19:34:32.520349] [DEBUG] [LOCAL ] KNF: Trimmed 51686 records to 36957 (keeping 200 days of data) [2025-10-30T19:34:32.730478] [DEBUG] [LOCAL ] KNF: Primary data saved (36957 records). [2025-10-30T19:34:32.730606] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-30T19:34:32.730709] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KNF took 22.6s. Estimated remaining: 2h 29m 52s. Rate: 7.8 symbols/min [2025-10-30T19:34:32.903518] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:32.914745] [DEBUG] [LOCAL ] KNOP: Loaded 9737 existing records from primary storage. [2025-10-30T19:34:32.914947] [INFO ] [MAIN ] KNOP: Loaded 9737 existing records. [2025-10-30T19:34:33.097844] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:33.098267] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-30T19:34:33.098372] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-30T19:34:33.098675] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-30T19:34:33.098750] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-30T19:34:33.303940] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-30T19:34:33.511801] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:33.515729] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-30T19:34:33.651830] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:34:34.097534] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-30T19:34:34.475907] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-30T19:34:34.824205] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-30T19:34:34.897528] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-30T19:34:35.697525] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-30T19:34:36.086136] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T19:34:36.497492] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-30T19:34:36.952685] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T19:34:37.297497] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-30T19:34:37.739427] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T19:34:37.748430] [INFO ] [REMOTE ] KN: Full fetch complete (56882 records). [2025-10-30T19:34:37.748553] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-30T19:34:37.860114] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-30T19:34:38.102690] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-30T19:34:38.156488] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-30T19:34:38.156597] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-30T19:34:38.157513] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-30T19:34:38.157577] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-30T19:34:38.158773] [DEBUG] [LOCAL ] KN: Trimmed 56882 records to 38395 (keeping 200 days of data) [2025-10-30T19:34:38.383704] [DEBUG] [LOCAL ] KN: Primary data saved (38395 records). [2025-10-30T19:34:38.383834] [INFO ] [MAIN ] KN: Full history saved. [2025-10-30T19:34:38.383911] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KN took 28.3s. Estimated remaining: 2h 29m 43s. Rate: 7.8 symbols/min [2025-10-30T19:34:38.571822] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:38.588978] [DEBUG] [LOCAL ] KNSL: Loaded 18670 existing records from primary storage. [2025-10-30T19:34:38.589208] [INFO ] [MAIN ] KNSL: Loaded 18670 existing records. [2025-10-30T19:34:38.782692] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:38.782927] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-30T19:34:38.782975] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-30T19:34:38.783226] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-30T19:34:38.783268] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-30T19:34:38.900860] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-30T19:34:39.172770] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:39.324274] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-30T19:34:39.697513] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-30T19:34:40.352888] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-30T19:34:40.497505] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-30T19:34:40.934171] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T19:34:40.945608] [INFO ] [REMOTE ] KMT: Full fetch complete (61820 records). [2025-10-30T19:34:40.945871] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-30T19:34:41.302787] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-30T19:34:41.330180] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-30T19:34:41.330309] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-30T19:34:41.331581] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-30T19:34:41.331728] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-30T19:34:41.333243] [DEBUG] [LOCAL ] KMT: Trimmed 61820 records to 42640 (keeping 200 days of data) [2025-10-30T19:34:41.456465] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-30T19:34:41.605431] [DEBUG] [LOCAL ] KMT: Primary data saved (42640 records). [2025-10-30T19:34:41.605554] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-30T19:34:41.605631] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KMT took 31.5s. Estimated remaining: 2h 29m 31s. Rate: 7.8 symbols/min [2025-10-30T19:34:41.771148] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:41.813923] [DEBUG] [LOCAL ] KNTK: Loaded 47161 existing records from primary storage. [2025-10-30T19:34:41.814203] [INFO ] [MAIN ] KNTK: Loaded 47161 existing records. [2025-10-30T19:34:41.988349] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:41.988533] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-30T19:34:41.988579] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-30T19:34:41.988836] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-30T19:34:41.988891] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-30T19:34:42.102751] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-30T19:34:42.344793] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:42.897479] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-30T19:34:42.934899] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T19:34:42.947150] [INFO ] [REMOTE ] KMX: Full fetch complete (76472 records). [2025-10-30T19:34:42.947303] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-30T19:34:43.110182] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T19:34:43.354719] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-30T19:34:43.354819] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-30T19:34:43.355866] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-30T19:34:43.355929] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-30T19:34:43.357519] [DEBUG] [LOCAL ] KMX: Trimmed 76472 records to 53673 (keeping 200 days of data) [2025-10-30T19:34:43.471613] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-30T19:34:43.687781] [DEBUG] [LOCAL ] KMX: Primary data saved (53673 records). [2025-10-30T19:34:43.687915] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-30T19:34:43.687996] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KMX took 33.6s. Estimated remaining: 2h 29m 17s. Rate: 7.8 symbols/min [2025-10-30T19:34:43.702605] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-30T19:34:43.860891] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:43.906899] [DEBUG] [LOCAL ] KNX: Loaded 52638 existing records from primary storage. [2025-10-30T19:34:43.907228] [INFO ] [MAIN ] KNX: Loaded 52638 existing records. [2025-10-30T19:34:44.083619] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:44.083846] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-30T19:34:44.083894] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-30T19:34:44.084194] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-30T19:34:44.084255] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-30T19:34:44.431923] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:44.497477] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-30T19:34:45.027959] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T19:34:45.297494] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-30T19:34:45.711277] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-30T19:34:45.745486] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-30T19:34:46.097490] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-30T19:34:46.721324] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-30T19:34:46.897473] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-30T19:34:47.629059] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-30T19:34:47.697463] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-30T19:34:48.366755] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T19:34:48.497550] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-30T19:34:49.188478] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T19:34:49.297578] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-30T19:34:49.856596] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T19:34:50.097538] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-30T19:34:50.671455] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-30T19:34:50.897475] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-30T19:34:51.697475] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-30T19:34:51.716374] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T19:34:52.248935] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-30T19:34:52.497531] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-30T19:34:53.112516] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T19:34:53.297505] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-30T19:34:53.764122] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-30T19:34:54.097492] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-30T19:34:54.897492] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-30T19:34:55.319696] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T19:34:55.337241] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-30T19:34:55.697536] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-30T19:34:56.387969] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-30T19:34:56.497475] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-30T19:34:57.210152] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T19:34:57.213783] [INFO ] [REMOTE ] KNOP: Full fetch complete (14647 records). [2025-10-30T19:34:57.213918] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-30T19:34:57.302744] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-30T19:34:57.618664] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-30T19:34:57.618764] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-30T19:34:57.619118] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-30T19:34:57.619160] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-30T19:34:57.619703] [DEBUG] [LOCAL ] KNOP: Trimmed 14647 records to 9800 (keeping 200 days of data) [2025-10-30T19:34:57.677018] [DEBUG] [LOCAL ] KNOP: Primary data saved (9800 records). [2025-10-30T19:34:57.677142] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-30T19:34:57.677218] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNOP took 24.9s. Estimated remaining: 2h 29m 16s. Rate: 7.8 symbols/min [2025-10-30T19:34:57.843441] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:57.843625] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-30T19:34:57.843705] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-30T19:34:57.843835] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-30T19:34:57.843876] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-30T19:34:57.843916] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-30T19:34:57.843948] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-30T19:34:58.103422] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-30T19:34:58.195899] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:58.349501] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T19:34:58.354856] [INFO ] [REMOTE ] KNSL: Full fetch complete (27414 records). [2025-10-30T19:34:58.354940] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-30T19:34:58.738134] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-30T19:34:58.738212] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-30T19:34:58.738807] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-30T19:34:58.738867] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-30T19:34:58.739504] [DEBUG] [LOCAL ] KNSL: Trimmed 27414 records to 18874 (keeping 200 days of data) [2025-10-30T19:34:58.857589] [DEBUG] [LOCAL ] KNSL: Primary data saved (18874 records). [2025-10-30T19:34:58.857765] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-30T19:34:58.857850] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNSL took 20.5s. Estimated remaining: 2h 29m 2s. Rate: 7.8 symbols/min [2025-10-30T19:34:58.902609] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-30T19:34:59.031663] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:34:59.061011] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T19:34:59.095954] [DEBUG] [LOCAL ] KODK: Loaded 43360 existing records from primary storage. [2025-10-30T19:34:59.096250] [INFO ] [MAIN ] KODK: Loaded 43360 existing records. [2025-10-30T19:34:59.284156] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:34:59.284354] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-30T19:34:59.284401] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-30T19:34:59.284689] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-30T19:34:59.284747] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-30T19:34:59.654042] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:34:59.697473] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-30T19:35:00.497507] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-30T19:35:01.256528] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-30T19:35:01.300021] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-30T19:35:01.307736] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-30T19:35:02.097545] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-30T19:35:02.544804] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-30T19:35:02.760943] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-30T19:35:02.897511] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-30T19:35:03.697695] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-30T19:35:04.088620] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-30T19:35:04.245125] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T19:35:04.497498] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-30T19:35:04.931982] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:35:05.297505] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-30T19:35:05.662062] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T19:35:06.097513] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-30T19:35:06.897503] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-30T19:35:07.256491] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-30T19:35:07.397492] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T19:35:07.697498] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-30T19:35:08.032513] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T19:35:08.497538] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-30T19:35:08.875177] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-30T19:35:09.297504] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-30T19:35:10.097717] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-30T19:35:10.517986] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-30T19:35:10.643945] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T19:35:10.897492] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-30T19:35:11.070536] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T19:35:11.697476] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-30T19:35:12.036367] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T19:35:12.497462] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-30T19:35:12.633021] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-30T19:35:13.297500] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-30T19:35:14.097558] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-30T19:35:14.372839] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-30T19:35:14.427102] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-30T19:35:14.897512] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-30T19:35:15.344326] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T19:35:15.697545] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-30T19:35:16.073504] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T19:35:16.497502] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-30T19:35:17.297500] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-30T19:35:17.611435] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-30T19:35:18.097794] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T19:35:18.097865] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-30T19:35:18.112542] [INFO ] [REMOTE ] KNX: Full fetch complete (76359 records). [2025-10-30T19:35:18.112811] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-30T19:35:18.593036] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-30T19:35:18.593234] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-30T19:35:18.594274] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-30T19:35:18.594355] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-30T19:35:18.623303] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-30T19:35:18.633137] [DEBUG] [LOCAL ] KNX: Trimmed 76359 records to 53028 (keeping 200 days of data) [2025-10-30T19:35:18.905021] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-30T19:35:18.951251] [DEBUG] [LOCAL ] KNX: Primary data saved (53028 records). [2025-10-30T19:35:18.951394] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-30T19:35:18.952332] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNX took 35.3s. Estimated remaining: 2h 29m 6s. Rate: 7.8 symbols/min [2025-10-30T19:35:19.123168] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:35:19.149031] [DEBUG] [LOCAL ] KOF: Loaded 26019 existing records from primary storage. [2025-10-30T19:35:19.149274] [INFO ] [MAIN ] KOF: Loaded 26019 existing records. [2025-10-30T19:35:19.325965] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:35:19.326187] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-30T19:35:19.326234] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-30T19:35:19.326585] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-30T19:35:19.326683] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-30T19:35:19.690825] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:35:19.697521] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-30T19:35:20.075137] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T19:35:20.223304] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-30T19:35:20.497514] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-30T19:35:21.116146] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T19:35:21.127124] [INFO ] [REMOTE ] KNTK: Full fetch complete (66325 records). [2025-10-30T19:35:21.127233] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-30T19:35:21.309464] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-30T19:35:21.566276] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-30T19:35:21.566456] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-30T19:35:21.567824] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-30T19:35:21.568059] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-30T19:35:21.569960] [DEBUG] [LOCAL ] KNTK: Trimmed 66325 records to 47507 (keeping 200 days of data) [2025-10-30T19:35:21.693425] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-30T19:35:21.906471] [DEBUG] [LOCAL ] KNTK: Primary data saved (47507 records). [2025-10-30T19:35:21.906661] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-30T19:35:21.906763] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KNTK took 40.3s. Estimated remaining: 2h 28m 54s. Rate: 7.8 symbols/min [2025-10-30T19:35:22.084289] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:35:22.100347] [DEBUG] [LOCAL ] KOP: Loaded 17140 existing records from primary storage. [2025-10-30T19:35:22.100837] [INFO ] [MAIN ] KOP: Loaded 17140 existing records. [2025-10-30T19:35:22.100532] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-30T19:35:22.294756] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:35:22.294996] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-30T19:35:22.295046] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-30T19:35:22.295302] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-30T19:35:22.295360] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-30T19:35:22.651472] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:35:22.897511] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-30T19:35:23.389767] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-30T19:35:23.436860] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-30T19:35:23.697500] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-30T19:35:23.951727] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T19:35:24.499149] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-30T19:35:24.503388] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T19:35:25.297502] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-30T19:35:26.097479] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-30T19:35:26.199089] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T19:35:26.401083] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-30T19:35:26.898205] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-30T19:35:26.900146] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-30T19:35:27.697513] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-30T19:35:28.119560] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T19:35:28.497483] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-30T19:35:29.096932] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-30T19:35:29.297497] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-30T19:35:29.970613] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-30T19:35:29.982418] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-30T19:35:29.982575] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-30T19:35:30.102636] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-30T19:35:30.187260] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-30T19:35:30.187995] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:35:30.188066] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:35:30.188139] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-30T19:35:30.188209] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-30T19:35:30.188245] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-30T19:35:30.188283] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-30T19:35:30.188363] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KO took 32.5s. Estimated remaining: 2h 28m 47s. Rate: 7.8 symbols/min [2025-10-30T19:35:30.354083] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:35:30.358589] [DEBUG] [LOCAL ] KORE: Loaded 2303 existing records from primary storage. [2025-10-30T19:35:30.359162] [INFO ] [MAIN ] KORE: Loaded 2303 existing records. [2025-10-30T19:35:30.567770] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:35:30.568096] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-30T19:35:30.568241] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-30T19:35:30.568490] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-30T19:35:30.568562] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-30T19:35:30.710059] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T19:35:30.907058] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-30T19:35:30.990586] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:35:31.006377] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-30T19:35:31.697541] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-30T19:35:32.116114] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T19:35:32.402965] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-30T19:35:32.497471] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-30T19:35:32.828599] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-30T19:35:33.297465] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-30T19:35:34.097538] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-30T19:35:34.150712] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-30T19:35:34.300068] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-10-30T19:35:34.897532] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-30T19:35:35.172331] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-30T19:35:35.697507] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-30T19:35:35.970721] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-30T19:35:36.497573] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-30T19:35:37.297566] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-30T19:35:37.385745] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-30T19:35:37.637091] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-30T19:35:38.097537] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-30T19:35:38.437330] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-30T19:35:38.897504] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-30T19:35:39.697558] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-30T19:35:40.256887] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-30T19:35:40.266959] [INFO ] [REMOTE ] KODK: Full fetch complete (63159 records). [2025-10-30T19:35:40.267252] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-30T19:35:40.344581] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-30T19:35:40.497596] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-30T19:35:40.697300] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-30T19:35:40.697376] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-30T19:35:40.698252] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-30T19:35:40.698314] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-30T19:35:40.699447] [DEBUG] [LOCAL ] KODK: Trimmed 63159 records to 43618 (keeping 200 days of data) [2025-10-30T19:35:40.890764] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-30T19:35:40.942702] [DEBUG] [LOCAL ] KODK: Primary data saved (43618 records). [2025-10-30T19:35:40.942834] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-30T19:35:40.943592] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KODK took 42.1s. Estimated remaining: 2h 28m 42s. Rate: 7.8 symbols/min [2025-10-30T19:35:41.116253] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:35:41.168908] [DEBUG] [LOCAL ] KOS: Loaded 53089 existing records from primary storage. [2025-10-30T19:35:41.169219] [INFO ] [MAIN ] KOS: Loaded 53089 existing records. [2025-10-30T19:35:41.305022] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-30T19:35:41.344883] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:35:41.345354] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-30T19:35:41.345420] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-30T19:35:41.345912] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-30T19:35:41.345972] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-30T19:35:41.696756] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T19:35:41.709359] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:35:42.097510] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-30T19:35:42.583639] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-30T19:35:42.585606] [INFO ] [REMOTE ] KORE: Full fetch complete (3685 records). [2025-10-30T19:35:42.585723] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-30T19:35:42.902853] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-30T19:35:42.983155] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-30T19:35:42.983237] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-30T19:35:42.983394] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-30T19:35:42.983435] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-30T19:35:42.983823] [DEBUG] [LOCAL ] KORE: Trimmed 3685 records to 2327 (keeping 200 days of data) [2025-10-30T19:35:42.996735] [DEBUG] [LOCAL ] KORE: Primary data saved (2327 records). [2025-10-30T19:35:42.996807] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-30T19:35:42.996881] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KORE took 12.8s. Estimated remaining: 2h 28m 29s. Rate: 7.8 symbols/min [2025-10-30T19:35:43.169471] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:35:43.218285] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-30T19:35:43.218682] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-30T19:35:43.396750] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:35:43.396972] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-30T19:35:43.397021] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-30T19:35:43.397463] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-30T19:35:43.397525] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-30T19:35:43.698082] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-30T19:35:43.764711] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:35:43.803992] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T19:35:44.497558] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-30T19:35:45.171007] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-30T19:35:45.204041] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T19:35:45.297473] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-30T19:35:46.097501] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-30T19:35:46.548092] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T19:35:46.897510] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-30T19:35:46.946707] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T19:35:47.697577] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-30T19:35:48.196035] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:35:48.346281] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-30T19:35:48.497519] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-30T19:35:49.206103] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-30T19:35:49.297465] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-30T19:35:49.928232] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-30T19:35:50.097494] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-30T19:35:50.897535] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-30T19:35:51.394036] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T19:35:51.690908] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T19:35:51.697443] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-30T19:35:52.497515] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-30T19:35:52.623304] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-30T19:35:53.153003] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T19:35:53.297504] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-30T19:35:54.097499] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-30T19:35:54.631093] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T19:35:54.897542] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-30T19:35:55.371242] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T19:35:55.544505] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T19:35:55.548698] [INFO ] [REMOTE ] KOP: Full fetch complete (25386 records). [2025-10-30T19:35:55.548775] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-30T19:35:55.701728] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-30T19:35:55.953401] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-30T19:35:55.953479] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-30T19:35:55.954092] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-30T19:35:55.954156] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-30T19:35:55.954812] [DEBUG] [LOCAL ] KOP: Trimmed 25386 records to 17265 (keeping 200 days of data) [2025-10-30T19:35:56.065233] [DEBUG] [LOCAL ] KOP: Primary data saved (17265 records). [2025-10-30T19:35:56.065368] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-30T19:35:56.065447] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KOP took 34.2s. Estimated remaining: 2h 28m 26s. Rate: 7.8 symbols/min [2025-10-30T19:35:56.239154] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:35:56.285475] [DEBUG] [LOCAL ] KRC: Loaded 47935 existing records from primary storage. [2025-10-30T19:35:56.285808] [INFO ] [MAIN ] KRC: Loaded 47935 existing records. [2025-10-30T19:35:56.468616] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:35:56.468911] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-30T19:35:56.468972] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-30T19:35:56.469364] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-30T19:35:56.469406] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-30T19:35:56.502995] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-30T19:35:56.866564] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:35:56.871252] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:35:56.877576] [INFO ] [REMOTE ] KOF: Full fetch complete (37817 records). [2025-10-30T19:35:56.877696] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-30T19:35:57.251332] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-30T19:35:57.251407] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-30T19:35:57.252088] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-30T19:35:57.252149] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-30T19:35:57.252972] [DEBUG] [LOCAL ] KOF: Trimmed 37817 records to 26181 (keeping 200 days of data) [2025-10-30T19:35:57.308126] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-30T19:35:57.413952] [DEBUG] [LOCAL ] KOF: Primary data saved (26181 records). [2025-10-30T19:35:57.414079] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-30T19:35:57.414157] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KOF took 38.5s. Estimated remaining: 2h 28m 12s. Rate: 7.8 symbols/min [2025-10-30T19:35:57.583274] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:35:57.618738] [DEBUG] [LOCAL ] KREF: Loaded 37720 existing records from primary storage. [2025-10-30T19:35:57.619010] [INFO ] [MAIN ] KREF: Loaded 37720 existing records. [2025-10-30T19:35:57.796885] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:35:57.797202] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-30T19:35:57.797538] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-30T19:35:57.797859] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-30T19:35:57.797948] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-30T19:35:58.005250] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T19:35:58.102669] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-30T19:35:58.197951] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:35:58.763099] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-30T19:35:58.897515] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-30T19:35:59.440005] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:35:59.697477] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-30T19:35:59.793392] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-30T19:36:00.497521] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-30T19:36:01.305628] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-30T19:36:01.326145] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-30T19:36:02.097466] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-30T19:36:02.166961] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-30T19:36:02.195035] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-30T19:36:02.897549] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-30T19:36:03.214001] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T19:36:03.697549] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-30T19:36:04.320778] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T19:36:04.497501] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-30T19:36:05.031336] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T19:36:05.297493] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-30T19:36:05.541333] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T19:36:06.097502] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-30T19:36:06.523546] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-30T19:36:06.897456] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-30T19:36:07.117434] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T19:36:07.697485] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-30T19:36:08.053727] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-30T19:36:08.497506] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-30T19:36:09.020609] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T19:36:09.297486] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-30T19:36:09.885979] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:36:10.097495] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-30T19:36:10.634730] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T19:36:10.897481] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-30T19:36:11.567629] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-30T19:36:11.580744] [INFO ] [REMOTE ] KOS: Full fetch complete (77029 records). [2025-10-30T19:36:11.580937] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-30T19:36:11.702721] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-30T19:36:12.056940] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-30T19:36:12.057071] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-30T19:36:12.058568] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-30T19:36:12.058695] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-30T19:36:12.060840] [DEBUG] [LOCAL ] KOS: Trimmed 77029 records to 53472 (keeping 200 days of data) [2025-10-30T19:36:12.308997] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T19:36:12.451230] [DEBUG] [LOCAL ] KOS: Primary data saved (53472 records). [2025-10-30T19:36:12.451400] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-30T19:36:12.452142] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KOS took 31.5s. Estimated remaining: 2h 28m 11s. Rate: 7.8 symbols/min [2025-10-30T19:36:12.503563] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-30T19:36:12.701989] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:12.724796] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T19:36:12.773518] [DEBUG] [LOCAL ] KRG: Loaded 49210 existing records from primary storage. [2025-10-30T19:36:12.773967] [INFO ] [MAIN ] KRG: Loaded 49210 existing records. [2025-10-30T19:36:12.963945] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:36:12.964164] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-30T19:36:12.964212] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-30T19:36:12.964775] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-30T19:36:12.964835] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-30T19:36:13.305274] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-30T19:36:13.354779] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:13.903829] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T19:36:14.097548] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-30T19:36:14.352621] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T19:36:14.897505] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-30T19:36:15.653252] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-30T19:36:15.697459] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-30T19:36:15.973696] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T19:36:16.497502] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-30T19:36:17.297471] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-30T19:36:17.390535] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-30T19:36:17.442193] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T19:36:17.454434] [INFO ] [REMOTE ] KR: Full fetch complete (77844 records). [2025-10-30T19:36:17.454605] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-30T19:36:17.913194] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-30T19:36:17.913292] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-30T19:36:17.914495] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-30T19:36:17.914563] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-30T19:36:17.916167] [DEBUG] [LOCAL ] KR: Trimmed 77844 records to 54071 (keeping 200 days of data) [2025-10-30T19:36:18.103930] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-30T19:36:18.249994] [DEBUG] [LOCAL ] KR: Primary data saved (54071 records). [2025-10-30T19:36:18.250147] [INFO ] [MAIN ] KR: Full history saved. [2025-10-30T19:36:18.250838] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KR took 35.3s. Estimated remaining: 2h 28m 2s. Rate: 7.8 symbols/min [2025-10-30T19:36:18.452672] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:18.453058] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-30T19:36:18.453158] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-30T19:36:18.453351] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-30T19:36:18.453448] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-30T19:36:18.453608] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-30T19:36:18.453771] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-30T19:36:18.708092] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T19:36:18.853957] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:18.897458] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-30T19:36:19.032529] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T19:36:19.032888] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-30T19:36:19.032977] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:36:19.033022] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-30T19:36:19.033055] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:36:19.033091] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-30T19:36:19.033144] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-30T19:36:19.033176] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-30T19:36:19.033214] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-30T19:36:19.033258] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KRMN took 0.8s. Estimated remaining: 2h 27m 48s. Rate: 7.8 symbols/min [2025-10-30T19:36:19.205134] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:19.231944] [DEBUG] [LOCAL ] KRO: Loaded 26472 existing records from primary storage. [2025-10-30T19:36:19.232194] [INFO ] [MAIN ] KRO: Loaded 26472 existing records. [2025-10-30T19:36:19.415051] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:36:19.415493] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-30T19:36:19.415557] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-30T19:36:19.425409] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-30T19:36:19.431185] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-30T19:36:19.533753] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T19:36:19.702763] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-30T19:36:19.809120] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:20.497500] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-30T19:36:20.733465] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T19:36:21.297507] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-30T19:36:21.554206] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:36:22.097514] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-30T19:36:22.403078] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-30T19:36:22.899356] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-30T19:36:22.903629] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-30T19:36:23.697550] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-30T19:36:24.166713] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T19:36:24.497507] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-30T19:36:24.921348] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T19:36:25.297484] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-30T19:36:25.694941] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-30T19:36:25.704082] [INFO ] [REMOTE ] KREF: Full fetch complete (53176 records). [2025-10-30T19:36:25.704181] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-30T19:36:26.084225] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-30T19:36:26.084314] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-30T19:36:26.085116] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-30T19:36:26.085180] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-30T19:36:26.086349] [DEBUG] [LOCAL ] KREF: Trimmed 53176 records to 38100 (keeping 200 days of data) [2025-10-30T19:36:26.136684] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-30T19:36:26.307598] [DEBUG] [LOCAL ] KREF: Primary data saved (38100 records). [2025-10-30T19:36:26.307749] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-30T19:36:26.307832] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KREF took 28.9s. Estimated remaining: 2h 27m 40s. Rate: 7.8 symbols/min [2025-10-30T19:36:26.474768] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:26.509341] [DEBUG] [LOCAL ] KRP: Loaded 35423 existing records from primary storage. [2025-10-30T19:36:26.509604] [INFO ] [MAIN ] KRP: Loaded 35423 existing records. [2025-10-30T19:36:26.697861] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:36:26.698681] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-30T19:36:26.698992] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-30T19:36:26.699306] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-30T19:36:26.699375] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-30T19:36:26.863385] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:36:26.919320] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-30T19:36:27.075603] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-30T19:36:27.170220] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:27.697497] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-30T19:36:28.216082] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T19:36:28.497519] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-30T19:36:28.858056] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T19:36:29.297594] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-30T19:36:29.729476] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-30T19:36:30.097519] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-30T19:36:30.563917] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T19:36:30.897497] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-30T19:36:31.321062] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-30T19:36:31.331473] [INFO ] [REMOTE ] KRC: Full fetch complete (70076 records). [2025-10-30T19:36:31.331590] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-30T19:36:31.703798] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-30T19:36:31.701958] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-30T19:36:31.797332] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-30T19:36:31.797479] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-30T19:36:31.799279] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-30T19:36:31.799704] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-30T19:36:31.802759] [DEBUG] [LOCAL ] KRC: Trimmed 70076 records to 48251 (keeping 200 days of data) [2025-10-30T19:36:32.095361] [DEBUG] [LOCAL ] KRC: Primary data saved (48251 records). [2025-10-30T19:36:32.095510] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-30T19:36:32.095593] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KRC took 36.0s. Estimated remaining: 2h 27m 30s. Rate: 7.8 symbols/min [2025-10-30T19:36:32.263322] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:32.311311] [DEBUG] [LOCAL ] KSS: Loaded 53570 existing records from primary storage. [2025-10-30T19:36:32.311672] [INFO ] [MAIN ] KSS: Loaded 53570 existing records. [2025-10-30T19:36:32.489520] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:36:32.489775] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-30T19:36:32.489827] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-30T19:36:32.490329] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-30T19:36:32.490387] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-30T19:36:32.503853] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-30T19:36:32.849207] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:33.036629] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T19:36:33.297473] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-30T19:36:33.394978] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-30T19:36:34.097501] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-30T19:36:34.897475] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-30T19:36:35.043892] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-30T19:36:35.083914] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T19:36:35.697565] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-30T19:36:36.040138] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:36:36.497535] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-30T19:36:36.999283] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T19:36:37.297551] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-30T19:36:37.633205] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T19:36:38.097544] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-30T19:36:38.677069] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-30T19:36:38.897510] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-30T19:36:39.230262] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T19:36:39.697495] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-30T19:36:39.806155] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T19:36:40.497507] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-30T19:36:40.776026] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-30T19:36:41.297515] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-30T19:36:41.675042] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T19:36:42.097490] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-30T19:36:42.227282] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T19:36:42.897501] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-30T19:36:43.570840] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-30T19:36:43.697530] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-30T19:36:44.400055] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T19:36:44.417905] [INFO ] [REMOTE ] KRG: Full fetch complete (71489 records). [2025-10-30T19:36:44.425668] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-30T19:36:44.426900] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-30T19:36:44.503586] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-30T19:36:44.934819] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-30T19:36:44.934903] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-30T19:36:44.935967] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-30T19:36:44.936048] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-30T19:36:44.937597] [DEBUG] [LOCAL ] KRG: Trimmed 71489 records to 49575 (keeping 200 days of data) [2025-10-30T19:36:45.272917] [DEBUG] [LOCAL ] KRG: Primary data saved (49575 records). [2025-10-30T19:36:45.273046] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-30T19:36:45.273521] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRG took 32.8s. Estimated remaining: 2h 27m 27s. Rate: 7.8 symbols/min [2025-10-30T19:36:45.302741] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-30T19:36:45.445718] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:45.490408] [DEBUG] [LOCAL ] KT: Loaded 45035 existing records from primary storage. [2025-10-30T19:36:45.490756] [INFO ] [MAIN ] KT: Loaded 45035 existing records. [2025-10-30T19:36:45.663170] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:36:45.663368] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-30T19:36:45.663414] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-30T19:36:45.664102] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-30T19:36:45.664159] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-30T19:36:46.017934] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:46.067176] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-30T19:36:46.097456] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-30T19:36:46.582416] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-30T19:36:46.897532] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-30T19:36:47.536790] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-30T19:36:47.697493] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-30T19:36:47.960602] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:36:48.497571] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-30T19:36:49.003898] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-30T19:36:49.297537] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-30T19:36:49.369086] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T19:36:50.097517] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-30T19:36:50.355823] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T19:36:50.897515] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-30T19:36:50.966541] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T19:36:51.697522] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-30T19:36:52.137491] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-30T19:36:52.497480] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-30T19:36:52.668959] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-30T19:36:53.297509] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-30T19:36:53.654973] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T19:36:54.097477] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-30T19:36:54.174290] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T19:36:54.897474] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-30T19:36:54.939375] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-30T19:36:55.697535] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-30T19:36:55.965346] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-30T19:36:55.973373] [INFO ] [REMOTE ] KRP: Full fetch complete (54450 records). [2025-10-30T19:36:55.973537] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-30T19:36:56.403754] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-30T19:36:56.403858] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-30T19:36:56.404856] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-30T19:36:56.404937] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-30T19:36:56.406229] [DEBUG] [LOCAL ] KRP: Trimmed 54450 records to 35661 (keeping 200 days of data) [2025-10-30T19:36:56.498052] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-30T19:36:56.623845] [DEBUG] [LOCAL ] KRP: Primary data saved (35661 records). [2025-10-30T19:36:56.623991] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-30T19:36:56.624980] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KRP took 30.3s. Estimated remaining: 2h 27m 23s. Rate: 7.8 symbols/min [2025-10-30T19:36:56.793638] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:56.833305] [DEBUG] [LOCAL ] KTB: Loaded 39713 existing records from primary storage. [2025-10-30T19:36:56.833731] [INFO ] [MAIN ] KTB: Loaded 39713 existing records. [2025-10-30T19:36:57.013439] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:36:57.013811] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-30T19:36:57.013866] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-30T19:36:57.040160] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-30T19:36:57.040286] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-30T19:36:57.122016] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T19:36:57.302635] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-30T19:36:57.412939] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:58.110555] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-30T19:36:58.113463] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-30T19:36:58.302884] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-30T19:36:58.308814] [INFO ] [REMOTE ] KRO: Full fetch complete (35609 records). [2025-10-30T19:36:58.308898] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-30T19:36:58.679833] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-30T19:36:58.680135] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-30T19:36:58.680803] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-30T19:36:58.680864] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-30T19:36:58.681608] [DEBUG] [LOCAL ] KRO: Trimmed 35609 records to 26694 (keeping 200 days of data) [2025-10-30T19:36:58.829594] [DEBUG] [LOCAL ] KRO: Primary data saved (26694 records). [2025-10-30T19:36:58.829746] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-30T19:36:58.829852] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KRO took 39.8s. Estimated remaining: 2h 27m 10s. Rate: 7.8 symbols/min [2025-10-30T19:36:58.903326] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-30T19:36:58.998991] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:36:59.011611] [DEBUG] [LOCAL ] KTF: Loaded 11541 existing records from primary storage. [2025-10-30T19:36:59.011857] [INFO ] [MAIN ] KTF: Loaded 11541 existing records. [2025-10-30T19:36:59.193389] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:36:59.193797] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-30T19:36:59.193946] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-30T19:36:59.194278] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-30T19:36:59.194430] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-30T19:36:59.327041] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T19:36:59.594875] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:36:59.697524] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-30T19:37:00.481954] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-30T19:37:00.497467] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-30T19:37:01.297516] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-30T19:37:01.396565] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-30T19:37:02.097500] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-30T19:37:02.172704] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T19:37:02.679840] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-30T19:37:02.897540] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-30T19:37:03.697480] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-30T19:37:03.848362] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-30T19:37:04.041046] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:37:04.497568] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-30T19:37:04.884135] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T19:37:05.146063] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-30T19:37:05.297546] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-30T19:37:06.097518] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-30T19:37:06.524327] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T19:37:06.897489] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-30T19:37:07.254954] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T19:37:07.697514] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-30T19:37:07.955727] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-30T19:37:08.497496] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-30T19:37:08.692983] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-30T19:37:09.297460] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-30T19:37:09.513413] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T19:37:09.949764] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-30T19:37:10.097496] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-30T19:37:10.581489] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-30T19:37:10.897533] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-30T19:37:11.697473] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-30T19:37:11.888705] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-30T19:37:12.497505] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-30T19:37:13.306076] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-30T19:37:13.327992] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-30T19:37:13.341005] [INFO ] [REMOTE ] KSS: Full fetch complete (77731 records). [2025-10-30T19:37:13.341159] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-30T19:37:13.738860] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-30T19:37:13.738973] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-30T19:37:13.740112] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-30T19:37:13.740273] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-30T19:37:13.741931] [DEBUG] [LOCAL ] KSS: Trimmed 77731 records to 53957 (keeping 200 days of data) [2025-10-30T19:37:13.869388] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-30T19:37:13.911817] [INFO ] [REMOTE ] KT: Full fetch complete (66445 records). [2025-10-30T19:37:13.912069] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-30T19:37:14.102636] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-30T19:37:14.451076] [DEBUG] [LOCAL ] KSS: Primary data saved (53957 records). [2025-10-30T19:37:14.451545] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-30T19:37:14.452294] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KSS took 42.4s. Estimated remaining: 2h 27m 10s. Rate: 7.8 symbols/min [2025-10-30T19:37:14.726025] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-30T19:37:14.732477] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-30T19:37:14.753834] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-30T19:37:14.771873] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:37:14.772041] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-30T19:37:14.775254] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T19:37:14.781526] [DEBUG] [LOCAL ] KT: Trimmed 66445 records to 45343 (keeping 200 days of data) [2025-10-30T19:37:14.870716] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-30T19:37:14.907423] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-30T19:37:15.096471] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-30T19:37:15.111746] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-30T19:37:15.197629] [DEBUG] [LOCAL ] KT: Primary data saved (45343 records). [2025-10-30T19:37:15.214517] [INFO ] [MAIN ] KT: Full history saved. [2025-10-30T19:37:15.222023] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KT took 29.9s. Estimated remaining: 2h 26m 56s. Rate: 7.8 symbols/min [2025-10-30T19:37:15.489300] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:37:15.522305] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:37:15.522850] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-30T19:37:15.532302] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-30T19:37:15.532869] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T19:37:15.536421] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-30T19:37:15.536483] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-30T19:37:15.697986] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-30T19:37:15.942377] [DEBUG] [LOCAL ] KVYO: Loaded 50916 existing records from primary storage. [2025-10-30T19:37:15.953142] [INFO ] [MAIN ] KVYO: Loaded 50916 existing records. [2025-10-30T19:37:16.138872] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:37:16.302894] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:37:16.303171] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-30T19:37:16.303228] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-30T19:37:16.303841] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-30T19:37:16.303903] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-30T19:37:16.509458] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-30T19:37:16.764759] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:37:16.969580] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-30T19:37:17.192163] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T19:37:17.297448] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-30T19:37:18.097507] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-30T19:37:18.595750] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-30T19:37:18.629132] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-30T19:37:18.897478] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-30T19:37:19.573630] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T19:37:19.576896] [INFO ] [REMOTE ] KTF: Full fetch complete (17707 records). [2025-10-30T19:37:19.576971] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-30T19:37:19.702679] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-30T19:37:20.007254] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-30T19:37:20.007339] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-30T19:37:20.007872] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-30T19:37:20.007948] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-30T19:37:20.008501] [DEBUG] [LOCAL ] KTF: Trimmed 17707 records to 11700 (keeping 200 days of data) [2025-10-30T19:37:20.082943] [DEBUG] [LOCAL ] KTF: Primary data saved (11700 records). [2025-10-30T19:37:20.083092] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-30T19:37:20.083186] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KTF took 21.3s. Estimated remaining: 2h 26m 45s. Rate: 7.8 symbols/min [2025-10-30T19:37:20.285574] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:37:20.326857] [DEBUG] [LOCAL ] KW: Loaded 39905 existing records from primary storage. [2025-10-30T19:37:20.327164] [INFO ] [MAIN ] KW: Loaded 39905 existing records. [2025-10-30T19:37:20.505388] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-30T19:37:20.532789] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:37:20.533930] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-30T19:37:20.533993] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-30T19:37:20.534377] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-30T19:37:20.534435] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-30T19:37:20.968514] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:37:20.993884] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-30T19:37:21.297503] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-30T19:37:21.867164] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-30T19:37:22.097486] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-30T19:37:22.369456] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T19:37:22.897516] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-30T19:37:23.432624] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-30T19:37:23.697475] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-30T19:37:23.874843] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T19:37:24.497520] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-30T19:37:25.112001] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-30T19:37:25.297512] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-30T19:37:25.420325] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-30T19:37:26.097488] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-30T19:37:26.522084] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T19:37:26.897546] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-30T19:37:27.377846] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-30T19:37:27.702757] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-30T19:37:27.712449] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-30T19:37:28.497501] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-30T19:37:28.970684] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-30T19:37:29.297469] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-30T19:37:29.464496] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T19:37:30.097500] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-30T19:37:30.558572] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T19:37:30.897482] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-30T19:37:31.065528] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-30T19:37:31.073256] [INFO ] [REMOTE ] KTB: Full fetch complete (58113 records). [2025-10-30T19:37:31.073387] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-30T19:37:31.442783] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-30T19:37:31.442860] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-30T19:37:31.443695] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-30T19:37:31.443755] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-30T19:37:31.444848] [DEBUG] [LOCAL ] KTB: Trimmed 58113 records to 39923 (keeping 200 days of data) [2025-10-30T19:37:31.682873] [DEBUG] [LOCAL ] KTB: Primary data saved (39923 records). [2025-10-30T19:37:31.683005] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-30T19:37:31.683754] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KTB took 35.1s. Estimated remaining: 2h 26m 41s. Rate: 7.8 symbols/min [2025-10-30T19:37:31.707808] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-30T19:37:31.897160] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:37:31.915177] [DEBUG] [LOCAL ] KWR: Loaded 15294 existing records from primary storage. [2025-10-30T19:37:31.915502] [INFO ] [MAIN ] KWR: Loaded 15294 existing records. [2025-10-30T19:37:32.138118] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:37:32.149225] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-30T19:37:32.149828] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-30T19:37:32.150896] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-30T19:37:32.160280] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-30T19:37:32.160506] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-30T19:37:32.502595] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-30T19:37:32.588012] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:37:33.234100] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T19:37:33.297480] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-30T19:37:33.454020] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-30T19:37:34.097476] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-30T19:37:34.662375] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-30T19:37:34.897499] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-30T19:37:35.443571] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T19:37:35.697545] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-30T19:37:35.930224] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T19:37:36.497506] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-30T19:37:37.297484] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-30T19:37:37.404380] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-30T19:37:37.557988] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T19:37:37.951553] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-30T19:37:38.097461] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-30T19:37:38.897504] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-30T19:37:39.697533] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-30T19:37:39.883352] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-30T19:37:40.139564] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-30T19:37:40.151452] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-30T19:37:40.151591] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-30T19:37:40.504314] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-30T19:37:40.547475] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-30T19:37:40.547555] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-30T19:37:40.548547] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-30T19:37:40.548612] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-30T19:37:40.550282] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 54057 (keeping 200 days of data) [2025-10-30T19:37:40.881945] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-30T19:37:40.882154] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-30T19:37:40.882354] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KVUE took 26.4s. Estimated remaining: 2h 26m 35s. Rate: 7.8 symbols/min [2025-10-30T19:37:41.028463] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-30T19:37:41.097038] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:37:41.126245] [DEBUG] [LOCAL ] KYN: Loaded 29641 existing records from primary storage. [2025-10-30T19:37:41.126537] [INFO ] [MAIN ] KYN: Loaded 29641 existing records. [2025-10-30T19:37:41.302001] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:37:41.302532] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-30T19:37:41.302117] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-30T19:37:41.303811] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-30T19:37:41.304020] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-30T19:37:41.304061] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-30T19:37:41.673304] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:37:41.694842] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-30T19:37:42.097514] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-30T19:37:42.534197] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-30T19:37:42.897525] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-30T19:37:43.452967] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T19:37:43.470325] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-30T19:37:43.697491] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-30T19:37:44.497482] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-30T19:37:44.515930] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T19:37:45.103924] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-30T19:37:45.297497] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-30T19:37:46.097476] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-30T19:37:46.461299] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:37:46.469723] [INFO ] [REMOTE ] KW: Full fetch complete (57210 records). [2025-10-30T19:37:46.469845] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-30T19:37:46.848352] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-30T19:37:46.848431] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-30T19:37:46.849417] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-30T19:37:46.849515] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-30T19:37:46.850729] [DEBUG] [LOCAL ] KW: Trimmed 57210 records to 40224 (keeping 200 days of data) [2025-10-30T19:37:46.898022] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-30T19:37:47.085426] [DEBUG] [LOCAL ] KW: Primary data saved (40224 records). [2025-10-30T19:37:47.085544] [INFO ] [MAIN ] KW: Full history saved. [2025-10-30T19:37:47.085618] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KW took 27.0s. Estimated remaining: 2h 26m 26s. Rate: 7.8 symbols/min [2025-10-30T19:37:47.267496] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:37:47.301935] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T19:37:47.344590] [DEBUG] [LOCAL ] L: Loaded 40742 existing records from primary storage. [2025-10-30T19:37:47.344880] [INFO ] [MAIN ] L: Loaded 40742 existing records. [2025-10-30T19:37:47.521307] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:37:47.521509] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-30T19:37:47.521555] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-30T19:37:47.521989] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-30T19:37:47.522045] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-30T19:37:47.698499] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-30T19:37:47.903115] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:37:47.904832] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-30T19:37:48.497464] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-30T19:37:48.614426] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T19:37:49.297464] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-30T19:37:49.495815] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-30T19:37:50.097471] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-30T19:37:50.156683] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-30T19:37:50.897533] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-30T19:37:51.025567] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T19:37:51.697500] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-30T19:37:52.164159] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T19:37:52.391574] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-30T19:37:52.497461] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-30T19:37:53.211194] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-30T19:37:53.297456] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-30T19:37:54.072947] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T19:37:54.097458] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-30T19:37:54.897456] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-30T19:37:54.944682] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-30T19:37:55.565377] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-30T19:37:55.697471] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-30T19:37:56.256226] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-30T19:37:56.497575] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-30T19:37:57.297541] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-30T19:37:57.570273] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T19:37:57.942267] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-30T19:37:57.945366] [INFO ] [REMOTE ] KWR: Full fetch complete (22972 records). [2025-10-30T19:37:57.945436] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-30T19:37:58.117078] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-30T19:37:58.310369] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-30T19:37:58.310443] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-30T19:37:58.310944] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-30T19:37:58.311006] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-30T19:37:58.311584] [DEBUG] [LOCAL ] KWR: Trimmed 22972 records to 15427 (keeping 200 days of data) [2025-10-30T19:37:58.406332] [DEBUG] [LOCAL ] KWR: Primary data saved (15427 records). [2025-10-30T19:37:58.406468] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-30T19:37:58.406578] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KWR took 26.7s. Estimated remaining: 2h 26m 21s. Rate: 7.8 symbols/min [2025-10-30T19:37:58.571060] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:37:58.621910] [DEBUG] [LOCAL ] LAC: Loaded 52607 existing records from primary storage. [2025-10-30T19:37:58.622199] [INFO ] [MAIN ] LAC: Loaded 52607 existing records. [2025-10-30T19:37:58.794197] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:37:58.794367] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-30T19:37:58.794412] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-30T19:37:58.794855] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-30T19:37:58.794911] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-30T19:37:58.902563] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-30T19:37:59.151019] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:37:59.213109] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:37:59.697541] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-30T19:38:00.497551] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-30T19:38:00.600952] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-30T19:38:00.612202] [INFO ] [REMOTE ] KVYO: Full fetch complete (72530 records). [2025-10-30T19:38:00.612320] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-30T19:38:00.995701] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-30T19:38:00.995785] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-30T19:38:00.996706] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-30T19:38:00.996769] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-30T19:38:00.998106] [DEBUG] [LOCAL ] KVYO: Trimmed 72530 records to 51293 (keeping 200 days of data) [2025-10-30T19:38:01.301910] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-30T19:38:01.307001] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-30T19:38:01.333277] [DEBUG] [LOCAL ] KVYO: Primary data saved (51293 records). [2025-10-30T19:38:01.333379] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-30T19:38:01.333453] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. KVYO took 46.1s. Estimated remaining: 2h 26m 9s. Rate: 7.8 symbols/min [2025-10-30T19:38:01.502137] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:38:01.524966] [DEBUG] [LOCAL ] LAD: Loaded 23180 existing records from primary storage. [2025-10-30T19:38:01.525240] [INFO ] [MAIN ] LAD: Loaded 23180 existing records. [2025-10-30T19:38:01.702427] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:38:01.702757] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-30T19:38:01.702812] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-30T19:38:01.703154] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-30T19:38:01.703213] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-30T19:38:02.052237] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:38:02.097500] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-30T19:38:02.757823] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-30T19:38:02.897492] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-30T19:38:03.559543] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-30T19:38:03.697523] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-30T19:38:03.907708] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-30T19:38:04.085292] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T19:38:04.497495] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-30T19:38:04.610569] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T19:38:05.297520] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-30T19:38:05.607744] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T19:38:06.097483] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-30T19:38:06.120870] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T19:38:06.897514] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-30T19:38:07.507975] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-30T19:38:07.697556] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-30T19:38:08.018117] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T19:38:08.497479] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-30T19:38:08.566359] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T19:38:09.297501] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-30T19:38:09.687727] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T19:38:10.097470] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-30T19:38:10.548791] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T19:38:10.897500] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-30T19:38:11.022681] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T19:38:11.029620] [INFO ] [REMOTE ] KYN: Full fetch complete (44316 records). [2025-10-30T19:38:11.029738] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-30T19:38:11.392435] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-30T19:38:11.392539] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-30T19:38:11.393348] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-30T19:38:11.393412] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-30T19:38:11.394357] [DEBUG] [LOCAL ] KYN: Trimmed 44316 records to 29932 (keeping 200 days of data) [2025-10-30T19:38:11.569803] [DEBUG] [LOCAL ] KYN: Primary data saved (29932 records). [2025-10-30T19:38:11.569920] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-30T19:38:11.569998] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KYN took 30.7s. Estimated remaining: 2h 26m 4s. Rate: 7.8 symbols/min [2025-10-30T19:38:11.704509] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-30T19:38:11.734871] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:38:11.772468] [DEBUG] [LOCAL ] LADR: Loaded 39025 existing records from primary storage. [2025-10-30T19:38:11.772760] [INFO ] [MAIN ] LADR: Loaded 39025 existing records. [2025-10-30T19:38:11.946008] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:38:11.946203] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-30T19:38:11.946250] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-30T19:38:11.946436] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-30T19:38:11.946492] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-30T19:38:12.289702] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:38:12.424919] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T19:38:12.497469] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-30T19:38:12.772563] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-30T19:38:13.297476] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-30T19:38:13.997910] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-30T19:38:14.097464] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-30T19:38:14.256174] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-30T19:38:14.897499] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-30T19:38:15.063674] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T19:38:15.697506] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-30T19:38:16.141342] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-30T19:38:16.150610] [INFO ] [REMOTE ] L: Full fetch complete (59250 records). [2025-10-30T19:38:16.150787] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-30T19:38:16.511394] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-30T19:38:16.530965] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-30T19:38:16.531027] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-30T19:38:16.531894] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-30T19:38:16.532045] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-30T19:38:16.533226] [DEBUG] [LOCAL ] L: Trimmed 59250 records to 41084 (keeping 200 days of data) [2025-10-30T19:38:16.780593] [DEBUG] [LOCAL ] L: Primary data saved (41084 records). [2025-10-30T19:38:16.791177] [INFO ] [MAIN ] L: Full history saved. [2025-10-30T19:38:16.798286] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. L took 29.7s. Estimated remaining: 2h 25m 54s. Rate: 7.8 symbols/min [2025-10-30T19:38:16.798895] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:38:16.975519] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:38:16.979837] [DEBUG] [LOCAL ] LANV: Loaded 2766 existing records from primary storage. [2025-10-30T19:38:16.979991] [INFO ] [MAIN ] LANV: Loaded 2766 existing records. [2025-10-30T19:38:17.160915] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:38:17.161202] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-30T19:38:17.161255] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-30T19:38:17.161385] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-30T19:38:17.161440] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-30T19:38:17.302558] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-30T19:38:17.522057] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:38:17.541615] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-30T19:38:18.097493] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-30T19:38:18.671402] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-30T19:38:18.818217] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-30T19:38:18.897494] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-30T19:38:19.250439] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-30T19:38:19.697524] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-30T19:38:20.497468] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-30T19:38:20.695058] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-30T19:38:21.297497] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-30T19:38:22.098002] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-30T19:38:22.098086] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-30T19:38:22.210260] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T19:38:22.799147] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-30T19:38:22.897495] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-30T19:38:23.598708] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-30T19:38:23.697507] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-30T19:38:24.379319] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-30T19:38:24.497548] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-30T19:38:25.233170] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-30T19:38:25.297498] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-30T19:38:26.097527] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-30T19:38:26.224253] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-30T19:38:26.230401] [INFO ] [REMOTE ] LAD: Full fetch complete (35806 records). [2025-10-30T19:38:26.230475] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-30T19:38:26.422992] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-30T19:38:26.605053] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-30T19:38:26.605145] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-30T19:38:26.605905] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-30T19:38:26.605972] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-30T19:38:26.607021] [DEBUG] [LOCAL ] LAD: Trimmed 35806 records to 23367 (keeping 200 days of data) [2025-10-30T19:38:26.752362] [DEBUG] [LOCAL ] LAD: Primary data saved (23367 records). [2025-10-30T19:38:26.752492] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-30T19:38:26.752573] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. LAD took 25.4s. Estimated remaining: 2h 25m 48s. Rate: 7.8 symbols/min [2025-10-30T19:38:26.899919] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-30T19:38:26.919624] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:38:26.920947] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-30T19:38:26.920998] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-30T19:38:26.921117] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-30T19:38:26.921160] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-30T19:38:26.921201] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-30T19:38:26.921235] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-30T19:38:27.267922] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:38:27.697544] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-30T19:38:27.821109] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-30T19:38:28.124860] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-30T19:38:28.497534] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-30T19:38:29.297542] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-30T19:38:30.009753] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-30T19:38:30.097494] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-30T19:38:30.380393] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-30T19:38:30.897502] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-30T19:38:31.361284] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-30T19:38:31.708744] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-30T19:38:31.714587] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-30T19:38:31.998144] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-30T19:38:32.497502] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-30T19:38:33.297502] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-30T19:38:33.519680] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T19:38:33.570381] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-30T19:38:34.097509] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-30T19:38:34.897495] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-30T19:38:35.167175] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-30T19:38:35.298596] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-30T19:38:35.697479] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-30T19:38:36.497462] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-30T19:38:36.664412] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-30T19:38:37.297507] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-30T19:38:37.588623] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-30T19:38:38.097514] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-30T19:38:38.769337] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-30T19:38:38.781099] [INFO ] [REMOTE ] LAC: Full fetch complete (76169 records). [2025-10-30T19:38:38.781237] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-30T19:38:38.902682] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-30T19:38:39.189781] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-30T19:38:39.189965] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-30T19:38:39.190988] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-30T19:38:39.191065] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-30T19:38:39.214630] [DEBUG] [LOCAL ] LAC: Trimmed 76169 records to 52997 (keeping 200 days of data) [2025-10-30T19:38:39.216078] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T19:38:39.312737] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-30T19:38:39.527113] [DEBUG] [LOCAL ] LAC: Primary data saved (52997 records). [2025-10-30T19:38:39.527243] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-30T19:38:39.528205] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LAC took 41.1s. Estimated remaining: 2h 25m 45s. Rate: 7.8 symbols/min [2025-10-30T19:38:39.698100] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-30T19:38:39.700616] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:38:39.716757] [DEBUG] [LOCAL ] LAW: Loaded 15110 existing records from primary storage. [2025-10-30T19:38:39.716978] [INFO ] [MAIN ] LAW: Loaded 15110 existing records. [2025-10-30T19:38:39.893789] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:38:39.893998] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-30T19:38:39.894044] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-30T19:38:39.894189] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-30T19:38:39.894226] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-30T19:38:40.132314] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-30T19:38:40.283074] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:38:40.497467] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-30T19:38:41.297496] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-30T19:38:41.541299] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-30T19:38:42.097499] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-30T19:38:42.522379] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-30T19:38:42.524011] [INFO ] [REMOTE ] LANV: Full fetch complete (4152 records). [2025-10-30T19:38:42.524271] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-30T19:38:42.571783] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T19:38:42.640900] [INFO ] [REMOTE ] LADR: Full fetch complete (55678 records). [2025-10-30T19:38:42.646791] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-30T19:38:42.902262] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-30T19:38:43.200781] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-30T19:38:43.200887] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-30T19:38:43.201044] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-30T19:38:43.201412] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-30T19:38:43.222769] [DEBUG] [LOCAL ] LANV: Trimmed 4152 records to 2777 (keeping 200 days of data) [2025-10-30T19:38:43.292666] [DEBUG] [LOCAL ] LANV: Primary data saved (2777 records). [2025-10-30T19:38:43.306881] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-30T19:38:43.309768] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-30T19:38:43.309928] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LANV took 26.5s. Estimated remaining: 2h 25m 34s. Rate: 7.8 symbols/min [2025-10-30T19:38:43.310004] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-30T19:38:43.310836] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-30T19:38:43.310909] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-30T19:38:43.417586] [DEBUG] [LOCAL ] LADR: Trimmed 55678 records to 39354 (keeping 200 days of data) [2025-10-30T19:38:43.543051] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:38:43.595746] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-30T19:38:43.716567] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-30T19:38:43.746074] [DEBUG] [LOCAL ] LAZ: Loaded 44210 existing records from primary storage. [2025-10-30T19:38:43.760746] [INFO ] [MAIN ] LAZ: Loaded 44210 existing records. [2025-10-30T19:38:43.765826] [DEBUG] [LOCAL ] LADR: Primary data saved (39354 records). [2025-10-30T19:38:43.808342] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-30T19:38:43.834532] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LADR took 32.3s. Estimated remaining: 2h 25m 20s. Rate: 7.8 symbols/min [2025-10-30T19:38:44.092764] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:38:44.110585] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:38:44.110958] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-30T19:38:44.111117] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-30T19:38:44.112411] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-30T19:38:44.112474] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-30T19:38:44.414308] [DEBUG] [LOCAL ] LB: Loaded 36445 existing records from primary storage. [2025-10-30T19:38:44.417174] [INFO ] [MAIN ] LB: Loaded 36445 existing records. [2025-10-30T19:38:44.503804] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-30T19:38:44.602929] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:38:44.678635] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:38:44.678837] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-30T19:38:44.678885] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-30T19:38:44.679086] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-30T19:38:44.679142] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-30T19:38:45.028042] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:38:45.053247] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T19:38:45.232793] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:38:45.297503] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-30T19:38:45.825712] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-30T19:38:46.097499] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-30T19:38:46.897595] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-30T19:38:47.193965] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T19:38:47.697532] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-30T19:38:48.158622] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T19:38:48.497490] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-30T19:38:48.671006] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T19:38:49.112128] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-30T19:38:49.297494] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-30T19:38:50.097566] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-30T19:38:50.344095] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-30T19:38:50.897504] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-30T19:38:51.286565] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-30T19:38:51.697571] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-30T19:38:51.985608] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-30T19:38:52.267322] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-30T19:38:52.497501] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-30T19:38:53.297514] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-30T19:38:53.621390] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-30T19:38:53.881580] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-30T19:38:54.097558] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-30T19:38:54.634047] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-30T19:38:54.897510] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-30T19:38:55.697545] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-30T19:38:55.917629] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T19:38:56.497491] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-30T19:38:56.824315] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-30T19:38:57.297528] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-30T19:38:57.539808] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:38:58.097490] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-30T19:38:58.305226] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-30T19:38:58.897499] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-30T19:38:59.364701] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:38:59.697512] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-30T19:38:59.979847] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T19:39:00.497531] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-30T19:39:01.200933] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-30T19:39:01.297470] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-30T19:39:01.920570] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-30T19:39:02.097503] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-30T19:39:02.767935] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-30T19:39:02.897518] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-30T19:39:03.493206] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-30T19:39:03.697494] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-30T19:39:04.135897] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-30T19:39:04.382021] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-30T19:39:04.497469] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-30T19:39:05.297670] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-30T19:39:05.297727] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-30T19:39:05.303773] [INFO ] [REMOTE ] LAW: Full fetch complete (21109 records). [2025-10-30T19:39:05.303886] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-30T19:39:05.665292] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-30T19:39:05.665675] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-30T19:39:05.666166] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-30T19:39:05.666207] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-30T19:39:05.666824] [DEBUG] [LOCAL ] LAW: Trimmed 21109 records to 15183 (keeping 200 days of data) [2025-10-30T19:39:05.752251] [DEBUG] [LOCAL ] LAW: Primary data saved (15183 records). [2025-10-30T19:39:05.752399] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-30T19:39:05.752494] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LAW took 26.2s. Estimated remaining: 2h 25m 25s. Rate: 7.8 symbols/min [2025-10-30T19:39:05.918132] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:05.970205] [DEBUG] [LOCAL ] LBRT: Loaded 53005 existing records from primary storage. [2025-10-30T19:39:05.970519] [INFO ] [MAIN ] LBRT: Loaded 53005 existing records. [2025-10-30T19:39:06.102688] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-30T19:39:06.158435] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:06.158776] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-30T19:39:06.158859] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-30T19:39:06.159416] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-30T19:39:06.159475] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-30T19:39:06.534732] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:06.558826] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T19:39:06.897492] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-30T19:39:07.437769] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-30T19:39:07.697509] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-30T19:39:08.204188] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T19:39:08.497506] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-30T19:39:09.297499] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-30T19:39:09.460040] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-30T19:39:09.471850] [INFO ] [REMOTE ] LAR: Full fetch complete (64731 records). [2025-10-30T19:39:09.471962] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-30T19:39:09.668527] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-30T19:39:09.669266] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:39:09.669399] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:39:09.669587] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-30T19:39:09.669882] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-30T19:39:09.670048] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-30T19:39:09.670107] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-30T19:39:09.670173] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. LAR took 42.9s. Estimated remaining: 2h 25m 14s. Rate: 7.8 symbols/min [2025-10-30T19:39:09.695307] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-30T19:39:10.097506] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-30T19:39:10.617563] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:39:10.897497] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-30T19:39:11.108892] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-30T19:39:11.697767] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-30T19:39:12.115803] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T19:39:12.497584] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-30T19:39:12.719847] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-30T19:39:13.297539] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-30T19:39:13.790236] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T19:39:13.799528] [INFO ] [REMOTE ] LAZ: Full fetch complete (65282 records). [2025-10-30T19:39:13.799677] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-30T19:39:14.104545] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-30T19:39:14.202635] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-30T19:39:14.202755] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-30T19:39:14.203670] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-30T19:39:14.203732] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-30T19:39:14.205003] [DEBUG] [LOCAL ] LAZ: Trimmed 65282 records to 44573 (keeping 200 days of data) [2025-10-30T19:39:14.474825] [DEBUG] [LOCAL ] LAZ: Primary data saved (44573 records). [2025-10-30T19:39:14.474976] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-30T19:39:14.475129] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LAZ took 31.2s. Estimated remaining: 2h 25m 3s. Rate: 7.8 symbols/min [2025-10-30T19:39:14.553478] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-30T19:39:14.897514] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-30T19:39:15.354798] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T19:39:15.362499] [INFO ] [REMOTE ] LB: Full fetch complete (55206 records). [2025-10-30T19:39:15.362600] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-30T19:39:15.736924] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-30T19:39:15.737000] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-30T19:39:15.737815] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-30T19:39:15.737876] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-30T19:39:15.738986] [DEBUG] [LOCAL ] LB: Trimmed 55206 records to 36614 (keeping 200 days of data) [2025-10-30T19:39:15.955907] [DEBUG] [LOCAL ] LB: Primary data saved (36614 records). [2025-10-30T19:39:15.956047] [INFO ] [MAIN ] LB: Full history saved. [2025-10-30T19:39:15.956146] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LB took 32.1s. Estimated remaining: 2h 24m 50s. Rate: 7.8 symbols/min [2025-10-30T19:39:16.214413] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T19:39:16.225525] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-30T19:39:17.481370] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T19:39:17.492533] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-30T19:39:18.588468] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:39:18.599340] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-30T19:39:19.896962] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T19:39:19.908394] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-30T19:39:21.229027] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T19:39:21.240151] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-30T19:39:22.363677] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T19:39:22.375226] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-30T19:39:24.103118] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-30T19:39:24.114936] [INFO ] [REMOTE ] LBRT: Full fetch complete (76941 records). [2025-10-30T19:39:24.115074] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-30T19:39:24.509512] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-30T19:39:24.509609] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-30T19:39:24.510810] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-30T19:39:24.510877] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-30T19:39:24.512385] [DEBUG] [LOCAL ] LBRT: Trimmed 76941 records to 53395 (keeping 200 days of data) [2025-10-30T19:39:24.855837] [DEBUG] [LOCAL ] LBRT: Primary data saved (53395 records). [2025-10-30T19:39:24.855966] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-30T19:39:24.856973] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LBRT took 19.1s. Estimated remaining: 2h 24m 43s. Rate: 7.8 symbols/min [2025-10-30T19:39:25.485947] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:25.511394] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:25.591248] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:25.611130] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:25.673620] [DEBUG] [LOCAL ] LCII: Loaded 26223 existing records from primary storage. [2025-10-30T19:39:25.699154] [INFO ] [MAIN ] LCII: Loaded 26223 existing records. [2025-10-30T19:39:25.731059] [DEBUG] [LOCAL ] LDI: Loaded 45381 existing records from primary storage. [2025-10-30T19:39:25.765291] [DEBUG] [LOCAL ] LDOS: Loaded 44096 existing records from primary storage. [2025-10-30T19:39:25.764221] [INFO ] [MAIN ] LDI: Loaded 45381 existing records. [2025-10-30T19:39:25.794103] [INFO ] [MAIN ] LDOS: Loaded 44096 existing records. [2025-10-30T19:39:25.882284] [DEBUG] [LOCAL ] LC: Loaded 48253 existing records from primary storage. [2025-10-30T19:39:26.000266] [INFO ] [MAIN ] LC: Loaded 48253 existing records. [2025-10-30T19:39:26.197670] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:26.235250] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-30T19:39:26.235829] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-30T19:39:26.267962] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-30T19:39:26.331077] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-30T19:39:26.351175] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:26.435806] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-30T19:39:26.441701] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:26.465204] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-30T19:39:26.506252] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-30T19:39:26.554351] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-30T19:39:26.577263] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-30T19:39:26.597038] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-30T19:39:26.583615] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:26.617758] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-30T19:39:26.623050] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-30T19:39:26.663583] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-30T19:39:26.703282] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-30T19:39:26.683939] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-30T19:39:26.717341] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-30T19:39:27.636948] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:27.702521] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-30T19:39:27.941859] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:27.966664] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:27.966942] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-30T19:39:27.967927] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-30T19:39:27.972149] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:27.972549] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-30T19:39:28.759046] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T19:39:28.766007] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-30T19:39:28.812323] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-30T19:39:28.817110] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-30T19:39:29.402027] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-30T19:39:29.412427] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-30T19:39:29.440105] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-30T19:39:29.451607] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-30T19:39:29.515817] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-30T19:39:29.522998] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-30T19:39:29.617189] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T19:39:29.622297] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-30T19:39:30.507910] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T19:39:30.514743] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-30T19:39:30.592167] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T19:39:30.601460] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-30T19:39:30.627871] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T19:39:30.638115] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-30T19:39:30.667907] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-30T19:39:30.897523] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-30T19:39:31.457195] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T19:39:31.697473] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-30T19:39:31.757260] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T19:39:31.786627] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T19:39:32.268624] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T19:39:32.452093] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T19:39:32.497468] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-30T19:39:33.297522] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-30T19:39:33.511720] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T19:39:34.097509] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-30T19:39:34.561308] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T19:39:34.897484] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-30T19:39:35.358746] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-30T19:39:35.697533] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-30T19:39:36.147758] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T19:39:36.497509] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-30T19:39:36.926967] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:39:37.297532] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-30T19:39:37.773769] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-30T19:39:38.097498] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-30T19:39:38.350543] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-30T19:39:38.870578] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-30T19:39:38.897515] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-30T19:39:39.697527] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-30T19:39:39.730407] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-30T19:39:40.497518] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-30T19:39:40.916481] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T19:39:41.297515] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-30T19:39:41.752374] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T19:39:42.097521] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-30T19:39:42.449768] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T19:39:42.843900] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T19:39:42.897485] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-30T19:39:43.611100] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T19:39:43.697605] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-30T19:39:44.497548] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-30T19:39:44.644612] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-30T19:39:44.650230] [INFO ] [REMOTE ] LCII: Full fetch complete (39206 records). [2025-10-30T19:39:44.650388] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-30T19:39:45.031624] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-30T19:39:45.031751] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-30T19:39:45.032448] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-30T19:39:45.032491] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-30T19:39:45.033374] [DEBUG] [LOCAL ] LCII: Trimmed 39206 records to 26489 (keeping 200 days of data) [2025-10-30T19:39:45.196525] [DEBUG] [LOCAL ] LCII: Primary data saved (26489 records). [2025-10-30T19:39:45.196754] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-30T19:39:45.196864] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LCII took 20.3s. Estimated remaining: 2h 24m 47s. Rate: 7.8 symbols/min [2025-10-30T19:39:45.298175] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-30T19:39:45.370698] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:45.382560] [DEBUG] [LOCAL ] LDP: Loaded 12102 existing records from primary storage. [2025-10-30T19:39:45.382795] [INFO ] [MAIN ] LDP: Loaded 12102 existing records. [2025-10-30T19:39:45.563485] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:45.563844] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-30T19:39:45.563898] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-30T19:39:45.564132] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-30T19:39:45.564174] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-30T19:39:45.952357] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:45.953597] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-30T19:39:46.097511] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-30T19:39:46.459549] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T19:39:46.897481] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-30T19:39:46.953200] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-30T19:39:47.697502] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-30T19:39:48.010030] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T19:39:48.497507] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-30T19:39:48.798429] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T19:39:48.884086] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-30T19:39:49.297498] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-30T19:39:50.097500] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-30T19:39:50.443878] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:39:50.897502] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-30T19:39:51.538944] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-30T19:39:51.550044] [INFO ] [REMOTE ] LC: Full fetch complete (70708 records). [2025-10-30T19:39:51.550166] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-30T19:39:51.707326] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-30T19:39:51.945432] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-30T19:39:51.945624] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-30T19:39:51.946804] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-30T19:39:51.946871] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-30T19:39:51.948244] [DEBUG] [LOCAL ] LC: Trimmed 70708 records to 48613 (keeping 200 days of data) [2025-10-30T19:39:52.187758] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T19:39:52.264930] [DEBUG] [LOCAL ] LC: Primary data saved (48613 records). [2025-10-30T19:39:52.265093] [INFO ] [MAIN ] LC: Full history saved. [2025-10-30T19:39:52.265177] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LC took 27.4s. Estimated remaining: 2h 24m 39s. Rate: 7.8 symbols/min [2025-10-30T19:39:52.420426] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-30T19:39:52.448629] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:52.486073] [DEBUG] [LOCAL ] LEA: Loaded 40721 existing records from primary storage. [2025-10-30T19:39:52.486362] [INFO ] [MAIN ] LEA: Loaded 40721 existing records. [2025-10-30T19:39:52.506614] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-30T19:39:52.665077] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:52.665273] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-30T19:39:52.665321] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-30T19:39:52.665517] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-30T19:39:52.665561] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-30T19:39:53.021721] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:53.297504] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-30T19:39:53.881145] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-30T19:39:54.097499] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-30T19:39:54.212345] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-30T19:39:54.897549] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-30T19:39:55.378743] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-30T19:39:55.387553] [INFO ] [REMOTE ] LDOS: Full fetch complete (66425 records). [2025-10-30T19:39:55.387732] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-30T19:39:55.702679] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-30T19:39:55.777403] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-30T19:39:55.777494] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-30T19:39:55.778410] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-30T19:39:55.778476] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-30T19:39:55.779830] [DEBUG] [LOCAL ] LDOS: Trimmed 66425 records to 44399 (keeping 200 days of data) [2025-10-30T19:39:56.056054] [DEBUG] [LOCAL ] LDOS: Primary data saved (44399 records). [2025-10-30T19:39:56.056197] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-30T19:39:56.056282] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LDOS took 31.2s. Estimated remaining: 2h 24m 27s. Rate: 7.8 symbols/min [2025-10-30T19:39:56.231326] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:39:56.261139] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T19:39:56.312543] [DEBUG] [LOCAL ] LEG: Loaded 49840 existing records from primary storage. [2025-10-30T19:39:56.312927] [INFO ] [MAIN ] LEG: Loaded 49840 existing records. [2025-10-30T19:39:56.486129] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-30T19:39:56.497768] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-30T19:39:56.525817] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:39:56.526169] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-30T19:39:56.526274] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-30T19:39:56.527171] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-30T19:39:56.527232] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-30T19:39:56.879712] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:39:57.297600] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-30T19:39:57.639614] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:39:58.097541] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-30T19:39:58.484544] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T19:39:58.897484] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-30T19:39:59.152943] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-30T19:39:59.697547] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-30T19:40:00.109416] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T19:40:00.497503] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-30T19:40:01.297591] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-30T19:40:01.561498] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:40:01.764182] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-30T19:40:01.782507] [INFO ] [REMOTE ] LDI: Full fetch complete (62822 records). [2025-10-30T19:40:01.782792] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-30T19:40:02.107275] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-30T19:40:02.229078] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-30T19:40:02.229175] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-30T19:40:02.230082] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-30T19:40:02.230149] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-30T19:40:02.231486] [DEBUG] [LOCAL ] LDI: Trimmed 62822 records to 45768 (keeping 200 days of data) [2025-10-30T19:40:02.481666] [DEBUG] [LOCAL ] LDI: Primary data saved (45768 records). [2025-10-30T19:40:02.481796] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-30T19:40:02.481872] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LDI took 37.6s. Estimated remaining: 2h 24m 19s. Rate: 7.8 symbols/min [2025-10-30T19:40:02.652478] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:02.701222] [DEBUG] [LOCAL ] LEN: Loaded 53188 existing records from primary storage. [2025-10-30T19:40:02.701546] [INFO ] [MAIN ] LEN: Loaded 53188 existing records. [2025-10-30T19:40:02.882510] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:02.882821] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-30T19:40:02.882876] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-30T19:40:02.883622] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-30T19:40:02.883724] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-30T19:40:02.898670] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-30T19:40:03.248189] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:40:03.279235] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-30T19:40:03.535930] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-30T19:40:03.697497] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-30T19:40:04.194936] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-30T19:40:04.497569] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-30T19:40:05.052917] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T19:40:05.297516] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-30T19:40:05.499077] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T19:40:06.097505] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-30T19:40:06.666032] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T19:40:06.897516] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-30T19:40:07.449137] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-30T19:40:07.697510] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-30T19:40:08.055335] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T19:40:08.497497] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-30T19:40:08.672772] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-30T19:40:08.913314] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-30T19:40:09.297512] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-30T19:40:10.097500] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-30T19:40:10.631372] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-30T19:40:10.649307] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T19:40:10.897555] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-30T19:40:11.697500] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-30T19:40:11.998772] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-30T19:40:12.497540] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-30T19:40:12.907479] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-30T19:40:13.297496] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-30T19:40:13.955329] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-30T19:40:14.097460] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-30T19:40:14.310251] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-30T19:40:14.777982] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-30T19:40:14.780790] [INFO ] [REMOTE ] LDP: Full fetch complete (18570 records). [2025-10-30T19:40:14.780957] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-30T19:40:14.902676] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-30T19:40:15.150981] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-30T19:40:15.151057] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-30T19:40:15.151447] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-30T19:40:15.151486] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-30T19:40:15.152040] [DEBUG] [LOCAL ] LDP: Trimmed 18570 records to 12172 (keeping 200 days of data) [2025-10-30T19:40:15.223520] [DEBUG] [LOCAL ] LDP: Primary data saved (12172 records). [2025-10-30T19:40:15.223660] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-30T19:40:15.223759] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LDP took 30.0s. Estimated remaining: 2h 24m 15s. Rate: 7.8 symbols/min [2025-10-30T19:40:15.391186] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:15.407769] [DEBUG] [LOCAL ] LEO: Loaded 16357 existing records from primary storage. [2025-10-30T19:40:15.408014] [INFO ] [MAIN ] LEO: Loaded 16357 existing records. [2025-10-30T19:40:15.584514] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:15.584717] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-30T19:40:15.584770] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-30T19:40:15.584968] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-30T19:40:15.585024] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-30T19:40:15.702696] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-30T19:40:15.933694] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:40:15.959319] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-30T19:40:16.497491] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-30T19:40:17.114882] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-30T19:40:17.297498] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-30T19:40:17.573558] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-30T19:40:17.582052] [INFO ] [REMOTE ] LEA: Full fetch complete (60374 records). [2025-10-30T19:40:17.582159] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-30T19:40:17.984621] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-30T19:40:17.984755] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-30T19:40:17.985584] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-30T19:40:17.985624] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-30T19:40:17.986766] [DEBUG] [LOCAL ] LEA: Trimmed 60374 records to 41050 (keeping 200 days of data) [2025-10-30T19:40:18.100700] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-30T19:40:18.233402] [DEBUG] [LOCAL ] LEA: Primary data saved (41050 records). [2025-10-30T19:40:18.233525] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-30T19:40:18.234335] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LEA took 26.0s. Estimated remaining: 2h 24m 3s. Rate: 7.8 symbols/min [2025-10-30T19:40:18.408429] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:18.458307] [DEBUG] [LOCAL ] LEVI: Loaded 51795 existing records from primary storage. [2025-10-30T19:40:18.458867] [INFO ] [MAIN ] LEVI: Loaded 51795 existing records. [2025-10-30T19:40:18.667897] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T19:40:18.672339] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:18.683366] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-30T19:40:18.683472] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-30T19:40:18.684223] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-30T19:40:18.684290] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-30T19:40:18.906469] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-30T19:40:19.057986] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:40:19.180158] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-30T19:40:19.697503] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-30T19:40:20.368337] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-30T19:40:20.393344] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T19:40:20.497514] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-30T19:40:21.297495] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-30T19:40:22.002392] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T19:40:22.012977] [INFO ] [REMOTE ] LEG: Full fetch complete (72806 records). [2025-10-30T19:40:22.013133] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-30T19:40:22.103243] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-30T19:40:22.421072] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-30T19:40:22.421166] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-30T19:40:22.422146] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-30T19:40:22.422216] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-30T19:40:22.423691] [DEBUG] [LOCAL ] LEG: Trimmed 72806 records to 50223 (keeping 200 days of data) [2025-10-30T19:40:22.724674] [DEBUG] [LOCAL ] LEG: Primary data saved (50223 records). [2025-10-30T19:40:22.725045] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-30T19:40:22.726030] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEG took 26.7s. Estimated remaining: 2h 23m 53s. Rate: 7.8 symbols/min [2025-10-30T19:40:22.895296] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-30T19:40:22.901012] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-30T19:40:22.940981] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:22.975435] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-30T19:40:23.002473] [DEBUG] [LOCAL ] LFT: Loaded 18027 existing records from primary storage. [2025-10-30T19:40:23.002896] [INFO ] [MAIN ] LFT: Loaded 18027 existing records. [2025-10-30T19:40:23.191686] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:23.191902] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-30T19:40:23.191952] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-30T19:40:23.192188] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-30T19:40:23.192228] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-30T19:40:23.570790] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:40:23.697500] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-30T19:40:24.123084] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T19:40:24.501867] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-30T19:40:24.505500] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T19:40:25.294262] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T19:40:25.297626] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-30T19:40:25.789893] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T19:40:26.097478] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-30T19:40:26.897508] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-30T19:40:27.212935] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-30T19:40:27.454807] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T19:40:27.697486] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-30T19:40:28.490030] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-30T19:40:28.497449] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-30T19:40:29.260501] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T19:40:29.297460] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-30T19:40:30.097465] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-30T19:40:30.141747] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-30T19:40:30.703109] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T19:40:30.897497] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-30T19:40:31.590178] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T19:40:31.697490] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-30T19:40:32.328407] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T19:40:32.497481] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-30T19:40:33.113969] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-30T19:40:33.297503] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-30T19:40:33.981857] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-30T19:40:34.097499] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-30T19:40:34.897480] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-30T19:40:35.445475] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T19:40:35.642588] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-30T19:40:35.697517] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-30T19:40:36.421554] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-30T19:40:36.425605] [INFO ] [REMOTE ] LEO: Full fetch complete (26593 records). [2025-10-30T19:40:36.425740] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-30T19:40:36.502616] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-30T19:40:36.813597] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-30T19:40:36.813694] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-30T19:40:36.814227] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-30T19:40:36.814268] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-30T19:40:36.814918] [DEBUG] [LOCAL ] LEO: Trimmed 26593 records to 16598 (keeping 200 days of data) [2025-10-30T19:40:36.907964] [DEBUG] [LOCAL ] LEO: Primary data saved (16598 records). [2025-10-30T19:40:36.908087] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-30T19:40:36.908175] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LEO took 21.7s. Estimated remaining: 2h 23m 51s. Rate: 7.8 symbols/min [2025-10-30T19:40:37.073027] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:37.083355] [DEBUG] [LOCAL ] LGI: Loaded 9697 existing records from primary storage. [2025-10-30T19:40:37.083548] [INFO ] [MAIN ] LGI: Loaded 9697 existing records. [2025-10-30T19:40:37.256371] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:37.256574] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-30T19:40:37.256693] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-30T19:40:37.256861] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-30T19:40:37.256899] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-30T19:40:37.302580] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-30T19:40:37.612452] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:40:37.797937] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:40:38.002740] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-30T19:40:38.097472] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-30T19:40:38.709924] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-30T19:40:38.897536] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-30T19:40:39.697503] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-30T19:40:40.186990] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-30T19:40:40.256514] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-30T19:40:40.497516] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-30T19:40:41.297464] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-30T19:40:42.061737] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-30T19:40:42.097485] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-30T19:40:42.647165] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-30T19:40:42.897509] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-30T19:40:43.608473] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-30T19:40:43.612480] [INFO ] [REMOTE ] LFT: Full fetch complete (23741 records). [2025-10-30T19:40:43.612573] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-30T19:40:43.702757] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-30T19:40:43.996129] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-30T19:40:43.996243] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-30T19:40:43.996928] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-30T19:40:43.997011] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-30T19:40:43.997907] [DEBUG] [LOCAL ] LFT: Trimmed 23741 records to 18167 (keeping 200 days of data) [2025-10-30T19:40:44.104618] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-30T19:40:44.147008] [DEBUG] [LOCAL ] LFT: Primary data saved (18167 records). [2025-10-30T19:40:44.147288] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-30T19:40:44.147384] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LFT took 21.4s. Estimated remaining: 2h 23m 43s. Rate: 7.8 symbols/min [2025-10-30T19:40:44.281045] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-30T19:40:44.332042] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:44.368152] [DEBUG] [LOCAL ] LH: Loaded 36812 existing records from primary storage. [2025-10-30T19:40:44.368440] [INFO ] [MAIN ] LH: Loaded 36812 existing records. [2025-10-30T19:40:44.507124] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-30T19:40:44.548500] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:44.549272] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-30T19:40:44.549335] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-30T19:40:44.549764] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-30T19:40:44.549829] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-30T19:40:44.905452] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:40:45.297514] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-30T19:40:45.803394] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-30T19:40:46.097501] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-30T19:40:46.354199] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-30T19:40:46.366156] [INFO ] [REMOTE ] LEN: Full fetch complete (77219 records). [2025-10-30T19:40:46.366315] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-30T19:40:46.663674] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-30T19:40:46.783580] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-30T19:40:46.783681] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-30T19:40:46.784664] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-30T19:40:46.784725] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-30T19:40:46.786283] [DEBUG] [LOCAL ] LEN: Trimmed 77219 records to 53578 (keeping 200 days of data) [2025-10-30T19:40:46.901785] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-30T19:40:47.124374] [DEBUG] [LOCAL ] LEN: Primary data saved (53578 records). [2025-10-30T19:40:47.124510] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-30T19:40:47.124605] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LEN took 44.6s. Estimated remaining: 2h 23m 31s. Rate: 7.8 symbols/min [2025-10-30T19:40:47.296866] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:47.339202] [DEBUG] [LOCAL ] LHX: Loaded 48176 existing records from primary storage. [2025-10-30T19:40:47.339472] [INFO ] [MAIN ] LHX: Loaded 48176 existing records. [2025-10-30T19:40:47.520462] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:47.520718] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-30T19:40:47.520772] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-30T19:40:47.521562] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-30T19:40:47.521623] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-30T19:40:47.709713] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-30T19:40:47.887086] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:40:48.247125] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-30T19:40:48.497481] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-30T19:40:48.870805] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-30T19:40:49.013839] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T19:40:49.297504] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-30T19:40:50.097496] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-30T19:40:50.504477] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T19:40:50.897493] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-30T19:40:51.245802] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-30T19:40:51.441310] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-30T19:40:51.697572] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-30T19:40:52.497558] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-30T19:40:52.958408] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T19:40:53.047581] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T19:40:53.297532] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-30T19:40:54.097515] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-30T19:40:54.504831] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T19:40:54.711729] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-30T19:40:54.897562] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-30T19:40:55.697503] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-30T19:40:56.023950] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-30T19:40:56.497489] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-30T19:40:56.947080] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-30T19:40:56.975158] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-30T19:40:57.297502] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-30T19:40:58.097510] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-30T19:40:58.532243] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T19:40:58.745383] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-30T19:40:58.749321] [INFO ] [REMOTE ] LGI: Full fetch complete (14361 records). [2025-10-30T19:40:58.749473] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-30T19:40:58.904763] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-30T19:40:59.143416] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-30T19:40:59.143498] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-30T19:40:59.143901] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-30T19:40:59.143965] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-30T19:40:59.144439] [DEBUG] [LOCAL ] LGI: Trimmed 14361 records to 9725 (keeping 200 days of data) [2025-10-30T19:40:59.203052] [DEBUG] [LOCAL ] LGI: Primary data saved (9725 records). [2025-10-30T19:40:59.203182] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-30T19:40:59.203258] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LGI took 22.3s. Estimated remaining: 2h 23m 27s. Rate: 7.8 symbols/min [2025-10-30T19:40:59.371808] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:40:59.399536] [DEBUG] [LOCAL ] LII: Loaded 27593 existing records from primary storage. [2025-10-30T19:40:59.399794] [INFO ] [MAIN ] LII: Loaded 27593 existing records. [2025-10-30T19:40:59.577901] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:40:59.578175] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-30T19:40:59.578251] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-30T19:40:59.578554] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-30T19:40:59.578613] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-30T19:40:59.702707] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-30T19:41:00.024939] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:00.332599] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-30T19:41:00.497518] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-30T19:41:01.074135] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T19:41:01.297490] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-30T19:41:01.905764] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T19:41:02.097509] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-30T19:41:02.585675] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T19:41:02.897474] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-30T19:41:03.052730] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-30T19:41:03.697549] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-30T19:41:04.123716] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:41:04.497497] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-30T19:41:04.648716] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-30T19:41:05.297505] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-30T19:41:05.912329] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T19:41:06.097462] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-30T19:41:06.315002] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T19:41:06.897498] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-30T19:41:07.123401] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-30T19:41:07.697460] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-30T19:41:07.842089] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T19:41:08.497532] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-30T19:41:08.905080] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T19:41:09.297470] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-30T19:41:09.414728] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-30T19:41:10.097510] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-30T19:41:10.691926] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-30T19:41:10.897495] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-30T19:41:11.697497] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-30T19:41:11.833890] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-30T19:41:11.845822] [INFO ] [REMOTE ] LEVI: Full fetch complete (75058 records). [2025-10-30T19:41:11.845964] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-30T19:41:12.228430] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-30T19:41:12.228583] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-30T19:41:12.229576] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-30T19:41:12.229658] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-30T19:41:12.231465] [DEBUG] [LOCAL ] LEVI: Trimmed 75058 records to 52178 (keeping 200 days of data) [2025-10-30T19:41:12.498021] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-30T19:41:12.509060] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-30T19:41:12.610284] [DEBUG] [LOCAL ] LEVI: Primary data saved (52178 records). [2025-10-30T19:41:12.610416] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-30T19:41:12.610957] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LEVI took 54.4s. Estimated remaining: 2h 23m 24s. Rate: 7.8 symbols/min [2025-10-30T19:41:12.790915] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:41:12.821451] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-30T19:41:12.868985] [DEBUG] [LOCAL ] LION: Loaded 47519 existing records from primary storage. [2025-10-30T19:41:12.869336] [INFO ] [MAIN ] LION: Loaded 47519 existing records. [2025-10-30T19:41:13.045247] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:41:13.045515] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-30T19:41:13.045569] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-30T19:41:13.045777] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-30T19:41:13.045845] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-30T19:41:13.301822] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-30T19:41:13.418830] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:13.435780] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-30T19:41:14.097495] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-30T19:41:14.332415] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T19:41:14.897188] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-30T19:41:14.902494] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-30T19:41:15.697502] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-30T19:41:16.092286] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T19:41:16.497512] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-30T19:41:16.563315] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-30T19:41:17.302624] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-30T19:41:17.312165] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-30T19:41:18.097466] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-30T19:41:18.187761] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-30T19:41:18.801555] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T19:41:18.897465] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-30T19:41:19.565207] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T19:41:19.697525] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-30T19:41:20.497488] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-30T19:41:20.883794] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-30T19:41:20.890816] [INFO ] [REMOTE ] LII: Full fetch complete (42023 records). [2025-10-30T19:41:20.890909] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-30T19:41:21.279773] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-30T19:41:21.279848] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-30T19:41:21.280563] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-30T19:41:21.280611] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-30T19:41:21.281450] [DEBUG] [LOCAL ] LII: Trimmed 42023 records to 27868 (keeping 200 days of data) [2025-10-30T19:41:21.337268] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-30T19:41:21.458104] [DEBUG] [LOCAL ] LII: Primary data saved (27868 records). [2025-10-30T19:41:21.458233] [INFO ] [MAIN ] LII: Full history saved. [2025-10-30T19:41:21.458315] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LII took 22.3s. Estimated remaining: 2h 23m 18s. Rate: 7.8 symbols/min [2025-10-30T19:41:21.641689] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:41:21.647149] [DEBUG] [LOCAL ] LITB: Loaded 3625 existing records from primary storage. [2025-10-30T19:41:21.647308] [INFO ] [MAIN ] LITB: Loaded 3625 existing records. [2025-10-30T19:41:21.791483] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-30T19:41:21.848582] [INFO ] [REMOTE ] LH: Full fetch complete (55056 records). [2025-10-30T19:41:21.849401] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-30T19:41:21.903584] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:41:21.947601] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-30T19:41:21.952842] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-30T19:41:21.974206] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-30T19:41:21.974301] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-30T19:41:22.104431] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-30T19:41:22.651449] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:22.654237] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-30T19:41:22.656340] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-30T19:41:22.657555] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-30T19:41:22.657693] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-30T19:41:22.659540] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-30T19:41:22.667153] [DEBUG] [LOCAL ] LH: Trimmed 55056 records to 37159 (keeping 200 days of data) [2025-10-30T19:41:22.897280] [DEBUG] [LOCAL ] LH: Primary data saved (37159 records). [2025-10-30T19:41:22.897456] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-30T19:41:22.897422] [INFO ] [MAIN ] LH: Full history saved. [2025-10-30T19:41:22.897671] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LH took 38.8s. Estimated remaining: 2h 23m 4s. Rate: 7.8 symbols/min [2025-10-30T19:41:23.067790] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:41:23.114836] [DEBUG] [LOCAL ] LLY: Loaded 53161 existing records from primary storage. [2025-10-30T19:41:23.115142] [INFO ] [MAIN ] LLY: Loaded 53161 existing records. [2025-10-30T19:41:23.290632] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:41:23.290881] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-30T19:41:23.290928] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-30T19:41:23.291436] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-30T19:41:23.291476] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-30T19:41:23.650034] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:23.674874] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-30T19:41:23.697449] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-30T19:41:24.128821] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:41:24.497522] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-30T19:41:25.195068] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T19:41:25.206403] [INFO ] [REMOTE ] LHX: Full fetch complete (70653 records). [2025-10-30T19:41:25.206573] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-30T19:41:25.305667] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-30T19:41:25.601565] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-30T19:41:25.601760] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-30T19:41:25.602897] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-30T19:41:25.602979] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-30T19:41:25.619636] [DEBUG] [LOCAL ] LHX: Trimmed 70653 records to 48559 (keeping 200 days of data) [2025-10-30T19:41:25.635268] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T19:41:25.718416] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T19:41:25.957273] [DEBUG] [LOCAL ] LHX: Primary data saved (48559 records). [2025-10-30T19:41:25.957407] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-30T19:41:25.957487] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LHX took 38.8s. Estimated remaining: 2h 22m 52s. Rate: 7.8 symbols/min [2025-10-30T19:41:26.103369] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-30T19:41:26.129509] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:41:26.178437] [DEBUG] [LOCAL ] LMND: Loaded 52111 existing records from primary storage. [2025-10-30T19:41:26.178776] [INFO ] [MAIN ] LMND: Loaded 52111 existing records. [2025-10-30T19:41:26.353477] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:41:26.353693] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-30T19:41:26.353759] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-30T19:41:26.354169] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-30T19:41:26.354225] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-30T19:41:26.740259] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:26.897455] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-30T19:41:27.697562] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-30T19:41:27.945339] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-30T19:41:27.988932] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-30T19:41:28.306571] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-30T19:41:28.497523] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-30T19:41:29.297495] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-30T19:41:29.356734] [DEBUG] [REMOTE ] LITB: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-30T19:41:29.357075] [WARN ] [REMOTE ] LITB: No data returned for month 2025-03 [2025-10-30T19:41:29.357172] [FATAL] [REMOTE ] LITB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:41:29.357263] [FATAL] [MAIN ] LITB: Failed to fetch primary data. [2025-10-30T19:41:29.357351] [WARN ] [MAIN ] LITB: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:41:29.357435] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-30T19:41:29.357534] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-10-30T19:41:29.357581] [INFO ] [LOCAL ] LITB: Starting deletion of derivative data. [2025-10-30T19:41:29.357780] [DEBUG] [LOCAL ] LITB: Deleted derivative data file. [2025-10-30T19:41:29.357891] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LITB took 7.9s. Estimated remaining: 2h 22m 41s. Rate: 7.8 symbols/min [2025-10-30T19:41:29.536037] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:41:29.581062] [DEBUG] [LOCAL ] LMT: Loaded 49440 existing records from primary storage. [2025-10-30T19:41:29.581372] [INFO ] [MAIN ] LMT: Loaded 49440 existing records. [2025-10-30T19:41:29.769913] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:41:29.770137] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-30T19:41:29.770202] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-30T19:41:29.770462] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-30T19:41:29.770500] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-30T19:41:30.100587] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-30T19:41:30.139492] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:30.171344] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-30T19:41:30.897512] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-30T19:41:31.347012] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T19:41:31.697493] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-30T19:41:32.333249] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-30T19:41:32.497484] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-30T19:41:33.297506] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-30T19:41:33.430373] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-30T19:41:33.785108] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T19:41:34.097546] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-30T19:41:34.806748] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T19:41:34.897462] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-30T19:41:35.388807] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-30T19:41:35.697476] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-30T19:41:36.391980] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-30T19:41:36.497474] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-30T19:41:37.297469] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-30T19:41:37.549184] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-30T19:41:37.685506] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T19:41:38.097584] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-30T19:41:38.520090] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-30T19:41:38.897545] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-30T19:41:39.701378] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-30T19:41:39.704426] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-30T19:41:40.104628] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-30T19:41:40.497509] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-30T19:41:41.297506] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-30T19:41:41.679952] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-30T19:41:41.856477] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-30T19:41:42.097500] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-30T19:41:42.750758] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-30T19:41:42.897468] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-30T19:41:43.613242] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T19:41:43.697496] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-30T19:41:44.388278] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T19:41:44.497485] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-30T19:41:45.022589] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T19:41:45.033568] [INFO ] [REMOTE ] LION: Full fetch complete (58972 records). [2025-10-30T19:41:45.033747] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-30T19:41:45.302803] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-30T19:41:45.410569] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-30T19:41:45.410676] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-30T19:41:45.411539] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-30T19:41:45.411582] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-30T19:41:45.412845] [DEBUG] [LOCAL ] LION: Trimmed 58972 records to 47841 (keeping 200 days of data) [2025-10-30T19:41:45.666340] [DEBUG] [LOCAL ] LION: Primary data saved (47841 records). [2025-10-30T19:41:45.666458] [INFO ] [MAIN ] LION: Full history saved. [2025-10-30T19:41:45.666533] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LION took 33.1s. Estimated remaining: 2h 22m 41s. Rate: 7.8 symbols/min [2025-10-30T19:41:45.832443] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:41:45.881162] [DEBUG] [LOCAL ] LNC: Loaded 51280 existing records from primary storage. [2025-10-30T19:41:45.881506] [INFO ] [MAIN ] LNC: Loaded 51280 existing records. [2025-10-30T19:41:46.058193] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:41:46.058435] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-30T19:41:46.058498] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-30T19:41:46.059055] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-30T19:41:46.059112] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-30T19:41:46.101696] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-30T19:41:46.416129] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:46.445586] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-30T19:41:46.897470] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-30T19:41:47.055301] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-30T19:41:47.697501] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-30T19:41:48.005477] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-30T19:41:48.497540] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-30T19:41:48.555408] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-30T19:41:49.297508] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-30T19:41:49.641325] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-30T19:41:49.682104] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-30T19:41:50.097489] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-30T19:41:50.897475] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-30T19:41:51.089690] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-30T19:41:51.101171] [INFO ] [REMOTE ] LMND: Full fetch complete (75489 records). [2025-10-30T19:41:51.101302] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-30T19:41:51.482535] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-30T19:41:51.482634] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-30T19:41:51.483724] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-30T19:41:51.483792] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-30T19:41:51.485302] [DEBUG] [LOCAL ] LMND: Trimmed 75489 records to 52495 (keeping 200 days of data) [2025-10-30T19:41:51.697679] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-30T19:41:51.785511] [DEBUG] [LOCAL ] LMND: Primary data saved (52495 records). [2025-10-30T19:41:51.785617] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-30T19:41:51.785721] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LMND took 25.8s. Estimated remaining: 2h 22m 32s. Rate: 7.8 symbols/min [2025-10-30T19:41:51.964921] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:41:51.971538] [DEBUG] [LOCAL ] LND: Loaded 4855 existing records from primary storage. [2025-10-30T19:41:51.971808] [INFO ] [MAIN ] LND: Loaded 4855 existing records. [2025-10-30T19:41:52.161493] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:41:52.161937] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-30T19:41:52.162097] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-30T19:41:52.162358] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-30T19:41:52.162479] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-30T19:41:52.303198] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-30T19:41:52.501592] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-30T19:41:52.577975] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:41:52.622772] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-30T19:41:52.862778] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-30T19:41:53.297494] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-30T19:41:53.732568] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-30T19:41:54.097497] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-30T19:41:54.519733] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-30T19:41:54.609324] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-30T19:41:54.897532] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-30T19:41:55.697494] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-30T19:41:56.190993] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T19:41:56.497493] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-30T19:41:57.297552] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-30T19:41:57.588027] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-30T19:41:57.905840] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T19:41:58.097473] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-30T19:41:58.525571] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-30T19:41:58.897476] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-30T19:41:59.307754] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-30T19:41:59.697518] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-30T19:42:00.308308] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-30T19:42:00.323968] [INFO ] [REMOTE ] LLY: Full fetch complete (77184 records). [2025-10-30T19:42:00.324233] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-30T19:42:00.502793] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-30T19:42:00.866717] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-30T19:42:00.866822] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-30T19:42:00.868228] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-30T19:42:00.868327] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-30T19:42:00.870262] [DEBUG] [LOCAL ] LLY: Trimmed 77184 records to 53551 (keeping 200 days of data) [2025-10-30T19:42:01.247787] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-30T19:42:01.259986] [DEBUG] [LOCAL ] LLY: Primary data saved (53551 records). [2025-10-30T19:42:01.260146] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-30T19:42:01.261038] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LLY took 38.4s. Estimated remaining: 2h 22m 25s. Rate: 7.8 symbols/min [2025-10-30T19:42:01.307593] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-30T19:42:01.438740] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:42:01.490193] [DEBUG] [LOCAL ] LNG: Loaded 50961 existing records from primary storage. [2025-10-30T19:42:01.490505] [INFO ] [MAIN ] LNG: Loaded 50961 existing records. [2025-10-30T19:42:01.696223] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:42:01.696477] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-30T19:42:01.696591] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-30T19:42:01.697265] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-30T19:42:01.697333] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-30T19:42:02.104572] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-30T19:42:02.120773] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:42:02.140984] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-30T19:42:02.151741] [INFO ] [REMOTE ] LMT: Full fetch complete (72488 records). [2025-10-30T19:42:02.151858] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-30T19:42:02.540623] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-30T19:42:02.540754] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-30T19:42:02.541726] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-30T19:42:02.541791] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-30T19:42:02.543210] [DEBUG] [LOCAL ] LMT: Trimmed 72488 records to 49792 (keeping 200 days of data) [2025-10-30T19:42:02.644344] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-30T19:42:02.888705] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T19:42:02.906258] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-30T19:42:02.942508] [DEBUG] [LOCAL ] LMT: Primary data saved (49792 records). [2025-10-30T19:42:02.942619] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-30T19:42:02.943312] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LMT took 33.6s. Estimated remaining: 2h 22m 12s. Rate: 7.8 symbols/min [2025-10-30T19:42:03.116222] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:42:03.128892] [DEBUG] [LOCAL ] LNN: Loaded 11615 existing records from primary storage. [2025-10-30T19:42:03.129109] [INFO ] [MAIN ] LNN: Loaded 11615 existing records. [2025-10-30T19:42:03.327197] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:42:03.327442] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-30T19:42:03.327491] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-30T19:42:03.327730] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-30T19:42:03.327789] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-30T19:42:03.680262] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:42:03.697460] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-30T19:42:04.299780] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-30T19:42:04.418752] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-30T19:42:04.497526] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-30T19:42:04.999937] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T19:42:05.297510] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-30T19:42:05.686848] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-30T19:42:06.097512] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-30T19:42:06.600416] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-30T19:42:06.897567] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-30T19:42:07.697536] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-30T19:42:08.110960] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-30T19:42:08.320317] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-30T19:42:08.497491] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-30T19:42:09.297524] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-30T19:42:09.919443] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-30T19:42:09.972894] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-30T19:42:10.097481] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-30T19:42:10.897526] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-30T19:42:11.521374] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-30T19:42:11.697474] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-30T19:42:12.105914] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-30T19:42:12.497547] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-30T19:42:13.004105] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-30T19:42:13.297475] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-30T19:42:13.722126] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T19:42:13.787739] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T19:42:14.097514] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-30T19:42:14.897471] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-30T19:42:15.350587] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-30T19:42:15.659750] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-30T19:42:15.697487] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-30T19:42:16.497514] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-30T19:42:16.870901] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-30T19:42:17.202687] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T19:42:17.297474] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-30T19:42:17.766735] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-30T19:42:17.768463] [INFO ] [REMOTE ] LND: Full fetch complete (7794 records). [2025-10-30T19:42:17.768530] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-30T19:42:18.121742] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-30T19:42:18.129478] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-30T19:42:18.129535] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-30T19:42:18.129774] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-30T19:42:18.129834] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-30T19:42:18.130318] [DEBUG] [LOCAL ] LND: Trimmed 7794 records to 4893 (keeping 200 days of data) [2025-10-30T19:42:18.158879] [DEBUG] [LOCAL ] LND: Primary data saved (4893 records). [2025-10-30T19:42:18.158995] [INFO ] [MAIN ] LND: Full history saved. [2025-10-30T19:42:18.159110] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LND took 26.4s. Estimated remaining: 2h 22m 11s. Rate: 7.8 symbols/min [2025-10-30T19:42:18.328449] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:42:18.366520] [DEBUG] [LOCAL ] LOAR: Loaded 41547 existing records from primary storage. [2025-10-30T19:42:18.366852] [INFO ] [MAIN ] LOAR: Loaded 41547 existing records. [2025-10-30T19:42:18.545543] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:42:18.545774] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-30T19:42:18.545845] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-30T19:42:18.546196] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-30T19:42:18.546269] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-30T19:42:18.809802] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T19:42:18.900466] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-30T19:42:18.922331] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:42:19.539770] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-30T19:42:19.697486] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-30T19:42:20.497531] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-30T19:42:20.529617] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T19:42:21.297513] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-30T19:42:21.873521] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-30T19:42:21.998807] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-30T19:42:22.097469] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-30T19:42:22.897497] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-30T19:42:23.063632] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-30T19:42:23.697478] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-30T19:42:24.196971] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-30T19:42:24.497490] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-30T19:42:25.230098] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-30T19:42:25.297464] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-30T19:42:25.626986] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-30T19:42:26.097541] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-30T19:42:26.672918] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T19:42:26.897562] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-30T19:42:27.222303] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T19:42:27.697534] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-30T19:42:28.412599] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-30T19:42:28.423490] [INFO ] [REMOTE ] LNG: Full fetch complete (74644 records). [2025-10-30T19:42:28.423635] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-30T19:42:28.503354] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-30T19:42:28.820747] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-30T19:42:28.820855] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-30T19:42:28.822025] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-30T19:42:28.822106] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-30T19:42:28.823844] [DEBUG] [LOCAL ] LNG: Trimmed 74644 records to 51335 (keeping 200 days of data) [2025-10-30T19:42:28.848306] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:42:29.163676] [DEBUG] [LOCAL ] LNG: Primary data saved (51335 records). [2025-10-30T19:42:29.163811] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-30T19:42:29.164475] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LNG took 27.9s. Estimated remaining: 2h 22m 6s. Rate: 7.8 symbols/min [2025-10-30T19:42:29.303203] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-30T19:42:29.335030] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:42:29.360676] [DEBUG] [LOCAL ] LOB: Loaded 26180 existing records from primary storage. [2025-10-30T19:42:29.360921] [INFO ] [MAIN ] LOB: Loaded 26180 existing records. [2025-10-30T19:42:29.538897] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:42:29.539128] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-30T19:42:29.539184] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-30T19:42:29.539442] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-30T19:42:29.539499] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-30T19:42:29.871858] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T19:42:29.916105] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:42:29.954109] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T19:42:29.970108] [INFO ] [REMOTE ] LNC: Full fetch complete (74509 records). [2025-10-30T19:42:29.970240] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-30T19:42:30.113259] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-30T19:42:30.363664] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-30T19:42:30.363764] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-30T19:42:30.364736] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-30T19:42:30.364800] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-30T19:42:30.366158] [DEBUG] [LOCAL ] LNC: Trimmed 74509 records to 51647 (keeping 200 days of data) [2025-10-30T19:42:30.667195] [DEBUG] [LOCAL ] LNC: Primary data saved (51647 records). [2025-10-30T19:42:30.667316] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-30T19:42:30.667977] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LNC took 45.0s. Estimated remaining: 2h 21m 53s. Rate: 7.8 symbols/min [2025-10-30T19:42:30.835547] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:42:30.841070] [DEBUG] [LOCAL ] LOCL: Loaded 3211 existing records from primary storage. [2025-10-30T19:42:30.841256] [INFO ] [MAIN ] LOCL: Loaded 3211 existing records. [2025-10-30T19:42:30.902591] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-30T19:42:31.025368] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-30T19:42:31.038872] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:42:31.044255] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-30T19:42:31.044307] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-30T19:42:31.044460] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-30T19:42:31.044516] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-30T19:42:31.392638] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:42:31.490607] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-30T19:42:31.697476] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-30T19:42:32.431841] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:42:32.497503] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-30T19:42:33.297460] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-30T19:42:33.407672] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-30T19:42:34.097520] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-30T19:42:34.331568] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-30T19:42:34.375765] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-30T19:42:34.897517] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-30T19:42:35.133564] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-30T19:42:35.697539] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-30T19:42:35.991698] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-30T19:42:36.497507] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-30T19:42:37.297481] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-30T19:42:37.320004] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-30T19:42:37.323761] [INFO ] [REMOTE ] LNN: Full fetch complete (16451 records). [2025-10-30T19:42:37.323834] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-30T19:42:37.675304] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-30T19:42:37.675380] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-30T19:42:37.675758] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-30T19:42:37.675819] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-30T19:42:37.676310] [DEBUG] [LOCAL ] LNN: Trimmed 16451 records to 11725 (keeping 200 days of data) [2025-10-30T19:42:37.749325] [DEBUG] [LOCAL ] LNN: Primary data saved (11725 records). [2025-10-30T19:42:37.749456] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-30T19:42:37.749534] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LNN took 34.8s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min [2025-10-30T19:42:37.915870] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:42:37.950184] [DEBUG] [LOCAL ] LOMA: Loaded 33171 existing records from primary storage. [2025-10-30T19:42:37.950463] [INFO ] [MAIN ] LOMA: Loaded 33171 existing records. [2025-10-30T19:42:38.103872] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-30T19:42:38.135679] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:42:38.135935] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-30T19:42:38.135995] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-30T19:42:38.136359] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-30T19:42:38.136417] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-30T19:42:38.565055] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-30T19:42:38.637967] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:42:38.647819] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T19:42:38.897496] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-30T19:42:39.697477] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-30T19:42:39.871830] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T19:42:40.307565] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-30T19:42:40.497554] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-30T19:42:41.128474] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-30T19:42:41.297545] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-30T19:42:42.097477] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-30T19:42:42.431597] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-30T19:42:42.559244] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-30T19:42:42.897501] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-30T19:42:43.673536] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-30T19:42:43.697472] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-30T19:42:44.479230] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-30T19:42:44.497457] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-30T19:42:45.297471] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-30T19:42:45.435592] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-30T19:42:45.442400] [INFO ] [REMOTE ] LOB: Full fetch complete (38784 records). [2025-10-30T19:42:45.442518] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-30T19:42:45.891691] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-30T19:42:45.891800] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-30T19:42:45.892716] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-30T19:42:45.892796] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-30T19:42:45.893708] [DEBUG] [LOCAL ] LOB: Trimmed 38784 records to 26353 (keeping 200 days of data) [2025-10-30T19:42:46.027274] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:42:46.100819] [DEBUG] [LOCAL ] LOB: Primary data saved (26353 records). [2025-10-30T19:42:46.100904] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-30T19:42:46.101137] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-30T19:42:46.102117] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LOB took 16.9s. Estimated remaining: 2h 21m 38s. Rate: 7.8 symbols/min [2025-10-30T19:42:46.312397] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:42:46.362931] [DEBUG] [LOCAL ] LOW: Loaded 52910 existing records from primary storage. [2025-10-30T19:42:46.363286] [INFO ] [MAIN ] LOW: Loaded 52910 existing records. [2025-10-30T19:42:46.575779] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:42:46.576014] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-30T19:42:46.576072] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-30T19:42:46.576842] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-30T19:42:46.576925] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-30T19:42:46.902697] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-30T19:42:46.992883] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:42:47.282298] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-30T19:42:47.697556] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-30T19:42:47.735053] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T19:42:48.497567] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-30T19:42:48.794478] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-30T19:42:49.059887] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T19:42:49.297544] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-30T19:42:50.097493] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-30T19:42:50.206135] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-30T19:42:50.897509] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-30T19:42:51.445452] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-30T19:42:51.697500] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-30T19:42:51.839158] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-30T19:42:52.497505] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-30T19:42:53.056966] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T19:42:53.297468] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-30T19:42:53.322179] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T19:42:54.097503] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-30T19:42:54.431921] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-30T19:42:54.830507] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T19:42:54.897494] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-30T19:42:55.697502] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-30T19:42:55.983878] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-30T19:42:56.157412] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-30T19:42:56.497523] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-30T19:42:57.297519] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-30T19:42:57.838493] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:42:58.045634] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-30T19:42:58.097495] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-30T19:42:58.897472] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-30T19:42:58.971065] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-30T19:42:59.277935] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-30T19:42:59.697505] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-30T19:43:00.497513] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-30T19:43:01.128090] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-30T19:43:01.297520] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-30T19:43:01.636131] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-30T19:43:02.060689] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-30T19:43:02.062435] [INFO ] [REMOTE ] LOCL: Full fetch complete (4567 records). [2025-10-30T19:43:02.062832] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-30T19:43:02.103053] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-30T19:43:02.448172] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-30T19:43:02.448248] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-30T19:43:02.448384] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-30T19:43:02.448423] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-30T19:43:02.448835] [DEBUG] [LOCAL ] LOCL: Trimmed 4567 records to 3251 (keeping 200 days of data) [2025-10-30T19:43:02.466874] [DEBUG] [LOCAL ] LOCL: Primary data saved (3251 records). [2025-10-30T19:43:02.466999] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-30T19:43:02.467122] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LOCL took 31.8s. Estimated remaining: 2h 21m 38s. Rate: 7.8 symbols/min [2025-10-30T19:43:02.642697] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:02.679482] [DEBUG] [LOCAL ] LPG: Loaded 38640 existing records from primary storage. [2025-10-30T19:43:02.679804] [INFO ] [MAIN ] LPG: Loaded 38640 existing records. [2025-10-30T19:43:02.861587] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:43:02.861839] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-30T19:43:02.861886] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-30T19:43:02.862239] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-30T19:43:02.862279] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-30T19:43:02.904225] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-30T19:43:03.210913] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:03.623639] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-30T19:43:03.697526] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-30T19:43:04.178041] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T19:43:04.186613] [INFO ] [REMOTE ] LOMA: Full fetch complete (48209 records). [2025-10-30T19:43:04.186742] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-30T19:43:04.502608] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-30T19:43:04.572456] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-30T19:43:04.572530] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-30T19:43:04.573396] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-30T19:43:04.573459] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-30T19:43:04.574583] [DEBUG] [LOCAL ] LOMA: Trimmed 48209 records to 33486 (keeping 200 days of data) [2025-10-30T19:43:04.763913] [DEBUG] [LOCAL ] LOMA: Primary data saved (33486 records). [2025-10-30T19:43:04.764040] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-30T19:43:04.764127] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LOMA took 27.0s. Estimated remaining: 2h 21m 25s. Rate: 7.8 symbols/min [2025-10-30T19:43:04.936373] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:04.970702] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-30T19:43:04.980411] [INFO ] [REMOTE ] LOAR: Full fetch complete (56079 records). [2025-10-30T19:43:04.980731] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-30T19:43:05.119998] [DEBUG] [LOCAL ] LPL: Loaded 29327 existing records from primary storage. [2025-10-30T19:43:05.131420] [INFO ] [MAIN ] LPL: Loaded 29327 existing records. [2025-10-30T19:43:05.318260] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-30T19:43:05.504299] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:43:05.530186] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-30T19:43:05.530292] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-30T19:43:05.530855] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-30T19:43:05.541577] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-30T19:43:05.758573] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-30T19:43:05.786717] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-30T19:43:05.798088] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-30T19:43:05.848903] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-30T19:43:05.923220] [DEBUG] [LOCAL ] LOAR: Trimmed 56079 records to 41780 (keeping 200 days of data) [2025-10-30T19:43:06.051043] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:06.097725] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-30T19:43:06.240088] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-30T19:43:06.297497] [DEBUG] [LOCAL ] LOAR: Primary data saved (41780 records). [2025-10-30T19:43:06.297660] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-30T19:43:06.297765] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOAR took 48.1s. Estimated remaining: 2h 21m 12s. Rate: 7.8 symbols/min [2025-10-30T19:43:06.482775] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:06.483066] [DEBUG] [LOCAL ] LPX: No existing data file found in primary storage. [2025-10-30T19:43:06.483146] [WARN ] [MAIN ] LPX: No existing data found, performing full refresh instead. [2025-10-30T19:43:06.483304] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-30T19:43:06.483371] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-30T19:43:06.483454] [DEBUG] [LOCAL ] LPX: No primary data file found to delete. [2025-10-30T19:43:06.483611] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-30T19:43:06.793181] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-30T19:43:06.877964] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:06.897463] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-30T19:43:07.046015] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-30T19:43:07.697535] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-30T19:43:07.958187] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-30T19:43:08.497503] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-30T19:43:09.091621] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-30T19:43:09.297477] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-30T19:43:09.595446] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:43:10.097490] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-30T19:43:10.830564] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:43:10.897486] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-30T19:43:10.951495] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-30T19:43:10.962829] [INFO ] [REMOTE ] LOW: Full fetch complete (76677 records). [2025-10-30T19:43:10.962953] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-30T19:43:11.348626] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-30T19:43:11.348731] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-30T19:43:11.349709] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-30T19:43:11.349770] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-30T19:43:11.351141] [DEBUG] [LOCAL ] LOW: Trimmed 76677 records to 53294 (keeping 200 days of data) [2025-10-30T19:43:11.580427] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-30T19:43:11.696444] [DEBUG] [LOCAL ] LOW: Primary data saved (53294 records). [2025-10-30T19:43:11.696670] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-30T19:43:11.697583] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LOW took 25.6s. Estimated remaining: 2h 21m 2s. Rate: 7.8 symbols/min [2025-10-30T19:43:11.697765] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-30T19:43:11.873078] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:11.912888] [DEBUG] [LOCAL ] LRN: Loaded 39144 existing records from primary storage. [2025-10-30T19:43:11.913171] [INFO ] [MAIN ] LRN: Loaded 39144 existing records. [2025-10-30T19:43:12.085909] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:43:12.086119] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-30T19:43:12.086164] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-30T19:43:12.086459] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-30T19:43:12.086515] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-30T19:43:12.432107] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:12.497456] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-30T19:43:12.898922] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-30T19:43:13.297486] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-30T19:43:13.698933] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T19:43:14.097501] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-30T19:43:14.332312] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T19:43:14.906078] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-30T19:43:14.910033] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-30T19:43:15.697484] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-30T19:43:15.925440] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-30T19:43:16.497500] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-30T19:43:16.835674] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-30T19:43:17.297504] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-30T19:43:17.590322] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T19:43:18.097494] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-30T19:43:18.278224] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T19:43:18.894335] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-30T19:43:18.898468] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-30T19:43:19.697542] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-30T19:43:19.892980] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T19:43:20.313496] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-30T19:43:20.497524] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-30T19:43:21.297469] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-30T19:43:21.573896] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T19:43:22.097473] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-30T19:43:22.117423] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-30T19:43:22.897487] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-30T19:43:23.139157] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:43:23.697487] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-30T19:43:23.991262] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-30T19:43:24.497487] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-30T19:43:24.762834] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-30T19:43:25.297518] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-30T19:43:25.729846] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:43:26.097511] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-30T19:43:26.390288] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-30T19:43:26.897501] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-30T19:43:27.245605] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-30T19:43:27.697507] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-30T19:43:28.016206] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T19:43:28.497536] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-30T19:43:28.605529] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-30T19:43:29.297554] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-30T19:43:29.556974] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:43:30.097510] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-30T19:43:30.210911] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-30T19:43:30.897516] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-30T19:43:31.243428] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-30T19:43:31.697591] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-30T19:43:31.939363] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-30T19:43:32.497544] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-30T19:43:32.756006] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-30T19:43:33.297564] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-30T19:43:33.523500] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T19:43:34.097525] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-30T19:43:34.644539] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-30T19:43:34.653982] [INFO ] [REMOTE ] LPX: Full fetch complete (58425 records). [2025-10-30T19:43:34.654085] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-30T19:43:34.904088] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-30T19:43:35.045989] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-30T19:43:35.046100] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-30T19:43:35.047215] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-30T19:43:35.047436] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-30T19:43:35.049118] [DEBUG] [LOCAL ] LPX: Trimmed 58425 records to 40117 (keeping 200 days of data) [2025-10-30T19:43:35.182307] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-30T19:43:35.327374] [DEBUG] [LOCAL ] LPX: Primary data saved (40117 records). [2025-10-30T19:43:35.327503] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-30T19:43:35.327573] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LPX took 29.0s. Estimated remaining: 2h 21m 8s. Rate: 7.8 symbols/min [2025-10-30T19:43:35.491364] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:35.531732] [DEBUG] [LOCAL ] LSPD: Loaded 41978 existing records from primary storage. [2025-10-30T19:43:35.532024] [INFO ] [MAIN ] LSPD: Loaded 41978 existing records. [2025-10-30T19:43:35.703528] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-30T19:43:35.708722] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:43:35.710170] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-30T19:43:35.710224] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-30T19:43:35.711344] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-30T19:43:35.711409] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-30T19:43:36.065761] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:36.238034] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-30T19:43:36.247218] [INFO ] [REMOTE ] LPL: Full fetch complete (38590 records). [2025-10-30T19:43:36.247334] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-30T19:43:36.502828] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-30T19:43:36.626538] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-30T19:43:36.626686] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-30T19:43:36.627403] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-30T19:43:36.627446] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-30T19:43:36.628415] [DEBUG] [LOCAL ] LPL: Trimmed 38590 records to 29628 (keeping 200 days of data) [2025-10-30T19:43:36.791181] [DEBUG] [LOCAL ] LPL: Primary data saved (29628 records). [2025-10-30T19:43:36.791319] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-30T19:43:36.791400] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LPL took 32.0s. Estimated remaining: 2h 20m 55s. Rate: 7.8 symbols/min [2025-10-30T19:43:36.966774] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:36.993615] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-30T19:43:37.028798] [DEBUG] [LOCAL ] LTC: Loaded 30474 existing records from primary storage. [2025-10-30T19:43:37.029081] [INFO ] [MAIN ] LTC: Loaded 30474 existing records. [2025-10-30T19:43:37.203181] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:43:37.203414] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-30T19:43:37.203462] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-30T19:43:37.203821] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-30T19:43:37.203877] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-30T19:43:37.302729] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-30T19:43:37.576526] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:37.598971] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-30T19:43:38.097502] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-30T19:43:38.399915] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-30T19:43:38.407752] [INFO ] [REMOTE ] LPG: Full fetch complete (58440 records). [2025-10-30T19:43:38.407885] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-30T19:43:38.778295] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-30T19:43:38.778373] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-30T19:43:38.779222] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-30T19:43:38.779284] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-30T19:43:38.780427] [DEBUG] [LOCAL ] LPG: Trimmed 58440 records to 38876 (keeping 200 days of data) [2025-10-30T19:43:38.897695] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-30T19:43:39.036486] [DEBUG] [LOCAL ] LPG: Primary data saved (38876 records). [2025-10-30T19:43:39.036897] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-30T19:43:39.037555] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols completed. LPG took 36.6s. Estimated remaining: 2h 20m 43s. Rate: 7.8 symbols/min [2025-10-30T19:43:39.213632] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T19:43:39.238774] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:39.296397] [DEBUG] [LOCAL ] LTH: Loaded 51518 existing records from primary storage. [2025-10-30T19:43:39.296807] [INFO ] [MAIN ] LTH: Loaded 51518 existing records. [2025-10-30T19:43:39.475935] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:43:39.476176] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-30T19:43:39.476226] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-30T19:43:39.476638] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-30T19:43:39.476732] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-30T19:43:39.705154] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-30T19:43:39.834128] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:39.926058] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T19:43:40.497515] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-30T19:43:40.897980] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T19:43:41.297536] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-30T19:43:41.640157] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T19:43:42.097562] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-30T19:43:42.298841] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-30T19:43:42.897566] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-30T19:43:43.352732] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-30T19:43:43.361552] [INFO ] [REMOTE ] LRN: Full fetch complete (58167 records). [2025-10-30T19:43:43.361753] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-30T19:43:43.702619] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-30T19:43:43.754620] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-30T19:43:43.754727] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-30T19:43:43.755550] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-30T19:43:43.755590] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-30T19:43:43.756770] [DEBUG] [LOCAL ] LRN: Trimmed 58167 records to 39534 (keeping 200 days of data) [2025-10-30T19:43:44.000419] [DEBUG] [LOCAL ] LRN: Primary data saved (39534 records). [2025-10-30T19:43:44.000691] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-30T19:43:44.001624] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols completed. LRN took 32.3s. Estimated remaining: 2h 20m 33s. Rate: 7.8 symbols/min [2025-10-30T19:43:44.177572] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:43:44.212988] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-30T19:43:44.262601] [DEBUG] [LOCAL ] LTM: Loaded 39616 existing records from primary storage. [2025-10-30T19:43:44.262975] [INFO ] [MAIN ] LTM: Loaded 39616 existing records. [2025-10-30T19:43:44.443998] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:43:44.444236] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-30T19:43:44.444286] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-30T19:43:44.444593] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-30T19:43:44.444686] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-30T19:43:44.507630] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-30T19:43:44.804805] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:43:44.971119] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-30T19:43:45.297526] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-30T19:43:45.667045] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-30T19:43:46.097499] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-30T19:43:46.583934] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-30T19:43:46.897478] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-30T19:43:47.112279] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T19:43:47.697502] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-30T19:43:48.119263] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T19:43:48.497479] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-30T19:43:48.581541] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-30T19:43:49.297498] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-30T19:43:49.707464] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T19:43:50.081949] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-30T19:43:50.097455] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-30T19:43:50.897481] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-30T19:43:51.075793] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T19:43:51.697526] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-30T19:43:51.755363] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-30T19:43:52.497506] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-30T19:43:52.696708] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-30T19:43:53.297514] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-30T19:43:53.368109] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-30T19:43:54.097500] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-30T19:43:54.553358] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-30T19:43:54.897494] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-30T19:43:54.970585] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T19:43:55.697501] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-30T19:43:56.029574] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-30T19:43:56.497461] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-30T19:43:56.570060] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-30T19:43:57.297517] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-30T19:43:57.580728] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T19:43:58.097536] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-30T19:43:58.212025] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T19:43:58.897503] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-30T19:43:59.163418] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:43:59.697470] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-30T19:43:59.795877] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-30T19:44:00.497508] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-30T19:44:00.744820] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-30T19:44:01.297507] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-30T19:44:01.603076] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T19:44:02.097504] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-30T19:44:02.459453] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-30T19:44:02.470749] [INFO ] [REMOTE ] LSPD: Full fetch complete (62610 records). [2025-10-30T19:44:02.470948] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-30T19:44:02.889825] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-30T19:44:02.889967] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-30T19:44:02.891418] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-30T19:44:02.891486] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-30T19:44:02.893498] [DEBUG] [LOCAL ] LSPD: Trimmed 62610 records to 42296 (keeping 200 days of data) [2025-10-30T19:44:02.944680] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-30T19:44:03.151687] [DEBUG] [LOCAL ] LSPD: Primary data saved (42296 records). [2025-10-30T19:44:03.152046] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-30T19:44:03.152140] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols completed. LSPD took 27.8s. Estimated remaining: 2h 20m 35s. Rate: 7.8 symbols/min [2025-10-30T19:44:03.283159] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-30T19:44:03.360699] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:03.405265] [DEBUG] [LOCAL ] LU: Loaded 49220 existing records from primary storage. [2025-10-30T19:44:03.405574] [INFO ] [MAIN ] LU: Loaded 49220 existing records. [2025-10-30T19:44:03.582347] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:44:03.582610] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-30T19:44:03.582696] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-30T19:44:03.583016] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-30T19:44:03.583064] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-30T19:44:03.702623] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-30T19:44:03.948182] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:04.267797] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-30T19:44:04.497512] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-30T19:44:04.653083] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T19:44:05.297499] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-30T19:44:05.492464] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T19:44:06.067356] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-30T19:44:06.097463] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-30T19:44:06.897492] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-30T19:44:07.225370] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T19:44:07.232608] [INFO ] [REMOTE ] LTC: Full fetch complete (43936 records). [2025-10-30T19:44:07.232843] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-30T19:44:07.625542] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-30T19:44:07.625620] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-30T19:44:07.626426] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-30T19:44:07.626491] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-30T19:44:07.627518] [DEBUG] [LOCAL ] LTC: Trimmed 43936 records to 30705 (keeping 200 days of data) [2025-10-30T19:44:07.713695] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-30T19:44:07.816931] [DEBUG] [LOCAL ] LTC: Primary data saved (30705 records). [2025-10-30T19:44:07.817122] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-30T19:44:07.817213] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols completed. LTC took 31.0s. Estimated remaining: 2h 20m 25s. Rate: 7.8 symbols/min [2025-10-30T19:44:08.000394] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:08.040009] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T19:44:08.066503] [DEBUG] [LOCAL ] LUCK: Loaded 23098 existing records from primary storage. [2025-10-30T19:44:08.066821] [INFO ] [MAIN ] LUCK: Loaded 23098 existing records. [2025-10-30T19:44:08.247928] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:44:08.248159] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-30T19:44:08.248207] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-30T19:44:08.248389] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-30T19:44:08.248434] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-30T19:44:08.502973] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-30T19:44:08.598909] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:08.952284] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-30T19:44:09.297496] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-30T19:44:09.717289] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-30T19:44:10.097490] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-30T19:44:10.256169] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-30T19:44:10.897499] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-30T19:44:11.077989] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-30T19:44:11.697496] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-30T19:44:11.797553] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-30T19:44:12.497493] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-30T19:44:12.804587] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T19:44:13.191449] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T19:44:13.297484] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-30T19:44:14.097512] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-30T19:44:14.236532] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-30T19:44:14.897492] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-30T19:44:15.505371] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-30T19:44:15.515784] [INFO ] [REMOTE ] LTM: Full fetch complete (52134 records). [2025-10-30T19:44:15.515937] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-30T19:44:15.708458] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-30T19:44:15.927840] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-30T19:44:15.927949] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-30T19:44:15.928849] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-30T19:44:15.928913] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-30T19:44:15.930097] [DEBUG] [LOCAL ] LTM: Trimmed 52134 records to 39915 (keeping 200 days of data) [2025-10-30T19:44:16.154216] [DEBUG] [LOCAL ] LTM: Primary data saved (39915 records). [2025-10-30T19:44:16.154347] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-30T19:44:16.155195] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols completed. LTM took 32.2s. Estimated remaining: 2h 20m 17s. Rate: 7.8 symbols/min [2025-10-30T19:44:16.325002] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:16.399293] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-30T19:44:16.400635] [DEBUG] [LOCAL ] LUMN: Loaded 53650 existing records from primary storage. [2025-10-30T19:44:16.411912] [INFO ] [MAIN ] LUMN: Loaded 53650 existing records. [2025-10-30T19:44:16.434110] [INFO ] [REMOTE ] LTH: Full fetch complete (74737 records). [2025-10-30T19:44:16.461754] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-30T19:44:16.505704] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-30T19:44:16.771166] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:44:16.800115] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-30T19:44:16.820527] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-30T19:44:16.830239] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-30T19:44:16.830371] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-30T19:44:17.216757] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-30T19:44:17.261390] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-30T19:44:17.294090] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-30T19:44:17.311034] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-30T19:44:17.391055] [DEBUG] [LOCAL ] LTH: Trimmed 74737 records to 51895 (keeping 200 days of data) [2025-10-30T19:44:17.419689] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:17.472365] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-30T19:44:17.526080] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-30T19:44:17.643178] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-30T19:44:17.776597] [DEBUG] [LOCAL ] LTH: Primary data saved (51895 records). [2025-10-30T19:44:17.776772] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-30T19:44:17.777299] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols completed. LTH took 38.7s. Estimated remaining: 2h 20m 4s. Rate: 7.8 symbols/min [2025-10-30T19:44:18.097498] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-30T19:44:18.850913] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:44:18.897451] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-30T19:44:19.292316] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-30T19:44:19.697487] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-30T19:44:20.299575] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-30T19:44:20.497499] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-30T19:44:20.719484] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T19:44:21.297497] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-30T19:44:21.717514] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-30T19:44:22.097497] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-30T19:44:22.436274] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-30T19:44:22.897540] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-30T19:44:23.487333] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-30T19:44:23.697519] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-30T19:44:24.037472] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:44:24.497544] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-30T19:44:25.237976] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-30T19:44:25.297581] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-30T19:44:25.759610] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-30T19:44:25.975469] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-30T19:44:26.097529] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-30T19:44:26.897576] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-30T19:44:27.348355] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-30T19:44:27.697597] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-30T19:44:28.239179] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:44:28.497530] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-30T19:44:29.021027] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-30T19:44:29.038980] [INFO ] [REMOTE ] LU: Full fetch complete (71231 records). [2025-10-30T19:44:29.039205] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-30T19:44:29.305576] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-30T19:44:29.574699] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-30T19:44:29.574832] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-30T19:44:29.575905] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-30T19:44:29.575971] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-30T19:44:29.577441] [DEBUG] [LOCAL ] LU: Trimmed 71231 records to 49608 (keeping 200 days of data) [2025-10-30T19:44:29.909461] [DEBUG] [LOCAL ] LU: Primary data saved (49608 records). [2025-10-30T19:44:29.926228] [INFO ] [MAIN ] LU: Full history saved. [2025-10-30T19:44:29.926369] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols completed. LU took 26.8s. Estimated remaining: 2h 20m 0s. Rate: 7.8 symbols/min [2025-10-30T19:44:29.942514] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T19:44:30.097491] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-30T19:44:30.238816] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T19:44:30.897499] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-30T19:44:31.476825] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-30T19:44:31.702554] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-30T19:44:31.720252] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-30T19:44:32.455433] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-30T19:44:32.497593] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-30T19:44:33.297526] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-30T19:44:33.338381] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-30T19:44:33.343227] [INFO ] [REMOTE ] LUCK: Full fetch complete (38563 records). [2025-10-30T19:44:33.343362] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-30T19:44:33.711763] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-30T19:44:33.711841] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-30T19:44:33.712515] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-30T19:44:33.712557] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-30T19:44:33.713364] [DEBUG] [LOCAL ] LUCK: Trimmed 38563 records to 23276 (keeping 200 days of data) [2025-10-30T19:44:33.849113] [DEBUG] [LOCAL ] LUCK: Primary data saved (23276 records). [2025-10-30T19:44:33.849231] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-30T19:44:33.849308] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols completed. LUCK took 26.0s. Estimated remaining: 2h 19m 50s. Rate: 7.8 symbols/min [2025-10-30T19:44:34.943637] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-30T19:44:34.955862] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-30T19:44:36.709283] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-30T19:44:36.721064] [INFO ] [REMOTE ] LUMN: Full fetch complete (77791 records). [2025-10-30T19:44:36.721214] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-30T19:44:37.103744] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-30T19:44:37.103858] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-30T19:44:37.104860] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-30T19:44:37.104926] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-30T19:44:37.106385] [DEBUG] [LOCAL ] LUMN: Trimmed 77791 records to 54040 (keeping 200 days of data) [2025-10-30T19:44:37.417164] [DEBUG] [LOCAL ] LUMN: Primary data saved (54040 records). [2025-10-30T19:44:37.417291] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-30T19:44:37.417368] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols completed. LUMN took 21.3s. Estimated remaining: 2h 19m 38s. Rate: 7.8 symbols/min [2025-10-30T19:44:38.109061] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:38.112162] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:38.080582] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:38.112632] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-30T19:44:38.131396] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-30T19:44:38.163984] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:38.164306] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-30T19:44:38.164552] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-30T19:44:38.164902] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-30T19:44:38.165048] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-30T19:44:38.304997] [DEBUG] [LOCAL ] LVWR: Loaded 18716 existing records from primary storage. [2025-10-30T19:44:38.305316] [INFO ] [MAIN ] LVWR: Loaded 18716 existing records. [2025-10-30T19:44:38.592368] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-30T19:44:38.653595] [INFO ] [MAIN ] LVS: Loaded 53569 existing records. [2025-10-30T19:44:38.653450] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-30T19:44:38.733819] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-30T19:44:38.834769] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:44:38.846236] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-30T19:44:38.894228] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-30T19:44:39.012333] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-30T19:44:39.020759] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-30T19:44:39.085229] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:39.100759] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-30T19:44:39.278793] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:44:39.336254] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-30T19:44:39.345879] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:44:39.361956] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-30T19:44:39.367234] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-30T19:44:39.351574] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-30T19:44:39.422129] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-30T19:44:39.445901] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-30T19:44:39.456223] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-30T19:44:39.461992] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-30T19:44:39.462207] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-30T19:44:39.494368] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-30T19:44:39.606590] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:44:39.697909] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-30T19:44:39.724367] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:44:39.763990] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-30T19:44:39.828103] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:39.833774] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-30T19:44:39.839416] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-30T19:44:39.839334] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-30T19:44:39.858100] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-30T19:44:39.863677] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols completed. LUXE took 2.4s. Estimated remaining: 2h 19m 26s. Rate: 7.8 symbols/min [2025-10-30T19:44:40.476893] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-30T19:44:40.460549] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:44:40.498213] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-30T19:44:40.542385] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:40.538718] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:40.543366] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-30T19:44:40.543153] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-30T19:44:40.594763] [DEBUG] [LOCAL ] LW: Loaded 51097 existing records from primary storage. [2025-10-30T19:44:40.595179] [INFO ] [MAIN ] LW: Loaded 51097 existing records. [2025-10-30T19:44:40.772590] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:44:40.772822] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-30T19:44:40.772870] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-30T19:44:40.773426] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-30T19:44:40.773483] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-30T19:44:40.949564] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-30T19:44:40.997895] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-30T19:44:41.132756] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:44:41.133081] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-30T19:44:41.423476] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-30T19:44:41.424990] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-30T19:44:41.808663] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T19:44:41.810538] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-30T19:44:41.898677] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-30T19:44:41.974874] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-30T19:44:42.097582] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-30T19:44:42.387556] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-30T19:44:42.470538] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-30T19:44:42.897475] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-30T19:44:43.401634] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T19:44:43.697557] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-30T19:44:44.052085] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T19:44:44.497519] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-30T19:44:45.225682] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-30T19:44:45.297505] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-30T19:44:45.779005] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-30T19:44:46.097549] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-30T19:44:46.635472] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-30T19:44:46.897494] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-30T19:44:47.384373] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-30T19:44:47.697526] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-30T19:44:48.112142] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T19:44:48.497507] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-30T19:44:49.030935] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T19:44:49.297505] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-30T19:44:49.560767] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T19:44:50.097509] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-30T19:44:50.693750] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-30T19:44:50.897511] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-30T19:44:51.290564] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-30T19:44:51.476906] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-30T19:44:51.697497] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-30T19:44:52.497509] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-30T19:44:53.001955] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T19:44:53.297469] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-30T19:44:54.004147] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-30T19:44:54.097464] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-30T19:44:54.426767] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T19:44:54.897513] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-30T19:44:55.469374] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T19:44:55.697497] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-30T19:44:56.195596] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-30T19:44:56.497544] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-30T19:44:57.034914] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-30T19:44:57.297517] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-30T19:44:57.658674] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-30T19:44:58.097524] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-30T19:44:58.603489] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T19:44:58.897573] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-30T19:44:59.400702] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-30T19:44:59.697507] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-30T19:45:00.431243] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-30T19:45:00.497516] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-30T19:45:01.099153] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-30T19:45:01.297537] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-30T19:45:01.975468] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-30T19:45:02.097563] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-30T19:45:02.907854] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-30T19:45:02.914009] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-30T19:45:03.505271] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-30T19:45:03.693063] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-30T19:45:03.704338] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-30T19:45:03.707985] [INFO ] [REMOTE ] LW: Full fetch complete (74721 records). [2025-10-30T19:45:03.708293] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-30T19:45:04.108580] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-30T19:45:04.108692] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-30T19:45:04.109725] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-30T19:45:04.109789] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-30T19:45:04.111200] [DEBUG] [LOCAL ] LW: Trimmed 74721 records to 51474 (keeping 200 days of data) [2025-10-30T19:45:04.418512] [DEBUG] [LOCAL ] LW: Primary data saved (51474 records). [2025-10-30T19:45:04.418834] [INFO ] [MAIN ] LW: Full history saved. [2025-10-30T19:45:04.418948] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols completed. LW took 24.5s. Estimated remaining: 2h 19m 33s. Rate: 7.8 symbols/min [2025-10-30T19:45:04.509834] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-30T19:45:04.501392] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-30T19:45:04.635782] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:04.653567] [DEBUG] [LOCAL ] LXFR: Loaded 16112 existing records from primary storage. [2025-10-30T19:45:04.653841] [INFO ] [MAIN ] LXFR: Loaded 16112 existing records. [2025-10-30T19:45:04.829556] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:04.829814] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-30T19:45:04.829863] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-30T19:45:04.830089] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-30T19:45:04.830146] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-30T19:45:05.187877] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:05.297482] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-30T19:45:05.977076] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-30T19:45:06.012201] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-30T19:45:06.097507] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-30T19:45:06.897550] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-30T19:45:07.601473] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-30T19:45:07.604447] [INFO ] [REMOTE ] LVWR: Full fetch complete (20874 records). [2025-10-30T19:45:07.604514] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-30T19:45:07.702679] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-30T19:45:07.979594] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-30T19:45:07.979716] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-30T19:45:07.980238] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-30T19:45:07.980342] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-30T19:45:07.981238] [DEBUG] [LOCAL ] LVWR: Trimmed 20874 records to 18757 (keeping 200 days of data) [2025-10-30T19:45:08.084887] [DEBUG] [LOCAL ] LVWR: Primary data saved (18757 records). [2025-10-30T19:45:08.085103] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-30T19:45:08.085193] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols completed. LVWR took 30.7s. Estimated remaining: 2h 19m 21s. Rate: 7.8 symbols/min [2025-10-30T19:45:08.226846] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-30T19:45:08.260192] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-30T19:45:08.285190] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-30T19:45:08.311709] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:08.503163] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-30T19:45:08.503386] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-30T19:45:08.743425] [DEBUG] [LOCAL ] LXP: Loaded 50625 existing records from primary storage. [2025-10-30T19:45:08.766095] [INFO ] [MAIN ] LXP: Loaded 50625 existing records. [2025-10-30T19:45:08.809509] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-30T19:45:08.832736] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-30T19:45:08.840075] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-30T19:45:08.840165] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-30T19:45:08.877203] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 54079 (keeping 200 days of data) [2025-10-30T19:45:09.063491] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:09.072044] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-30T19:45:09.076902] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-30T19:45:09.098071] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-30T19:45:09.098144] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-30T19:45:09.298686] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-30T19:45:09.549568] [DEBUG] [LOCAL ] LUV: Primary data saved (54079 records). [2025-10-30T19:45:09.588184] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-30T19:45:09.608584] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols completed. LUV took 32.2s. Estimated remaining: 2h 19m 9s. Rate: 7.8 symbols/min [2025-10-30T19:45:09.828550] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:09.859028] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:09.888152] [DEBUG] [LOCAL ] LXU: Loaded 31077 existing records from primary storage. [2025-10-30T19:45:09.888443] [INFO ] [MAIN ] LXU: Loaded 31077 existing records. [2025-10-30T19:45:10.076877] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:10.077426] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-30T19:45:10.077491] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-30T19:45:10.077942] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-30T19:45:10.078002] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-30T19:45:10.099552] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-30T19:45:10.316295] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T19:45:10.484908] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:10.529569] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-30T19:45:10.541815] [INFO ] [REMOTE ] LVS: Full fetch complete (77729 records). [2025-10-30T19:45:10.542006] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-30T19:45:10.925687] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-30T19:45:10.957505] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-30T19:45:10.957588] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-30T19:45:10.958722] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-30T19:45:10.958790] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-30T19:45:10.960373] [DEBUG] [LOCAL ] LVS: Trimmed 77729 records to 53959 (keeping 200 days of data) [2025-10-30T19:45:11.283450] [DEBUG] [LOCAL ] LVS: Primary data saved (53959 records). [2025-10-30T19:45:11.283582] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-30T19:45:11.283684] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols completed. LVS took 33.9s. Estimated remaining: 2h 18m 56s. Rate: 7.8 symbols/min [2025-10-30T19:45:11.469293] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:11.499397] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-30T19:45:11.550638] [DEBUG] [LOCAL ] LYB: Loaded 53620 existing records from primary storage. [2025-10-30T19:45:11.551018] [INFO ] [MAIN ] LYB: Loaded 53620 existing records. [2025-10-30T19:45:11.706295] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-30T19:45:11.750160] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:11.750626] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-30T19:45:11.750840] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-30T19:45:11.756355] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-30T19:45:11.761967] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-30T19:45:11.794807] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T19:45:12.113021] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:12.497550] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-30T19:45:12.861009] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-30T19:45:13.297489] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-30T19:45:13.766993] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T19:45:14.098407] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-30T19:45:14.098327] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-30T19:45:14.897564] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-30T19:45:15.172325] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T19:45:15.623117] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T19:45:15.697466] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-30T19:45:16.362715] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T19:45:16.497503] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-30T19:45:17.120046] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-30T19:45:17.297497] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-30T19:45:18.047330] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T19:45:18.097481] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-30T19:45:18.723692] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T19:45:18.897487] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-30T19:45:19.697497] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-30T19:45:20.325143] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-30T19:45:20.497501] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-30T19:45:21.187590] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T19:45:21.219598] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-30T19:45:21.223167] [INFO ] [REMOTE ] LXFR: Full fetch complete (24674 records). [2025-10-30T19:45:21.223275] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-30T19:45:21.302627] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-30T19:45:21.602790] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-30T19:45:21.602879] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-30T19:45:21.603391] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-30T19:45:21.603433] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-30T19:45:21.604055] [DEBUG] [LOCAL ] LXFR: Trimmed 24674 records to 16259 (keeping 200 days of data) [2025-10-30T19:45:21.699390] [DEBUG] [LOCAL ] LXFR: Primary data saved (16259 records). [2025-10-30T19:45:21.699512] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-30T19:45:21.699587] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols completed. LXFR took 17.3s. Estimated remaining: 2h 18m 50s. Rate: 7.8 symbols/min [2025-10-30T19:45:21.870391] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:21.916320] [DEBUG] [LOCAL ] LYG: Loaded 52632 existing records from primary storage. [2025-10-30T19:45:21.916681] [INFO ] [MAIN ] LYG: Loaded 52632 existing records. [2025-10-30T19:45:22.093787] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:22.094031] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-30T19:45:22.094084] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-30T19:45:22.094341] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-30T19:45:22.094380] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-30T19:45:22.105764] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-30T19:45:22.465006] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:22.838537] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T19:45:22.897462] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-30T19:45:22.982036] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-30T19:45:23.697533] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-30T19:45:24.275631] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-30T19:45:24.497526] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-30T19:45:24.909067] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T19:45:25.297472] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-30T19:45:25.717417] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T19:45:26.097506] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-30T19:45:26.639547] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:45:26.897550] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-30T19:45:27.340080] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T19:45:27.697502] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-30T19:45:28.115437] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T19:45:28.497524] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-30T19:45:28.964591] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T19:45:29.297496] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-30T19:45:29.898258] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-30T19:45:30.097539] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-30T19:45:30.596512] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-30T19:45:30.897470] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-30T19:45:31.088669] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T19:45:31.697495] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-30T19:45:32.310262] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-30T19:45:32.497509] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-30T19:45:32.941313] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-30T19:45:33.297543] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-30T19:45:33.491727] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T19:45:34.097548] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-30T19:45:34.765157] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-30T19:45:34.897533] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-30T19:45:35.697493] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-30T19:45:35.955673] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-30T19:45:35.967450] [INFO ] [REMOTE ] LYB: Full fetch complete (77642 records). [2025-10-30T19:45:35.967593] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-30T19:45:36.374343] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-30T19:45:36.374481] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-30T19:45:36.375518] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-30T19:45:36.375626] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-30T19:45:36.404214] [DEBUG] [LOCAL ] LYB: Trimmed 77642 records to 54010 (keeping 200 days of data) [2025-10-30T19:45:36.405904] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-30T19:45:36.503421] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-30T19:45:36.736633] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-30T19:45:36.766937] [DEBUG] [LOCAL ] LYB: Primary data saved (54010 records). [2025-10-30T19:45:36.767081] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-30T19:45:36.767160] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols completed. LYB took 25.5s. Estimated remaining: 2h 18m 49s. Rate: 7.8 symbols/min [2025-10-30T19:45:36.942068] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:36.997115] [DEBUG] [LOCAL ] LYV: Loaded 50874 existing records from primary storage. [2025-10-30T19:45:36.997460] [INFO ] [MAIN ] LYV: Loaded 50874 existing records. [2025-10-30T19:45:37.193212] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:37.193433] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-30T19:45:37.193482] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-30T19:45:37.194042] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-30T19:45:37.194102] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-30T19:45:37.302634] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-30T19:45:37.746827] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:37.844046] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-30T19:45:38.097514] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-30T19:45:38.233127] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-30T19:45:38.897518] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-30T19:45:39.295196] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-30T19:45:39.697468] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-30T19:45:39.872444] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-30T19:45:40.497551] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-30T19:45:40.885506] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T19:45:41.297498] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-30T19:45:41.799967] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T19:45:42.097538] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-30T19:45:42.368757] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-30T19:45:42.897496] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-30T19:45:43.483995] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-30T19:45:43.697524] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-30T19:45:44.301636] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-30T19:45:44.312551] [INFO ] [REMOTE ] LXP: Full fetch complete (72832 records). [2025-10-30T19:45:44.312740] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-30T19:45:44.509808] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-30T19:45:44.727107] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-30T19:45:44.727303] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-30T19:45:44.728434] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-30T19:45:44.728906] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-30T19:45:44.729788] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-30T19:45:44.738353] [DEBUG] [LOCAL ] LXP: Trimmed 72832 records to 51005 (keeping 200 days of data) [2025-10-30T19:45:45.049255] [DEBUG] [LOCAL ] LXP: Primary data saved (51005 records). [2025-10-30T19:45:45.049373] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-30T19:45:45.049462] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols completed. LXP took 37.0s. Estimated remaining: 2h 18m 41s. Rate: 7.8 symbols/min [2025-10-30T19:45:45.217250] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:45.249762] [DEBUG] [LOCAL ] LZB: Loaded 34644 existing records from primary storage. [2025-10-30T19:45:45.250041] [INFO ] [MAIN ] LZB: Loaded 34644 existing records. [2025-10-30T19:45:45.303682] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-30T19:45:45.447894] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:45.448091] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-30T19:45:45.448136] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-30T19:45:45.448411] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-30T19:45:45.448449] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-30T19:45:45.798554] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:45.999877] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-30T19:45:46.097474] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-30T19:45:46.186961] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T19:45:46.897498] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-30T19:45:47.080304] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T19:45:47.697519] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-30T19:45:47.875830] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-30T19:45:47.882732] [INFO ] [REMOTE ] LXU: Full fetch complete (45138 records). [2025-10-30T19:45:47.882831] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-30T19:45:48.251049] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-30T19:45:48.251133] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-30T19:45:48.251890] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-30T19:45:48.251952] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-30T19:45:48.252925] [DEBUG] [LOCAL ] LXU: Trimmed 45138 records to 31353 (keeping 200 days of data) [2025-10-30T19:45:48.444223] [DEBUG] [LOCAL ] LXU: Primary data saved (31353 records). [2025-10-30T19:45:48.444358] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-30T19:45:48.444440] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols completed. LXU took 38.8s. Estimated remaining: 2h 18m 30s. Rate: 7.8 symbols/min [2025-10-30T19:45:48.503284] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-30T19:45:48.629491] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:48.644941] [DEBUG] [LOCAL ] LZM: Loaded 14888 existing records from primary storage. [2025-10-30T19:45:48.645186] [INFO ] [MAIN ] LZM: Loaded 14888 existing records. [2025-10-30T19:45:48.875791] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:48.876155] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-30T19:45:48.876378] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-30T19:45:48.876626] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-30T19:45:48.876811] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-30T19:45:49.202135] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-30T19:45:49.302571] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-30T19:45:49.350772] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:49.489545] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-30T19:45:50.097560] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-30T19:45:50.619725] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-30T19:45:50.661445] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T19:45:50.897519] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-30T19:45:51.697526] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-30T19:45:52.223102] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T19:45:52.497484] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-30T19:45:52.687400] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T19:45:53.297576] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-30T19:45:53.817970] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-30T19:45:54.097524] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-30T19:45:54.318216] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T19:45:54.897518] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-30T19:45:55.376970] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-30T19:45:55.388504] [INFO ] [REMOTE ] LYG: Full fetch complete (76279 records). [2025-10-30T19:45:55.388673] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-30T19:45:55.508112] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T19:45:55.702684] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-30T19:45:55.797778] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-30T19:45:55.797859] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-30T19:45:55.798844] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-30T19:45:55.798908] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-30T19:45:55.800491] [DEBUG] [LOCAL ] LYG: Trimmed 76279 records to 53014 (keeping 200 days of data) [2025-10-30T19:45:56.096073] [DEBUG] [LOCAL ] LYG: Primary data saved (53014 records). [2025-10-30T19:45:56.096197] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-30T19:45:56.096272] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols completed. LYG took 34.4s. Estimated remaining: 2h 18m 22s. Rate: 7.8 symbols/min [2025-10-30T19:45:56.260512] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:45:56.309482] [DEBUG] [LOCAL ] M: Loaded 53542 existing records from primary storage. [2025-10-30T19:45:56.309812] [INFO ] [MAIN ] M: Loaded 53542 existing records. [2025-10-30T19:45:56.484187] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:45:56.484428] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-30T19:45:56.484476] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-30T19:45:56.484914] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-30T19:45:56.484972] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-30T19:45:56.513785] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-30T19:45:56.863096] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:45:56.864137] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-30T19:45:57.297521] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-30T19:45:57.779495] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-30T19:45:58.097603] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-30T19:45:58.619998] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:45:58.897544] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-30T19:45:59.136173] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-30T19:45:59.697497] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-30T19:46:00.120061] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-30T19:46:00.302904] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-30T19:46:00.497480] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-30T19:46:01.297493] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-30T19:46:02.097514] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-30T19:46:02.260969] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-30T19:46:02.406755] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-30T19:46:02.897501] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-30T19:46:03.408518] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-30T19:46:03.697552] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-30T19:46:04.082607] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-30T19:46:04.475020] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T19:46:04.497450] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-30T19:46:05.021485] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-30T19:46:05.297529] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-30T19:46:06.097526] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-30T19:46:06.426331] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-30T19:46:06.897502] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-30T19:46:07.514186] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-30T19:46:07.697504] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-30T19:46:08.142596] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-30T19:46:08.154259] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-30T19:46:08.497494] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-30T19:46:09.297499] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-30T19:46:09.796788] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-30T19:46:10.028494] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-30T19:46:10.097466] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-30T19:46:10.897547] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-30T19:46:11.580899] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-30T19:46:11.697496] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-30T19:46:12.171669] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-30T19:46:12.497498] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-30T19:46:12.697430] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-30T19:46:12.705004] [INFO ] [REMOTE ] LZB: Full fetch complete (50992 records). [2025-10-30T19:46:12.705152] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-30T19:46:13.107288] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-30T19:46:13.107380] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-30T19:46:13.108286] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-30T19:46:13.108358] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-30T19:46:13.109387] [DEBUG] [LOCAL ] LZB: Trimmed 50992 records to 34854 (keeping 200 days of data) [2025-10-30T19:46:13.304303] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-30T19:46:13.318134] [DEBUG] [LOCAL ] LZB: Primary data saved (34854 records). [2025-10-30T19:46:13.318268] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-30T19:46:13.319148] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols completed. LZB took 28.3s. Estimated remaining: 2h 18m 23s. Rate: 7.8 symbols/min [2025-10-30T19:46:13.488505] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:46:13.542102] [DEBUG] [LOCAL ] MA: Loaded 52410 existing records from primary storage. [2025-10-30T19:46:13.542458] [INFO ] [MAIN ] MA: Loaded 52410 existing records. [2025-10-30T19:46:13.717781] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:46:13.717972] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-30T19:46:13.718018] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-30T19:46:13.718746] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-30T19:46:13.718802] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-30T19:46:14.066022] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:46:14.097465] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-30T19:46:14.314082] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-30T19:46:14.325254] [INFO ] [REMOTE ] LYV: Full fetch complete (74179 records). [2025-10-30T19:46:14.325376] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-30T19:46:14.724004] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-30T19:46:14.724080] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-30T19:46:14.725138] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-30T19:46:14.725202] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-30T19:46:14.726601] [DEBUG] [LOCAL ] LYV: Trimmed 74179 records to 51244 (keeping 200 days of data) [2025-10-30T19:46:14.904048] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-30T19:46:15.049918] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-30T19:46:15.077554] [DEBUG] [LOCAL ] LYV: Primary data saved (51244 records). [2025-10-30T19:46:15.077992] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-30T19:46:15.078797] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols completed. LYV took 38.3s. Estimated remaining: 2h 18m 10s. Rate: 7.8 symbols/min [2025-10-30T19:46:15.246583] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:46:15.287626] [DEBUG] [LOCAL ] MAA: Loaded 42867 existing records from primary storage. [2025-10-30T19:46:15.287921] [INFO ] [MAIN ] MAA: Loaded 42867 existing records. [2025-10-30T19:46:15.466157] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:46:15.466449] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-30T19:46:15.466522] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-30T19:46:15.474253] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-30T19:46:15.474511] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T19:46:15.474638] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-30T19:46:15.701549] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-30T19:46:15.842271] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:46:15.871159] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-30T19:46:16.497489] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-30T19:46:17.190747] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-30T19:46:17.297455] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-30T19:46:17.634705] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T19:46:18.097512] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-30T19:46:18.609311] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-30T19:46:18.737048] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-30T19:46:18.897511] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-30T19:46:19.697526] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-30T19:46:19.827618] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-30T19:46:20.497498] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-30T19:46:21.140083] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-30T19:46:21.297525] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-30T19:46:21.710147] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-30T19:46:22.097490] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-30T19:46:22.674543] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-30T19:46:22.897503] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-30T19:46:23.374209] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-30T19:46:23.697468] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-30T19:46:23.843689] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-30T19:46:23.849137] [INFO ] [REMOTE ] LZM: Full fetch complete (20375 records). [2025-10-30T19:46:23.849253] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-30T19:46:24.211091] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-30T19:46:24.211168] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-30T19:46:24.211634] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-30T19:46:24.211715] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-30T19:46:24.212290] [DEBUG] [LOCAL ] LZM: Trimmed 20375 records to 15020 (keeping 200 days of data) [2025-10-30T19:46:24.292626] [DEBUG] [LOCAL ] LZM: Primary data saved (15020 records). [2025-10-30T19:46:24.292782] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-30T19:46:24.292859] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols completed. LZM took 35.8s. Estimated remaining: 2h 18m 3s. Rate: 7.8 symbols/min [2025-10-30T19:46:24.456472] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:46:24.499635] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-30T19:46:24.501790] [DEBUG] [LOCAL ] MAC: Loaded 49357 existing records from primary storage. [2025-10-30T19:46:24.502184] [INFO ] [MAIN ] MAC: Loaded 49357 existing records. [2025-10-30T19:46:24.709555] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:46:24.709812] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-30T19:46:24.709883] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-30T19:46:24.710161] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-30T19:46:24.710218] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-30T19:46:25.243091] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:46:25.302890] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-30T19:46:25.341229] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-30T19:46:25.363079] [INFO ] [REMOTE ] M: Full fetch complete (77655 records). [2025-10-30T19:46:25.363322] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-30T19:46:25.846716] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-30T19:46:25.846887] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-30T19:46:25.848459] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-30T19:46:25.848568] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-30T19:46:25.851392] [DEBUG] [LOCAL ] M: Trimmed 77655 records to 53931 (keeping 200 days of data) [2025-10-30T19:46:26.098894] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-30T19:46:26.205009] [DEBUG] [LOCAL ] M: Primary data saved (53931 records). [2025-10-30T19:46:26.205220] [INFO ] [MAIN ] M: Full history saved. [2025-10-30T19:46:26.205433] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols completed. M took 30.1s. Estimated remaining: 2h 17m 51s. Rate: 7.8 symbols/min [2025-10-30T19:46:26.417846] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:46:26.421996] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-30T19:46:26.488040] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T19:46:26.509472] [DEBUG] [LOCAL ] MAGN: Loaded 35760 existing records from primary storage. [2025-10-30T19:46:26.509792] [INFO ] [MAIN ] MAGN: Loaded 35760 existing records. [2025-10-30T19:46:26.685274] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:46:26.685509] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-30T19:46:26.685556] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-30T19:46:26.685784] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-30T19:46:26.685840] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-30T19:46:26.902704] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-30T19:46:27.041433] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:46:27.116814] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-30T19:46:27.697493] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-30T19:46:28.042097] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:46:28.497552] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-30T19:46:28.798988] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:46:29.297538] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-30T19:46:30.033842] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T19:46:30.097498] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-30T19:46:30.588619] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-30T19:46:30.897533] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-30T19:46:31.343253] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-30T19:46:31.697491] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-30T19:46:32.412898] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-30T19:46:32.497492] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-30T19:46:32.543129] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T19:46:32.555489] [DEBUG] [REMOTE ] MAC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-30T19:46:32.555988] [WARN ] [REMOTE ] MAC: No data returned for month 2025-04 [2025-10-30T19:46:32.556094] [FATAL] [REMOTE ] MAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-30T19:46:32.556194] [FATAL] [MAIN ] MAC: Failed to fetch primary data. [2025-10-30T19:46:32.556261] [WARN ] [MAIN ] MAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-30T19:46:32.556339] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-30T19:46:32.556412] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-30T19:46:32.556452] [INFO ] [LOCAL ] MAC: Starting deletion of derivative data. [2025-10-30T19:46:32.556945] [DEBUG] [LOCAL ] MAC: Deleted derivative data file. [2025-10-30T19:46:32.557553] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols completed. MAC took 8.3s. Estimated remaining: 2h 17m 42s. Rate: 7.8 symbols/min [2025-10-30T19:46:32.727521] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:46:32.766510] [DEBUG] [LOCAL ] MAIN: Loaded 41641 existing records from primary storage. [2025-10-30T19:46:32.766840] [INFO ] [MAIN ] MAIN: Loaded 41641 existing records. [2025-10-30T19:46:32.961450] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:46:32.961709] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-30T19:46:32.961774] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-30T19:46:32.962161] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-30T19:46:32.962203] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-30T19:46:33.301230] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-30T19:46:33.325161] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:46:34.097497] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-30T19:46:34.488118] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-30T19:46:34.897531] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-30T19:46:35.370954] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-30T19:46:35.697491] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-30T19:46:35.843406] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-30T19:46:36.497584] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-30T19:46:37.180227] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-30T19:46:37.297475] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-30T19:46:37.419414] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T19:46:38.097540] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-30T19:46:38.435186] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:46:38.897567] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-30T19:46:39.632903] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-30T19:46:39.697457] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-30T19:46:40.010336] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-30T19:46:40.497540] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-30T19:46:41.029281] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-30T19:46:41.297531] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-30T19:46:41.663890] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-30T19:46:42.097493] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-30T19:46:42.650198] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-30T19:46:42.897497] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-30T19:46:43.408299] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-30T19:46:43.418783] [INFO ] [REMOTE ] MAA: Full fetch complete (62226 records). [2025-10-30T19:46:43.418935] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-30T19:46:43.698680] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-30T19:46:43.822360] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-30T19:46:43.822461] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-30T19:46:43.823353] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-30T19:46:43.823536] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-30T19:46:43.824862] [DEBUG] [LOCAL ] MAA: Trimmed 62226 records to 43253 (keeping 200 days of data) [2025-10-30T19:46:43.951415] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T19:46:43.990892] [INFO ] [REMOTE ] MA: Full fetch complete (76368 records). [2025-10-30T19:46:43.996796] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-30T19:46:44.293893] [DEBUG] [LOCAL ] MAA: Primary data saved (43253 records). [2025-10-30T19:46:44.319197] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-30T19:46:44.319329] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols completed. MAA took 29.2s. Estimated remaining: 2h 17m 38s. Rate: 7.8 symbols/min [2025-10-30T19:46:44.509236] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-30T19:46:44.699239] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:46:44.795077] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-30T19:46:44.795392] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-30T19:46:44.797125] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-30T19:46:44.797394] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-30T19:46:44.800006] [DEBUG] [LOCAL ] MA: Trimmed 76368 records to 52795 (keeping 200 days of data) [2025-10-30T19:46:44.944591] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-30T19:46:45.050936] [DEBUG] [LOCAL ] MAN: Loaded 44346 existing records from primary storage. [2025-10-30T19:46:45.076174] [INFO ] [MAIN ] MAN: Loaded 44346 existing records. [2025-10-30T19:46:45.285838] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:46:45.298847] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-30T19:46:45.301414] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-30T19:46:45.309060] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-30T19:46:45.350346] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-30T19:46:45.367532] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-30T19:46:45.520172] [DEBUG] [LOCAL ] MA: Primary data saved (52795 records). [2025-10-30T19:46:45.526287] [INFO ] [MAIN ] MA: Full history saved. [2025-10-30T19:46:45.527680] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols completed. MA took 32.2s. Estimated remaining: 2h 17m 25s. Rate: 7.8 symbols/min [2025-10-30T19:46:45.931583] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:46:46.026522] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:46:46.065323] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-30T19:46:46.083274] [DEBUG] [LOCAL ] MANU: Loaded 26758 existing records from primary storage. [2025-10-30T19:46:46.083536] [INFO ] [MAIN ] MANU: Loaded 26758 existing records. [2025-10-30T19:46:46.103959] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-30T19:46:46.263086] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:46:46.263308] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-30T19:46:46.263361] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-30T19:46:46.263597] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-30T19:46:46.263689] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-30T19:46:46.625931] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:46:46.645334] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-30T19:46:46.897482] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-30T19:46:47.441758] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T19:46:47.697493] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-30T19:46:47.881536] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-30T19:46:48.327007] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-30T19:46:48.497495] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-30T19:46:49.297548] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-30T19:46:49.313550] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T19:46:50.097529] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-30T19:46:50.283001] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-30T19:46:50.897463] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-30T19:46:51.108478] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T19:46:51.697491] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-30T19:46:51.806333] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-30T19:46:52.497464] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-30T19:46:52.635289] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-30T19:46:53.297483] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-30T19:46:53.369787] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T19:46:54.097464] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-30T19:46:54.175740] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-30T19:46:54.897485] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-30T19:46:54.922234] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-30T19:46:55.697526] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-30T19:46:56.303321] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-30T19:46:56.497494] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-30T19:46:56.754683] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-30T19:46:57.297535] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-30T19:46:57.613824] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-30T19:46:58.097525] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-30T19:46:58.422754] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-30T19:46:58.897470] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-30T19:46:59.230355] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-30T19:46:59.239377] [INFO ] [REMOTE ] MAGN: Full fetch complete (52000 records). [2025-10-30T19:46:59.239519] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-30T19:46:59.613598] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-30T19:46:59.613711] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-30T19:46:59.614488] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-30T19:46:59.614528] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-30T19:46:59.615529] [DEBUG] [LOCAL ] MAGN: Trimmed 52000 records to 36042 (keeping 200 days of data) [2025-10-30T19:46:59.701855] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-30T19:46:59.748307] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-30T19:46:59.842909] [DEBUG] [LOCAL ] MAGN: Primary data saved (36042 records). [2025-10-30T19:46:59.843026] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-30T19:46:59.843099] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols completed. MAGN took 33.6s. Estimated remaining: 2h 17m 22s. Rate: 7.8 symbols/min [2025-10-30T19:47:00.006593] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:00.053289] [DEBUG] [LOCAL ] MAS: Loaded 52160 existing records from primary storage. [2025-10-30T19:47:00.053621] [INFO ] [MAIN ] MAS: Loaded 52160 existing records. [2025-10-30T19:47:00.235868] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:00.236110] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-30T19:47:00.236160] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-30T19:47:00.236803] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-30T19:47:00.236863] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-30T19:47:00.505499] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-30T19:47:00.584697] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:01.035249] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-30T19:47:01.297513] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-30T19:47:02.097481] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-30T19:47:02.121917] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-30T19:47:02.619098] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-30T19:47:02.667531] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-30T19:47:02.897536] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-30T19:47:03.697475] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-30T19:47:04.018245] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-30T19:47:04.497467] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-30T19:47:04.612037] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-30T19:47:05.297490] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-30T19:47:05.557325] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-30T19:47:06.097479] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-30T19:47:06.479715] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-30T19:47:06.486115] [INFO ] [REMOTE ] MANU: Full fetch complete (39362 records). [2025-10-30T19:47:06.486250] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-30T19:47:06.861733] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-30T19:47:06.861814] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-30T19:47:06.862492] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-30T19:47:06.862533] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-30T19:47:06.863373] [DEBUG] [LOCAL ] MANU: Trimmed 39362 records to 26899 (keeping 200 days of data) [2025-10-30T19:47:06.911287] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-30T19:47:07.021053] [DEBUG] [LOCAL ] MANU: Primary data saved (26899 records). [2025-10-30T19:47:07.021185] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-30T19:47:07.021265] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols completed. MANU took 21.5s. Estimated remaining: 2h 17m 14s. Rate: 7.8 symbols/min [2025-10-30T19:47:07.204838] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:07.238792] [DEBUG] [LOCAL ] MATV: Loaded 34313 existing records from primary storage. [2025-10-30T19:47:07.239073] [INFO ] [MAIN ] MATV: Loaded 34313 existing records. [2025-10-30T19:47:07.430589] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:07.431127] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-30T19:47:07.431204] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-30T19:47:07.431583] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-30T19:47:07.431715] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-30T19:47:07.708005] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-30T19:47:07.846301] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-30T19:47:07.844155] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:08.028555] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-30T19:47:08.497511] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-30T19:47:09.068770] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-30T19:47:09.297458] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-30T19:47:09.435433] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-30T19:47:10.097505] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-30T19:47:10.293825] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-30T19:47:10.897500] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-30T19:47:11.109094] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-30T19:47:11.697493] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-30T19:47:11.898168] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-30T19:47:12.497521] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-30T19:47:12.724087] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-30T19:47:13.297538] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-30T19:47:14.033183] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-30T19:47:14.097460] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-30T19:47:14.897581] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-30T19:47:15.077389] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-30T19:47:15.088047] [INFO ] [REMOTE ] MAIN: Full fetch complete (60341 records). [2025-10-30T19:47:15.088199] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-30T19:47:15.485432] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-30T19:47:15.485524] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-30T19:47:15.486485] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-30T19:47:15.486584] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-30T19:47:15.499000] [DEBUG] [LOCAL ] MAIN: Trimmed 60341 records to 41928 (keeping 200 days of data) [2025-10-30T19:47:15.518306] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-30T19:47:15.699552] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-30T19:47:15.782270] [DEBUG] [LOCAL ] MAIN: Primary data saved (41928 records). [2025-10-30T19:47:15.782403] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-30T19:47:15.783054] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols completed. MAIN took 43.2s. Estimated remaining: 2h 17m 7s. Rate: 7.8 symbols/min [2025-10-30T19:47:15.919529] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-30T19:47:15.997311] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:16.030078] [DEBUG] [LOCAL ] MATX: Loaded 31332 existing records from primary storage. [2025-10-30T19:47:16.030375] [INFO ] [MAIN ] MATX: Loaded 31332 existing records. [2025-10-30T19:47:16.218042] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:16.218252] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-30T19:47:16.218300] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-30T19:47:16.219016] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-30T19:47:16.219076] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-30T19:47:16.499825] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-30T19:47:16.581605] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:17.015482] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-30T19:47:17.297522] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-30T19:47:17.628532] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-30T19:47:18.097485] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-30T19:47:18.120476] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-30T19:47:18.897510] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-30T19:47:19.541988] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-30T19:47:19.697499] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-30T19:47:20.050500] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:47:20.497477] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-30T19:47:20.623067] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-30T19:47:21.297496] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-30T19:47:21.704727] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-30T19:47:22.097479] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-30T19:47:22.203709] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-30T19:47:22.897457] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-30T19:47:23.114797] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T19:47:23.697502] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-30T19:47:24.342553] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-30T19:47:24.353447] [INFO ] [REMOTE ] MAN: Full fetch complete (63181 records). [2025-10-30T19:47:24.353618] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-30T19:47:24.510602] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-30T19:47:24.781168] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-30T19:47:24.781318] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-30T19:47:24.782755] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-30T19:47:24.782857] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-30T19:47:24.804730] [DEBUG] [LOCAL ] MAN: Trimmed 63181 records to 44698 (keeping 200 days of data) [2025-10-30T19:47:24.806599] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-30T19:47:25.074246] [DEBUG] [LOCAL ] MAN: Primary data saved (44698 records). [2025-10-30T19:47:25.074383] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-30T19:47:25.075249] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols completed. MAN took 40.8s. Estimated remaining: 2h 17m 1s. Rate: 7.8 symbols/min [2025-10-30T19:47:25.240863] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:25.271476] [DEBUG] [LOCAL ] MAX: Loaded 30447 existing records from primary storage. [2025-10-30T19:47:25.271780] [INFO ] [MAIN ] MAX: Loaded 30447 existing records. [2025-10-30T19:47:25.302785] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-30T19:47:25.449043] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:25.449256] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-30T19:47:25.449303] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-30T19:47:25.449600] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-30T19:47:25.449639] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-30T19:47:25.803753] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:25.894225] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-30T19:47:26.097508] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-30T19:47:26.400070] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-30T19:47:26.897470] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-30T19:47:26.945154] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-30T19:47:27.697478] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-30T19:47:27.834927] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T19:47:28.497478] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-30T19:47:28.586438] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-30T19:47:29.297505] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-30T19:47:30.087700] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-30T19:47:30.099028] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-30T19:47:30.101685] [INFO ] [REMOTE ] MAS: Full fetch complete (75452 records). [2025-10-30T19:47:30.102016] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-30T19:47:30.332462] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T19:47:30.567338] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-30T19:47:30.567419] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-30T19:47:30.568439] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-30T19:47:30.568504] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-30T19:47:30.570079] [DEBUG] [LOCAL ] MAS: Trimmed 75452 records to 52549 (keeping 200 days of data) [2025-10-30T19:47:30.879357] [DEBUG] [LOCAL ] MAS: Primary data saved (52549 records). [2025-10-30T19:47:30.879495] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-30T19:47:30.879589] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols completed. MAS took 31.0s. Estimated remaining: 2h 16m 52s. Rate: 7.8 symbols/min [2025-10-30T19:47:30.902690] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-30T19:47:31.050442] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:31.096598] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-30T19:47:31.119945] [DEBUG] [LOCAL ] MBC: Loaded 43666 existing records from primary storage. [2025-10-30T19:47:31.120284] [INFO ] [MAIN ] MBC: Loaded 43666 existing records. [2025-10-30T19:47:31.292491] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:31.292754] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-30T19:47:31.292809] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-30T19:47:31.293573] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-30T19:47:31.293630] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-30T19:47:31.660513] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:31.697454] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-30T19:47:32.023994] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-30T19:47:32.030249] [INFO ] [REMOTE ] MATV: Full fetch complete (51809 records). [2025-10-30T19:47:32.030350] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-30T19:47:32.397138] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-30T19:47:32.397213] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-30T19:47:32.398011] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-30T19:47:32.398074] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-30T19:47:32.399100] [DEBUG] [LOCAL ] MATV: Trimmed 51809 records to 34468 (keeping 200 days of data) [2025-10-30T19:47:32.497558] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-30T19:47:32.595463] [DEBUG] [LOCAL ] MATV: Primary data saved (34468 records). [2025-10-30T19:47:32.595584] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-30T19:47:32.596414] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols completed. MATV took 25.6s. Estimated remaining: 2h 16m 39s. Rate: 7.8 symbols/min [2025-10-30T19:47:32.764031] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:32.789457] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-30T19:47:32.814052] [DEBUG] [LOCAL ] MBI: Loaded 23394 existing records from primary storage. [2025-10-30T19:47:32.814282] [INFO ] [MAIN ] MBI: Loaded 23394 existing records. [2025-10-30T19:47:32.984465] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:32.984678] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-30T19:47:32.984735] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-30T19:47:32.984987] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-30T19:47:32.985043] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-30T19:47:33.304584] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-30T19:47:33.333412] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:33.476151] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-30T19:47:34.097496] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-30T19:47:34.360571] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-30T19:47:34.840993] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-30T19:47:34.897479] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-30T19:47:35.697461] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-30T19:47:35.730113] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-30T19:47:36.497456] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-30T19:47:36.530504] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-30T19:47:37.297464] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-30T19:47:37.444685] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-30T19:47:38.097457] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-30T19:47:38.119696] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-30T19:47:38.897459] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-30T19:47:39.044795] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-30T19:47:39.697464] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-30T19:47:39.804154] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-30T19:47:40.497470] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-30T19:47:40.556264] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T19:47:41.297476] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-30T19:47:41.468257] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-30T19:47:42.097540] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-30T19:47:42.171459] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-30T19:47:42.897492] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-30T19:47:43.090860] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-30T19:47:43.702577] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-30T19:47:43.710717] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-30T19:47:44.477688] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-30T19:47:44.497471] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-30T19:47:45.169238] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-30T19:47:45.297500] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-30T19:47:45.932356] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-30T19:47:46.097521] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-30T19:47:46.897566] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-30T19:47:47.167325] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-30T19:47:47.697541] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-30T19:47:47.822082] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-30T19:47:48.497543] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-30T19:47:48.778782] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-30T19:47:49.291184] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-30T19:47:49.298428] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-30T19:47:50.097540] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-30T19:47:50.181126] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-30T19:47:50.897521] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-30T19:47:51.245961] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:47:51.670133] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-30T19:47:51.697480] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-30T19:47:52.497492] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-30T19:47:52.644047] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-30T19:47:52.649395] [INFO ] [REMOTE ] MBI: Full fetch complete (35377 records). [2025-10-30T19:47:52.649495] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-30T19:47:53.021561] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-30T19:47:53.021637] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-30T19:47:53.022373] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-30T19:47:53.022415] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-30T19:47:53.023155] [DEBUG] [LOCAL ] MBI: Trimmed 35377 records to 23555 (keeping 200 days of data) [2025-10-30T19:47:53.150805] [DEBUG] [LOCAL ] MBI: Primary data saved (23555 records). [2025-10-30T19:47:53.150941] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-30T19:47:53.151174] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols completed. MBI took 20.6s. Estimated remaining: 2h 16m 42s. Rate: 7.8 symbols/min [2025-10-30T19:47:53.298672] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-30T19:47:53.323469] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:53.345567] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-30T19:47:53.389012] [DEBUG] [LOCAL ] MC: Loaded 43332 existing records from primary storage. [2025-10-30T19:47:53.389349] [INFO ] [MAIN ] MC: Loaded 43332 existing records. [2025-10-30T19:47:53.564924] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:53.565126] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-30T19:47:53.565175] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-30T19:47:53.566070] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-30T19:47:53.566127] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-30T19:47:53.905504] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:54.097492] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-30T19:47:54.285334] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-30T19:47:54.897533] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-30T19:47:55.157521] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-30T19:47:55.165401] [INFO ] [REMOTE ] MAX: Full fetch complete (45158 records). [2025-10-30T19:47:55.165527] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-30T19:47:55.553295] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-30T19:47:55.553403] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-30T19:47:55.554259] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-30T19:47:55.554326] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-30T19:47:55.555297] [DEBUG] [LOCAL ] MAX: Trimmed 45158 records to 30802 (keeping 200 days of data) [2025-10-30T19:47:55.699874] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-30T19:47:55.733115] [DEBUG] [LOCAL ] MAX: Primary data saved (30802 records). [2025-10-30T19:47:55.733213] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-30T19:47:55.733299] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols completed. MAX took 30.7s. Estimated remaining: 2h 16m 30s. Rate: 7.8 symbols/min [2025-10-30T19:47:55.902596] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:55.914146] [DEBUG] [LOCAL ] MCB: Loaded 11315 existing records from primary storage. [2025-10-30T19:47:55.914354] [INFO ] [MAIN ] MCB: Loaded 11315 existing records. [2025-10-30T19:47:56.106921] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:47:56.115868] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-30T19:47:56.117220] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-30T19:47:56.116281] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-30T19:47:56.126869] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-30T19:47:56.126937] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-30T19:47:56.486622] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:56.497461] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-30T19:47:56.905766] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-30T19:47:56.912506] [INFO ] [REMOTE ] MATX: Full fetch complete (44160 records). [2025-10-30T19:47:56.912604] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-30T19:47:57.121186] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-30T19:47:57.299961] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-30T19:47:57.315225] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-30T19:47:57.315306] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-30T19:47:57.316104] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-30T19:47:57.316275] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-30T19:47:57.317227] [DEBUG] [LOCAL ] MATX: Trimmed 44160 records to 31505 (keeping 200 days of data) [2025-10-30T19:47:57.501021] [DEBUG] [LOCAL ] MATX: Primary data saved (31505 records). [2025-10-30T19:47:57.501150] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-30T19:47:57.501225] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols completed. MATX took 41.7s. Estimated remaining: 2h 16m 17s. Rate: 7.8 symbols/min [2025-10-30T19:47:57.664893] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:47:57.665050] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-30T19:47:57.665085] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-30T19:47:57.665190] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-30T19:47:57.665250] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-30T19:47:57.665292] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-30T19:47:57.665323] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-30T19:47:58.005990] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:47:58.097455] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-30T19:47:58.499107] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-30T19:47:58.897494] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-30T19:47:59.681244] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-30T19:47:59.697448] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-30T19:47:59.973768] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-30T19:48:00.497561] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-30T19:48:01.110679] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-30T19:48:01.297471] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-30T19:48:01.395412] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-30T19:48:02.097540] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-30T19:48:02.435576] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T19:48:02.665110] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-30T19:48:02.897551] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-30T19:48:03.697539] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-30T19:48:04.046021] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-30T19:48:04.497491] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-30T19:48:04.876863] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-30T19:48:05.297579] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-30T19:48:05.665594] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-30T19:48:05.848599] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-30T19:48:06.097528] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-30T19:48:06.897504] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-30T19:48:07.402389] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-30T19:48:07.697531] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-30T19:48:08.316454] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T19:48:08.326890] [INFO ] [REMOTE ] MBC: Full fetch complete (63152 records). [2025-10-30T19:48:08.327046] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-30T19:48:08.512960] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-30T19:48:08.760765] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-30T19:48:08.760852] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-30T19:48:08.761777] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-30T19:48:08.761842] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-30T19:48:08.763231] [DEBUG] [LOCAL ] MBC: Trimmed 63152 records to 44006 (keeping 200 days of data) [2025-10-30T19:48:09.011495] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-30T19:48:09.081932] [DEBUG] [LOCAL ] MBC: Primary data saved (44006 records). [2025-10-30T19:48:09.082056] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-30T19:48:09.082367] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols completed. MBC took 38.2s. Estimated remaining: 2h 16m 13s. Rate: 7.8 symbols/min [2025-10-30T19:48:09.251624] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:48:09.260051] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-30T19:48:09.268271] [DEBUG] [LOCAL ] MCI: Loaded 6090 existing records from primary storage. [2025-10-30T19:48:09.268433] [INFO ] [MAIN ] MCI: Loaded 6090 existing records. [2025-10-30T19:48:09.302690] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-30T19:48:09.449181] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:48:09.449391] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-30T19:48:09.449441] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-30T19:48:09.449691] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-30T19:48:09.449748] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-30T19:48:09.799976] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:48:10.097504] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-30T19:48:10.604096] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T19:48:10.897473] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-30T19:48:10.953269] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-30T19:48:11.489786] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-30T19:48:11.697509] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-30T19:48:12.497510] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-30T19:48:12.981154] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-30T19:48:13.297474] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-30T19:48:13.502846] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-30T19:48:14.097509] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-30T19:48:14.437416] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:48:14.897506] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-30T19:48:15.675610] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-30T19:48:15.697488] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-30T19:48:15.987570] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-30T19:48:16.497495] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-30T19:48:16.977302] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-30T19:48:17.297494] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-30T19:48:17.362409] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-30T19:48:17.791014] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-30T19:48:18.097437] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-30T19:48:18.897495] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-30T19:48:19.205413] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-30T19:48:19.697505] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-30T19:48:20.087512] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-30T19:48:20.402929] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-30T19:48:20.497468] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-30T19:48:21.266780] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-30T19:48:21.270126] [INFO ] [REMOTE ] MCB: Full fetch complete (17058 records). [2025-10-30T19:48:21.270196] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-30T19:48:21.302689] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-30T19:48:21.624200] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-30T19:48:21.624279] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-30T19:48:21.624574] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-30T19:48:21.624612] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-30T19:48:21.625111] [DEBUG] [LOCAL ] MCB: Trimmed 17058 records to 11469 (keeping 200 days of data) [2025-10-30T19:48:21.696489] [DEBUG] [LOCAL ] MCB: Primary data saved (11469 records). [2025-10-30T19:48:21.696750] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-30T19:48:21.696872] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols completed. MCB took 26.0s. Estimated remaining: 2h 16m 9s. Rate: 7.8 symbols/min [2025-10-30T19:48:21.864836] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:48:21.899599] [DEBUG] [LOCAL ] MCK: Loaded 37281 existing records from primary storage. [2025-10-30T19:48:21.899913] [INFO ] [MAIN ] MCK: Loaded 37281 existing records. [2025-10-30T19:48:22.072053] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:48:22.072247] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-30T19:48:22.072293] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-30T19:48:22.073104] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-30T19:48:22.073161] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-30T19:48:22.103177] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-30T19:48:22.418193] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:48:22.722463] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-30T19:48:22.732779] [INFO ] [REMOTE ] MC: Full fetch complete (63310 records). [2025-10-30T19:48:22.732988] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-30T19:48:22.898568] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-30T19:48:23.126985] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-30T19:48:23.127061] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-30T19:48:23.127989] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-30T19:48:23.128058] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-30T19:48:23.129292] [DEBUG] [LOCAL ] MC: Trimmed 63310 records to 43706 (keeping 200 days of data) [2025-10-30T19:48:23.339502] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-30T19:48:23.391094] [DEBUG] [LOCAL ] MC: Primary data saved (43706 records). [2025-10-30T19:48:23.391223] [INFO ] [MAIN ] MC: Full history saved. [2025-10-30T19:48:23.392150] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols completed. MC took 30.2s. Estimated remaining: 2h 15m 56s. Rate: 7.8 symbols/min [2025-10-30T19:48:23.562397] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:48:23.571898] [DEBUG] [LOCAL ] MCN: Loaded 7808 existing records from primary storage. [2025-10-30T19:48:23.572325] [INFO ] [MAIN ] MCN: Loaded 7808 existing records. [2025-10-30T19:48:23.698550] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-30T19:48:23.750379] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:48:23.751366] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-30T19:48:23.751426] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-30T19:48:23.751832] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-30T19:48:23.751940] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-30T19:48:24.143965] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:48:24.138223] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-30T19:48:24.238732] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-30T19:48:24.497491] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-30T19:48:25.297502] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-30T19:48:25.856123] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-30T19:48:25.990294] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-30T19:48:26.097534] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-30T19:48:26.897531] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-30T19:48:27.236840] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-30T19:48:27.605479] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-30T19:48:27.697490] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-30T19:48:28.219812] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-30T19:48:28.497494] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-30T19:48:28.875352] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-30T19:48:29.297509] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-30T19:48:30.097495] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-30T19:48:30.563915] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-30T19:48:30.897534] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-30T19:48:31.121601] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-30T19:48:31.133624] [INFO ] [REMOTE ] MCD: Full fetch complete (77114 records). [2025-10-30T19:48:31.133814] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-30T19:48:31.265031] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-30T19:48:31.355835] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-30T19:48:31.356683] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-30T19:48:31.356756] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-30T19:48:31.356830] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-30T19:48:31.356898] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-30T19:48:31.356936] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-30T19:48:31.356977] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-30T19:48:31.357035] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols completed. MCD took 33.9s. Estimated remaining: 2h 15m 49s. Rate: 7.8 symbols/min [2025-10-30T19:48:31.536747] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:48:31.572199] [DEBUG] [LOCAL ] MCO: Loaded 39195 existing records from primary storage. [2025-10-30T19:48:31.572465] [INFO ] [MAIN ] MCO: Loaded 39195 existing records. [2025-10-30T19:48:31.702771] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-30T19:48:31.771243] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:48:31.771593] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-30T19:48:31.771673] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-30T19:48:31.772734] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-30T19:48:31.772796] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-30T19:48:32.174727] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:48:32.254782] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T19:48:32.497489] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-30T19:48:32.984501] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-30T19:48:32.986326] [INFO ] [REMOTE ] MCI: Full fetch complete (9780 records). [2025-10-30T19:48:32.986393] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-30T19:48:33.306596] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-30T19:48:33.350346] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-30T19:48:33.350426] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-30T19:48:33.350711] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-30T19:48:33.350771] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-30T19:48:33.351196] [DEBUG] [LOCAL ] MCI: Trimmed 9780 records to 6169 (keeping 200 days of data) [2025-10-30T19:48:33.389244] [DEBUG] [LOCAL ] MCI: Primary data saved (6169 records). [2025-10-30T19:48:33.389398] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-30T19:48:33.389489] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols completed. MCI took 24.3s. Estimated remaining: 2h 15m 37s. Rate: 7.8 symbols/min [2025-10-30T19:48:33.556383] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:48:33.565524] [DEBUG] [LOCAL ] MCR: Loaded 8871 existing records from primary storage. [2025-10-30T19:48:33.565751] [INFO ] [MAIN ] MCR: Loaded 8871 existing records. [2025-10-30T19:48:33.742948] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:48:33.743162] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-30T19:48:33.743210] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-30T19:48:33.743483] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-30T19:48:33.743541] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-30T19:48:33.997639] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T19:48:34.102622] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-30T19:48:34.106715] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:48:34.596736] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-30T19:48:34.897515] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-30T19:48:35.697490] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-30T19:48:36.058849] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-30T19:48:36.188716] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T19:48:36.497496] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-30T19:48:36.985787] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-30T19:48:37.297520] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-30T19:48:38.097493] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-30T19:48:38.409826] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-30T19:48:38.897484] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-30T19:48:39.140843] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-30T19:48:39.361413] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-30T19:48:39.697515] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-30T19:48:40.497536] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-30T19:48:40.935551] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-30T19:48:41.007796] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-30T19:48:41.297519] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-30T19:48:42.097554] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-30T19:48:42.508079] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T19:48:42.869869] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-30T19:48:42.897489] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-30T19:48:43.392784] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-30T19:48:43.697541] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-30T19:48:44.174263] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-30T19:48:44.497506] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-30T19:48:45.297508] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-30T19:48:45.633037] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-30T19:48:45.855746] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-30T19:48:46.097530] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-30T19:48:46.700680] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-30T19:48:46.703048] [INFO ] [REMOTE ] MCN: Full fetch complete (11496 records). [2025-10-30T19:48:46.703119] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-30T19:48:46.905529] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-30T19:48:47.131212] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-30T19:48:47.131329] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-30T19:48:47.131705] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-30T19:48:47.131790] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-30T19:48:47.132426] [DEBUG] [LOCAL ] MCN: Trimmed 11496 records to 7835 (keeping 200 days of data) [2025-10-30T19:48:47.179825] [DEBUG] [LOCAL ] MCN: Primary data saved (7835 records). [2025-10-30T19:48:47.179979] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-30T19:48:47.180103] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols completed. MCN took 23.8s. Estimated remaining: 2h 15m 34s. Rate: 7.8 symbols/min [2025-10-30T19:48:47.361182] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:48:47.381880] [DEBUG] [LOCAL ] MCS: Loaded 21084 existing records from primary storage. [2025-10-30T19:48:47.382121] [INFO ] [MAIN ] MCS: Loaded 21084 existing records. [2025-10-30T19:48:47.553994] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:48:47.554265] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-30T19:48:47.554323] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-30T19:48:47.555347] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-30T19:48:47.555405] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-30T19:48:47.703554] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-30T19:48:47.908760] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:48:48.015850] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-30T19:48:48.310815] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-30T19:48:48.497481] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-30T19:48:49.297524] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-30T19:48:49.729573] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-30T19:48:50.087985] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T19:48:50.097447] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-30T19:48:50.833903] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-30T19:48:50.897452] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-30T19:48:51.697476] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-30T19:48:51.732267] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-30T19:48:52.169262] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-30T19:48:52.497499] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-30T19:48:52.919635] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-30T19:48:53.297514] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-30T19:48:53.745958] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-30T19:48:54.097501] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-30T19:48:54.604147] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-30T19:48:54.897512] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-30T19:48:55.697482] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-30T19:48:55.916113] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-30T19:48:56.130153] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-30T19:48:56.497495] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-30T19:48:57.297505] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-30T19:48:57.709440] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-30T19:48:57.998231] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-30T19:48:58.097503] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-30T19:48:58.897465] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-30T19:48:59.107573] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-30T19:48:59.697475] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-30T19:48:59.953948] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-30T19:49:00.497514] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-30T19:49:00.798549] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-30T19:49:01.235724] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-30T19:49:01.297509] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-30T19:49:02.097510] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-30T19:49:02.548781] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-30T19:49:02.792179] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-30T19:49:02.897512] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-30T19:49:03.697498] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-30T19:49:03.771757] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-30T19:49:04.497498] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-30T19:49:04.662125] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T19:49:05.297497] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-30T19:49:05.630237] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-30T19:49:06.097535] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-30T19:49:06.421194] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T19:49:06.897497] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-30T19:49:07.212004] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-30T19:49:07.219250] [INFO ] [REMOTE ] MCK: Full fetch complete (56268 records). [2025-10-30T19:49:07.219372] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-30T19:49:07.517877] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-30T19:49:07.541201] [INFO ] [REMOTE ] MCR: Full fetch complete (13151 records). [2025-10-30T19:49:07.556140] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-30T19:49:07.713448] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-30T19:49:07.713982] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-30T19:49:07.715216] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-30T19:49:07.722063] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-30T19:49:07.722165] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-30T19:49:07.801164] [DEBUG] [LOCAL ] MCK: Trimmed 56268 records to 37557 (keeping 200 days of data) [2025-10-30T19:49:08.109080] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-30T19:49:08.111576] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-30T19:49:08.119036] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-30T19:49:08.122234] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-30T19:49:08.128497] [DEBUG] [LOCAL ] MCR: Trimmed 13151 records to 8914 (keeping 200 days of data) [2025-10-30T19:49:08.289201] [DEBUG] [LOCAL ] MCR: Primary data saved (8914 records). [2025-10-30T19:49:08.292371] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-30T19:49:08.292510] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols completed. MCR took 34.9s. Estimated remaining: 2h 15m 37s. Rate: 7.8 symbols/min [2025-10-30T19:49:08.292185] [DEBUG] [LOCAL ] MCK: Primary data saved (37557 records). [2025-10-30T19:49:08.292899] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-30T19:49:08.304390] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols completed. MCK took 46.6s. Estimated remaining: 2h 15m 23s. Rate: 7.8 symbols/min [2025-10-30T19:49:08.501130] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-30T19:49:08.620111] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:08.653000] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:08.669934] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-30T19:49:08.693562] [DEBUG] [LOCAL ] MCY: Loaded 22870 existing records from primary storage. [2025-10-30T19:49:08.693850] [INFO ] [MAIN ] MCY: Loaded 22870 existing records. [2025-10-30T19:49:08.845298] [DEBUG] [LOCAL ] MD: Loaded 38404 existing records from primary storage. [2025-10-30T19:49:08.874319] [INFO ] [MAIN ] MD: Loaded 38404 existing records. [2025-10-30T19:49:08.938516] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:08.998380] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-30T19:49:09.008771] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-30T19:49:09.014714] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-30T19:49:09.025119] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-30T19:49:09.142942] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:09.187636] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-30T19:49:09.207014] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-30T19:49:09.238052] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-30T19:49:09.238147] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-30T19:49:09.307382] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-30T19:49:09.806697] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:09.875123] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:09.992703] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-30T19:49:10.003750] [INFO ] [REMOTE ] MCO: Full fetch complete (58500 records). [2025-10-30T19:49:10.003912] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-30T19:49:10.098412] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-30T19:49:10.336616] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-30T19:49:10.419490] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-30T19:49:10.419576] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-30T19:49:10.420484] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-30T19:49:10.420552] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-30T19:49:10.421831] [DEBUG] [LOCAL ] MCO: Trimmed 58500 records to 39506 (keeping 200 days of data) [2025-10-30T19:49:10.665594] [DEBUG] [LOCAL ] MCO: Primary data saved (39506 records). [2025-10-30T19:49:10.665767] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-30T19:49:10.666447] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols completed. MCO took 39.3s. Estimated remaining: 2h 15m 11s. Rate: 7.8 symbols/min [2025-10-30T19:49:10.832475] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:10.841008] [DEBUG] [LOCAL ] MDST: Loaded 6233 existing records from primary storage. [2025-10-30T19:49:10.841225] [INFO ] [MAIN ] MDST: Loaded 6233 existing records. [2025-10-30T19:49:10.902825] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-30T19:49:11.018966] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:11.019172] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-30T19:49:11.019220] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-30T19:49:11.019440] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-30T19:49:11.019499] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-30T19:49:11.398866] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-30T19:49:11.398072] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:11.697496] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-30T19:49:12.087992] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-30T19:49:12.497500] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-30T19:49:12.729919] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-30T19:49:12.920169] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-30T19:49:13.297517] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-30T19:49:14.097562] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-30T19:49:14.366992] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-30T19:49:14.897512] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-30T19:49:15.170091] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-30T19:49:15.697466] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-30T19:49:15.947772] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-30T19:49:15.953211] [INFO ] [REMOTE ] MCS: Full fetch complete (30814 records). [2025-10-30T19:49:15.953314] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-30T19:49:16.217452] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-30T19:49:16.334452] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-30T19:49:16.334525] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-30T19:49:16.335150] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-30T19:49:16.335209] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-30T19:49:16.335901] [DEBUG] [LOCAL ] MCS: Trimmed 30814 records to 21278 (keeping 200 days of data) [2025-10-30T19:49:16.462057] [DEBUG] [LOCAL ] MCS: Primary data saved (21278 records). [2025-10-30T19:49:16.462176] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-30T19:49:16.462248] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols completed. MCS took 29.3s. Estimated remaining: 2h 15m 2s. Rate: 7.8 symbols/min [2025-10-30T19:49:16.502568] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-30T19:49:16.643346] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:16.691688] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-30T19:49:16.692007] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-30T19:49:16.871449] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:16.871703] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-30T19:49:16.871763] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-30T19:49:16.872988] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-30T19:49:16.873044] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-30T19:49:17.003819] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-30T19:49:17.232124] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:17.297462] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-30T19:49:18.097524] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-30T19:49:18.678421] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-30T19:49:18.897465] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-30T19:49:19.092158] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-30T19:49:19.280063] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T19:49:19.697488] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-30T19:49:20.059167] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-30T19:49:20.497508] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-30T19:49:21.297530] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-30T19:49:21.516215] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T19:49:22.097547] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-30T19:49:22.593223] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-30T19:49:22.897543] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-30T19:49:23.192542] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-30T19:49:23.697492] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-30T19:49:23.990748] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-30T19:49:24.263874] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-30T19:49:24.497520] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-30T19:49:25.297511] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-30T19:49:25.512993] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-30T19:49:26.097498] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-30T19:49:26.123279] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-30T19:49:26.897488] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-30T19:49:27.432802] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T19:49:27.697497] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-30T19:49:27.869435] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-30T19:49:28.241585] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-30T19:49:28.497536] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-30T19:49:29.297542] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-30T19:49:29.660559] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-30T19:49:30.097482] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-30T19:49:30.669104] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-30T19:49:30.897516] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-30T19:49:31.232711] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-30T19:49:31.697491] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-30T19:49:32.280947] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T19:49:32.497518] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-30T19:49:32.813695] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-30T19:49:32.927184] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-30T19:49:33.297495] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-30T19:49:34.097559] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-30T19:49:34.548675] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-30T19:49:34.562877] [INFO ] [REMOTE ] MD: Full fetch complete (55399 records). [2025-10-30T19:49:34.563546] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-30T19:49:34.563623] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-30T19:49:34.905298] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-30T19:49:34.960021] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-30T19:49:34.960098] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-30T19:49:34.960924] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-30T19:49:34.960986] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-30T19:49:34.962242] [DEBUG] [LOCAL ] MD: Trimmed 55399 records to 38731 (keeping 200 days of data) [2025-10-30T19:49:35.181562] [DEBUG] [LOCAL ] MD: Primary data saved (38731 records). [2025-10-30T19:49:35.181752] [INFO ] [MAIN ] MD: Full history saved. [2025-10-30T19:49:35.181854] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols completed. MD took 26.9s. Estimated remaining: 2h 15m 3s. Rate: 7.8 symbols/min [2025-10-30T19:49:35.680464] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-30T19:49:35.697451] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-30T19:49:36.420988] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-30T19:49:36.497513] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-30T19:49:37.297520] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-30T19:49:37.843042] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-30T19:49:38.097487] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-30T19:49:38.195807] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T19:49:38.897473] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-30T19:49:39.374930] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-30T19:49:39.442709] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-30T19:49:39.697501] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-30T19:49:40.302871] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-30T19:49:40.306190] [INFO ] [REMOTE ] MDST: Full fetch complete (8968 records). [2025-10-30T19:49:40.306323] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-30T19:49:40.510688] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-30T19:49:40.719551] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-30T19:49:40.719681] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-30T19:49:40.720057] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-30T19:49:40.720106] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-30T19:49:40.720604] [DEBUG] [LOCAL ] MDST: Trimmed 8968 records to 6284 (keeping 200 days of data) [2025-10-30T19:49:40.760036] [DEBUG] [LOCAL ] MDST: Primary data saved (6284 records). [2025-10-30T19:49:40.760215] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-30T19:49:40.760317] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols completed. MDST took 30.1s. Estimated remaining: 2h 14m 53s. Rate: 7.8 symbols/min [2025-10-30T19:49:41.297519] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-30T19:49:41.523835] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-30T19:49:41.528681] [INFO ] [REMOTE ] MCY: Full fetch complete (39717 records). [2025-10-30T19:49:41.528776] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-30T19:49:41.908576] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-30T19:49:41.908678] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-30T19:49:41.909528] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-30T19:49:41.909574] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-30T19:49:41.910584] [DEBUG] [LOCAL ] MCY: Trimmed 39717 records to 22993 (keeping 200 days of data) [2025-10-30T19:49:42.053313] [DEBUG] [LOCAL ] MCY: Primary data saved (22993 records). [2025-10-30T19:49:42.053464] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-30T19:49:42.053560] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols completed. MCY took 33.8s. Estimated remaining: 2h 14m 40s. Rate: 7.8 symbols/min [2025-10-30T19:49:42.668188] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-30T19:49:42.679503] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-30T19:49:44.362134] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-30T19:49:44.373662] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-30T19:49:44.373785] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-30T19:49:44.760680] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-30T19:49:44.760799] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-30T19:49:44.761866] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-30T19:49:44.761932] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-30T19:49:44.763433] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 54068 (keeping 200 days of data) [2025-10-30T19:49:45.089291] [DEBUG] [LOCAL ] MDT: Primary data saved (54068 records). [2025-10-30T19:49:45.089421] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-30T19:49:45.090328] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols completed. MDT took 28.6s. Estimated remaining: 2h 14m 29s. Rate: 7.8 symbols/min [2025-10-30T19:49:45.665974] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:45.739008] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:45.704749] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:45.796194] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:45.806460] [DEBUG] [LOCAL ] MDV: Loaded 8265 existing records from primary storage. [2025-10-30T19:49:45.806939] [INFO ] [MAIN ] MDV: Loaded 8265 existing records. [2025-10-30T19:49:45.921869] [DEBUG] [LOCAL ] MED: Loaded 20570 existing records from primary storage. [2025-10-30T19:49:45.937671] [INFO ] [MAIN ] MED: Loaded 20570 existing records. [2025-10-30T19:49:45.949807] [DEBUG] [LOCAL ] MEC: Loaded 17023 existing records from primary storage. [2025-10-30T19:49:45.961529] [INFO ] [MAIN ] MEC: Loaded 17023 existing records. [2025-10-30T19:49:46.211567] [DEBUG] [LOCAL ] MDU: Loaded 47929 existing records from primary storage. [2025-10-30T19:49:46.276260] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:46.286707] [INFO ] [MAIN ] MDU: Loaded 47929 existing records. [2025-10-30T19:49:46.297143] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-30T19:49:46.376978] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-30T19:49:46.401734] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-30T19:49:46.492956] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:46.501388] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:46.463463] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-30T19:49:46.517201] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-30T19:49:46.534316] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-30T19:49:46.528920] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-30T19:49:46.563397] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-30T19:49:46.611502] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-30T19:49:46.662937] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-30T19:49:46.579131] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-30T19:49:46.710237] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:46.730690] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-30T19:49:46.744742] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-30T19:49:46.765529] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-30T19:49:46.885230] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-30T19:49:46.990498] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-30T19:49:47.792929] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:47.939454] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-30T19:49:48.019340] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:48.047214] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-30T19:49:48.134699] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:48.159176] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-30T19:49:48.199600] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:48.199963] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-30T19:49:48.382186] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-30T19:49:48.384095] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-30T19:49:48.720891] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-30T19:49:48.723885] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-30T19:49:48.756233] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-30T19:49:48.759604] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-30T19:49:48.830163] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-30T19:49:48.835361] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-30T19:49:49.243252] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-30T19:49:49.272333] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-30T19:49:49.297462] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-30T19:49:49.380185] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-30T19:49:49.676442] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-30T19:49:49.970901] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-30T19:49:50.097490] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-30T19:49:50.897488] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-30T19:49:51.274202] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-30T19:49:51.549697] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-30T19:49:51.697494] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-30T19:49:52.427717] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-30T19:49:52.497464] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-30T19:49:53.117328] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-30T19:49:53.297458] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-30T19:49:53.818424] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-30T19:49:54.097480] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-30T19:49:54.847278] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-30T19:49:54.897507] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-30T19:49:55.526756] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-30T19:49:55.697488] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-30T19:49:56.497463] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-30T19:49:56.605240] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T19:49:56.610183] [INFO ] [REMOTE ] MEC: Full fetch complete (23284 records). [2025-10-30T19:49:56.610265] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-30T19:49:57.021118] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-30T19:49:57.021257] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-30T19:49:57.022251] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-30T19:49:57.022323] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-30T19:49:57.023400] [DEBUG] [LOCAL ] MEC: Trimmed 23284 records to 17160 (keeping 200 days of data) [2025-10-30T19:49:57.129201] [DEBUG] [LOCAL ] MEC: Primary data saved (17160 records). [2025-10-30T19:49:57.129392] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-30T19:49:57.129493] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols completed. MEC took 12.0s. Estimated remaining: 2h 14m 25s. Rate: 7.8 symbols/min [2025-10-30T19:49:57.302341] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:49:57.302457] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-30T19:49:57.338062] [DEBUG] [LOCAL ] MEG: Loaded 31038 existing records from primary storage. [2025-10-30T19:49:57.338451] [INFO ] [MAIN ] MEG: Loaded 31038 existing records. [2025-10-30T19:49:57.528361] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:49:57.528693] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-30T19:49:57.528757] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-30T19:49:57.529183] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-30T19:49:57.529246] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-30T19:49:57.895587] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-30T19:49:57.957725] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:49:57.996001] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T19:49:58.097518] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-30T19:49:58.641624] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-30T19:49:58.897547] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-30T19:49:59.697526] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-30T19:49:59.820181] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-30T19:50:00.204530] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-30T19:50:00.497523] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-30T19:50:01.297532] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-30T19:50:01.833342] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-30T19:50:02.097579] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-30T19:50:02.153749] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-30T19:50:02.897540] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-30T19:50:03.310027] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-30T19:50:03.499841] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-30T19:50:03.697501] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-30T19:50:04.497573] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-30T19:50:05.042139] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-30T19:50:05.297475] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-30T19:50:05.415004] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-30T19:50:06.097469] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-30T19:50:06.440407] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-30T19:50:06.852518] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-30T19:50:06.897455] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-30T19:50:07.697485] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-30T19:50:07.751616] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-30T19:50:08.497547] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-30T19:50:08.767446] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-30T19:50:09.297466] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-30T19:50:09.474471] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-30T19:50:09.834914] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-30T19:50:10.097511] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-30T19:50:10.897532] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-30T19:50:11.243774] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-30T19:50:11.297054] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T19:50:11.697510] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-30T19:50:12.497508] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-30T19:50:13.105443] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-30T19:50:13.118444] [INFO ] [REMOTE ] MDU: Full fetch complete (70778 records). [2025-10-30T19:50:13.118619] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-30T19:50:13.251707] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-30T19:50:13.281831] [INFO ] [REMOTE ] MDV: Full fetch complete (11802 records). [2025-10-30T19:50:13.292943] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-30T19:50:13.301374] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-30T19:50:13.827667] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-30T19:50:13.835369] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-30T19:50:13.843115] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-30T19:50:13.848430] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-30T19:50:13.922284] [DEBUG] [LOCAL ] MDU: Trimmed 70778 records to 48305 (keeping 200 days of data) [2025-10-30T19:50:13.955466] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-30T19:50:13.955582] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-30T19:50:13.955772] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-30T19:50:13.956165] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-30T19:50:13.956777] [DEBUG] [LOCAL ] MDV: Trimmed 11802 records to 8313 (keeping 200 days of data) [2025-10-30T19:50:14.121275] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-30T19:50:14.185042] [DEBUG] [LOCAL ] MDV: Primary data saved (8313 records). [2025-10-30T19:50:14.185326] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-30T19:50:14.194164] [INFO ] [MAIN ] Update Progress: 1322/2366 symbols completed. MDV took 29.1s. Estimated remaining: 2h 14m 24s. Rate: 7.8 symbols/min [2025-10-30T19:50:14.476209] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:50:14.487856] [DEBUG] [LOCAL ] MDU: Primary data saved (48305 records). [2025-10-30T19:50:14.488038] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-30T19:50:14.488153] [INFO ] [MAIN ] Update Progress: 1323/2366 symbols completed. MDU took 29.4s. Estimated remaining: 2h 14m 11s. Rate: 7.8 symbols/min [2025-10-30T19:50:14.679216] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:50:14.680523] [DEBUG] [LOCAL ] MEGI: Loaded 19577 existing records from primary storage. [2025-10-30T19:50:14.680997] [INFO ] [MAIN ] MEGI: Loaded 19577 existing records. [2025-10-30T19:50:14.794664] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-30T19:50:14.904550] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-30T19:50:14.911253] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:50:14.913177] [DEBUG] [LOCAL ] MEI: Loaded 30894 existing records from primary storage. [2025-10-30T19:50:14.913550] [INFO ] [MAIN ] MEI: Loaded 30894 existing records. [2025-10-30T19:50:14.913636] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-30T19:50:14.913751] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-30T19:50:14.970748] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-30T19:50:14.979778] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-30T19:50:15.215470] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:50:15.231446] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-30T19:50:15.254275] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-30T19:50:15.295753] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-30T19:50:15.377707] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-30T19:50:15.390419] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T19:50:15.636005] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:50:15.705573] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-30T19:50:15.861185] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:50:15.886224] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-30T19:50:16.498164] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-30T19:50:16.499501] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-30T19:50:17.297522] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-30T19:50:17.496061] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-30T19:50:18.007133] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-30T19:50:18.097464] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-30T19:50:18.809051] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-30T19:50:18.897464] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-30T19:50:19.697468] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-30T19:50:19.755586] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-30T19:50:19.760178] [INFO ] [REMOTE ] MED: Full fetch complete (31630 records). [2025-10-30T19:50:19.760268] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-30T19:50:20.125958] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-30T19:50:20.126039] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-30T19:50:20.126761] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-30T19:50:20.126826] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-30T19:50:20.127670] [DEBUG] [LOCAL ] MED: Trimmed 31630 records to 20694 (keeping 200 days of data) [2025-10-30T19:50:20.248477] [DEBUG] [LOCAL ] MED: Primary data saved (20694 records). [2025-10-30T19:50:20.248597] [INFO ] [MAIN ] MED: Full history saved. [2025-10-30T19:50:20.248692] [INFO ] [MAIN ] Update Progress: 1324/2366 symbols completed. MED took 35.2s. Estimated remaining: 2h 14m 1s. Rate: 7.8 symbols/min [2025-10-30T19:50:20.420092] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:50:20.468486] [DEBUG] [LOCAL ] MET: Loaded 53276 existing records from primary storage. [2025-10-30T19:50:20.468813] [INFO ] [MAIN ] MET: Loaded 53276 existing records. [2025-10-30T19:50:20.500001] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-30T19:50:20.653636] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:50:20.670788] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-30T19:50:20.671391] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-30T19:50:20.672005] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-30T19:50:20.674506] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-30T19:50:20.679010] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-30T19:50:21.025660] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:50:21.177963] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-30T19:50:21.297467] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-30T19:50:22.097514] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-30T19:50:22.555114] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-30T19:50:22.824548] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-30T19:50:22.897465] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-30T19:50:23.697476] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-30T19:50:23.915113] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-30T19:50:24.384240] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-30T19:50:24.497487] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-30T19:50:25.297505] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-30T19:50:25.433590] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-30T19:50:26.103036] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-30T19:50:26.121245] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-30T19:50:26.883493] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-30T19:50:26.897447] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-30T19:50:27.697492] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-30T19:50:27.937400] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-30T19:50:28.470142] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-30T19:50:28.497468] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-30T19:50:29.297477] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-30T19:50:29.314782] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-30T19:50:30.097498] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-30T19:50:30.542852] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-30T19:50:30.897520] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-30T19:50:31.172629] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-30T19:50:31.677015] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-30T19:50:31.697467] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-30T19:50:32.418464] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-30T19:50:32.497529] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-30T19:50:33.217757] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-30T19:50:33.297488] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-30T19:50:34.097516] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-30T19:50:34.195509] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-30T19:50:34.897479] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-30T19:50:35.068354] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-30T19:50:35.697490] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-30T19:50:36.396778] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-30T19:50:36.497478] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-30T19:50:36.867440] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-30T19:50:36.874768] [INFO ] [REMOTE ] MEG: Full fetch complete (46966 records). [2025-10-30T19:50:36.874896] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-30T19:50:37.243846] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-30T19:50:37.243922] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-30T19:50:37.244697] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-30T19:50:37.244759] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-30T19:50:37.245695] [DEBUG] [LOCAL ] MEG: Trimmed 46966 records to 31254 (keeping 200 days of data) [2025-10-30T19:50:37.300849] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-30T19:50:37.433053] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-30T19:50:37.453893] [DEBUG] [LOCAL ] MEG: Primary data saved (31254 records). [2025-10-30T19:50:37.453999] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-30T19:50:37.454069] [INFO ] [MAIN ] Update Progress: 1325/2366 symbols completed. MEG took 40.3s. Estimated remaining: 2h 14m 1s. Rate: 7.8 symbols/min [2025-10-30T19:50:37.618625] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:50:37.660748] [DEBUG] [LOCAL ] MFA: Loaded 45058 existing records from primary storage. [2025-10-30T19:50:37.661028] [INFO ] [MAIN ] MFA: Loaded 45058 existing records. [2025-10-30T19:50:37.841264] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:50:37.841519] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-30T19:50:37.841569] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-30T19:50:37.841849] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-30T19:50:37.841908] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-30T19:50:38.097627] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-30T19:50:38.207634] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:50:38.230472] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-30T19:50:38.897518] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-30T19:50:39.320896] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-30T19:50:39.697516] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-30T19:50:40.141333] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-30T19:50:40.497544] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-30T19:50:40.800883] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-30T19:50:41.297495] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-30T19:50:41.593054] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-30T19:50:42.097517] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-30T19:50:42.207459] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-30T19:50:42.214002] [INFO ] [REMOTE ] MEI: Full fetch complete (45245 records). [2025-10-30T19:50:42.214106] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-30T19:50:42.594320] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-30T19:50:42.594422] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-30T19:50:42.595285] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-30T19:50:42.595348] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-30T19:50:42.596315] [DEBUG] [LOCAL ] MEI: Trimmed 45245 records to 31087 (keeping 200 days of data) [2025-10-30T19:50:42.773025] [DEBUG] [LOCAL ] MEI: Primary data saved (31087 records). [2025-10-30T19:50:42.773154] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-30T19:50:42.773233] [INFO ] [MAIN ] Update Progress: 1326/2366 symbols completed. MEI took 28.3s. Estimated remaining: 2h 13m 52s. Rate: 7.8 symbols/min [2025-10-30T19:50:42.908889] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-30T19:50:42.939881] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:50:42.946691] [DEBUG] [LOCAL ] MFAN: Loaded 4140 existing records from primary storage. [2025-10-30T19:50:42.946906] [INFO ] [MAIN ] MFAN: Loaded 4140 existing records. [2025-10-30T19:50:43.126207] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:50:43.126536] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-30T19:50:43.126754] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-30T19:50:43.126925] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-30T19:50:43.126982] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-30T19:50:43.506897] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-30T19:50:43.551538] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:50:43.697475] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-30T19:50:44.105764] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-30T19:50:44.288718] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-30T19:50:44.497577] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-30T19:50:44.791447] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-30T19:50:45.297502] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-30T19:50:46.097518] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-30T19:50:46.474990] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-30T19:50:46.897546] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-30T19:50:47.365664] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T19:50:47.697482] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-30T19:50:48.132314] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-30T19:50:48.497469] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-30T19:50:48.930722] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-30T19:50:49.297510] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-30T19:50:49.658001] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-30T19:50:50.097553] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-30T19:50:50.145127] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-30T19:50:50.897557] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-30T19:50:51.417621] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-30T19:50:51.552970] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-30T19:50:51.697489] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-30T19:50:52.497476] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-30T19:50:52.532306] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-30T19:50:52.536697] [INFO ] [REMOTE ] MEGI: Full fetch complete (28918 records). [2025-10-30T19:50:52.536775] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-30T19:50:52.889626] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-30T19:50:52.903931] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-30T19:50:52.904016] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-30T19:50:52.904636] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-30T19:50:52.904723] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-30T19:50:52.905428] [DEBUG] [LOCAL ] MEGI: Trimmed 28918 records to 19747 (keeping 200 days of data) [2025-10-30T19:50:53.020919] [DEBUG] [LOCAL ] MEGI: Primary data saved (19747 records). [2025-10-30T19:50:53.021058] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-30T19:50:53.021139] [INFO ] [MAIN ] Update Progress: 1327/2366 symbols completed. MEGI took 38.8s. Estimated remaining: 2h 13m 46s. Rate: 7.8 symbols/min [2025-10-30T19:50:53.188621] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:50:53.193734] [DEBUG] [LOCAL ] MFAO: Loaded 3761 existing records from primary storage. [2025-10-30T19:50:53.193894] [INFO ] [MAIN ] MFAO: Loaded 3761 existing records. [2025-10-30T19:50:53.302707] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-30T19:50:53.369604] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:50:53.369805] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-30T19:50:53.369886] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-30T19:50:53.370053] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-30T19:50:53.370108] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-30T19:50:53.750817] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:50:53.778800] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-30T19:50:54.097528] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-30T19:50:54.575528] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-30T19:50:54.897549] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-30T19:50:55.697508] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-30T19:50:56.451220] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-30T19:50:56.463020] [INFO ] [REMOTE ] MET: Full fetch complete (77347 records). [2025-10-30T19:50:56.463182] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-30T19:50:56.505738] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-30T19:50:56.877699] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-30T19:50:56.878035] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-30T19:50:56.879273] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-30T19:50:56.879364] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-30T19:50:56.881298] [DEBUG] [LOCAL ] MET: Trimmed 77347 records to 53660 (keeping 200 days of data) [2025-10-30T19:50:56.913441] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-30T19:50:56.970289] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-30T19:50:57.252423] [DEBUG] [LOCAL ] MET: Primary data saved (53660 records). [2025-10-30T19:50:57.252557] [INFO ] [MAIN ] MET: Full history saved. [2025-10-30T19:50:57.253762] [INFO ] [MAIN ] Update Progress: 1328/2366 symbols completed. MET took 37.0s. Estimated remaining: 2h 13m 35s. Rate: 7.8 symbols/min [2025-10-30T19:50:57.306290] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-30T19:50:57.422152] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:50:57.473682] [DEBUG] [LOCAL ] MFC: Loaded 50849 existing records from primary storage. [2025-10-30T19:50:57.474034] [INFO ] [MAIN ] MFC: Loaded 50849 existing records. [2025-10-30T19:50:57.695612] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:50:57.695822] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-30T19:50:57.695869] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-30T19:50:57.696268] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-30T19:50:57.696324] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-30T19:50:57.800861] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-30T19:50:58.052066] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-15 to 2025-10-30 (requires 10 months of data pull). [2025-10-30T19:50:58.097462] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-30T19:50:58.897522] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-30T19:50:59.216292] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-30T19:50:59.254101] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-30T19:50:59.697498] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-30T19:51:00.142284] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-30T19:51:00.497479] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-30T19:51:01.134061] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-30T19:51:01.297507] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-30T19:51:02.097507] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-30T19:51:02.498228] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-30T19:51:02.534407] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-30T19:51:02.897510] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-30T19:51:03.697481] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-30T19:51:03.984254] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-30T19:51:04.046206] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-30T19:51:04.497490] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-30T19:51:04.880969] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-30T19:51:05.297505] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-30T19:51:06.097517] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-30T19:51:06.607100] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-30T19:51:06.607454] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-30T19:51:06.897543] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-30T19:51:07.697496] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-30T19:51:08.074171] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-30T19:51:08.267190] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-30T19:51:08.268865] [INFO ] [REMOTE ] MFAN: Full fetch complete (5921 records). [2025-10-30T19:51:08.268937] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-30T19:51:08.502745] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-30T19:51:08.642029] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-30T19:51:08.642112] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-30T19:51:08.642286] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-30T19:51:08.642327] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-30T19:51:08.642732] [DEBUG] [LOCAL ] MFAN: Trimmed 5921 records to 4162 (keeping 200 days of data) [2025-10-30T19:51:08.667755] [DEBUG] [LOCAL ] MFAN: Primary data saved (4162 records). [2025-10-30T19:51:08.667869] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-30T19:51:08.667948] [INFO ] [MAIN ] Update Progress: 1329/2366 symbols completed. MFAN took 25.9s. Estimated remaining: 2h 13m 31s. Rate: 7.8 symbols/min [2025-10-30T19:51:08.842274] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-22 to 2025-10-30. [2025-10-30T19:51:08.888633] [DEBUG] [LOCAL ] MFG: Loaded 49368 existing records from primary storage. [2025-10-30T19:51:08.888990] [INFO ] [MAIN ] MFG: Loaded 49368 existing records. [2025-10-30T19:51:08.968213] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-30T19:51:09.084487] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-15 for 200 day retention. Performing full refresh. [2025-10-30T19:51:09.084739] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-30T19:51:09.084795] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-30T19:51:09.084984] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-30T19:51:09.085024] [INFO ]